

You just need to write the alt text inside the square brackets, like this:

This works in pretty much every platform that accepts Markdown images. If you want a reference for what Markdown syntax Lemmy supports, read this page.
Yep, the “Comments” thingy behind the text box gives it away