robots.txt is plain text
You can also use your local clone with
A barebones textboard for the Gemini protocol, written in Haskell
This package serves also as an example for the other haskell-gemini libraries.
More info at https://sr.ht/~fgaz/haskell-gemini/
I have an instance online at gemini-textboard.fgaz.me