3 Commits

Author	SHA1	Message	Date
Dave Jansen	359512d589	Updated robots.txt and added ai.txt	2024-08-06 09:10:54 +09:00
Dave Jansen	335a54fc91	Disallow /ghost in robots.txt	2024-08-06 09:10:06 +09:00
Dave Jansen	73f01f42f8	Add initial robots.txt. ... Contains disallows for several known AI/GPT related bots.	2024-08-06 09:10:06 +09:00