michael/pyfedi
1
0
Fork 0
mirror of https://codeberg.org/rimu/pyfedi synced 2025-01-23 19:36:56 -08:00
Code Issues Projects Releases Packages Wiki Activity Actions

disallow amazonbot

Browse source
This commit is contained in:
rimu 2024-07-20 13:56:55 +08:00
parent 1a4b2810d6
commit d2cc5aa453
1 changed files with 4 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
app/templates/robots.txt
View file

@ -35,4 +35,7 @@ User-agent: MJ12bot
Disallow: / Disallow: /
User-agent: ClaudeBot User-agent: ClaudeBot
Disallow: / Disallow: /
User-agent: Amazonbot
Disallow: /