michael/pyfedi
1
0
Fork 0
mirror of https://codeberg.org/rimu/pyfedi synced 2025-01-23 19:36:56 -08:00
Code Issues Projects Releases Packages Wiki Activity Actions

add barkrowler to robots.txt

Browse source
This commit is contained in:
rimu 2025-01-08 14:25:23 +13:00
parent 8618d43c1c
commit d8c9e04617
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
app/templates/robots.txt
View file

@ -39,3 +39,6 @@ Disallow: /
User-agent: Amazonbot User-agent: Amazonbot
Disallow: / Disallow: /
User-agent: barkrowler
Disallow: /