TeaSanctuary/teasanctuary.ru
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Заблокировал некоторых особо надоедливых ботов

Browse source
This commit is contained in:
Иван Кузьменко 2025-04-08 23:34:48 +03:00
parent 5ac3dc07f0
commit 7d0f521d8f
1 changed files with 8 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
static/robots.txt
View file

@ -1,3 +1,11 @@
User-agent: SemrushBot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: *
Allow: /