teasanctuary.ru/static/robots.txt

12 lines
No EOL
201 B
Text

User-agent: SemrushBot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: *
Allow: /
Sitemap: https://teasanctuary.ru/sitemap.xml