Visual robots.txt manager for AI crawlers. Supports toggle controls for 20+ bots including GPTBot, ClaudeBot, and PerplexityBot to control AI scraping.
Carregando......
Nesta página
robotstxt-ai
Manages robots.txt for AI bots.
Open-source, free.
Explore mais itens relacionados a este