SEO
Robots.txt Generator
Compose a robots.txt with rules and AI crawler controls.
Loading tool…
About this tool
Generate a robots.txt with per-user-agent allow/disallow rules and modern AI crawler support (GPTBot, ClaudeBot, PerplexityBot, Google-Extended). Download instantly.
Frequently asked questions
Where do I place robots.txt?
At the root of your domain, e.g. https://example.com/robots.txt.