Robots.txt Generator

Build a valid robots.txt in seconds. Includes one-click blocking for AI crawlers like GPTBot, ClaudeBot, and PerplexityBot.

Crawler access

Disallowed paths — one per line

Sitemap URL(s) — one per line

Block AI crawlers

robots.txt

User-agent: *
Allow: /
Disallow: /admin
Disallow: /dashboard
Disallow: /api/private

Sitemap: https://example.com/sitemap.xml