robots.txt Generator

Generate a robots.txt file for your website.

Sitemap URL

Disallowed paths (one per line)

Crawl delay (seconds)

robots.txt

User-agent: *
Disallow: /admin
Disallow: /api
Disallow: /private
Crawl-delay: 10

Sitemap: https://example.com/sitemap.xml