DevTools.run

robots.txt Generator

Generate a robots.txt file for your website.

robots.txt
User-agent: *
Disallow: /admin
Disallow: /api
Disallow: /private
Crawl-delay: 10

Sitemap: https://example.com/sitemap.xml