robots.txt Generator

Build a robots.txt with allow/disallow rules for crawlers.

Input

Output

Suggested Tools

Meta Tag Generator
Generate HTML meta tags for title, description, and basic SEO fields.
Open Graph Generator
Generate Open Graph meta tags for richer link previews on social networks.
sitemap.xml Generator
Generate a basic sitemap.xml URL list for search engine discovery.

robots.txt Generator helps you draft crawl rules before deploying to the site root.

Set paths and user-agents as available, run, and copy the robots.txt content.

Please enable JavaScript.