Robots.txt Generator

Generate robots.txt file to control search engine crawlers

Category:SEO Tools

User Agent:

Sitemap URL:

Allow Paths

Disallow Paths

Crawl Delay (seconds):

How to use:

Set user agent (default: * for all bots)
Add paths to allow or disallow
Optionally set sitemap URL and crawl delay
Click "Generate robots.txt" to create the file
Upload robots.txt to your website root directory