Robots.txt Generator

Create a robots.txt file to control how search engines crawl your website.

Configuration

Seconds between requests (not all bots support this)

Rules

Common Disallow Paths

Processing...