UT
UsefulToolkit
Home
About
Contact
Blog
Home
About
Contact
Blog
Home
/
SEO & Marketing
/
Robots.txt Generator
Robots.txt Generator
Generate robots.txt files with allow/disallow rules.
Sitemap URL
Crawl Delay (seconds)
Rule #1
User-agent
Allow (one per line)
/
Disallow (one per line)
/admin/ /private/
+ Add Rule
robots.txt Output
Copy
User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ Sitemap: https://example.com/sitemap.xml