Robots Txt Generator
Generate a robots.txt file that tells search-engine crawlers which parts of your site they may visit.
- Runs in your browser No upload — everything runs on your device.
- No sign-up, no watermark Free to use, no account needed.
- Files never uploaded Nothing leaves your device.
- 5,400+ tools, one site File, unit and currency tools in one place.
Generate a robots.txt file that tells search-engine crawlers which parts of your site they may visit. You set the user-agent the rules apply to, the paths crawlers are allowed to visit, the paths they must stay away from, an optional sitemap address, and an optional crawl delay in seconds. Each allow and disallow entry becomes its own line, so a comma-separated list of paths turns into the exact directives crawlers expect. The crawl delay is checked to be between zero and sixty seconds, and the file is assembled in the standard order: user-agent first, then allow and disallow lines, then the delay and sitemap. The result is plain text you can save as robots.txt at the root of your site. Nothing is uploaded and nothing is stored — the file is built in your browser, with no account and no sign-up. Use it when launching a site, or when a private area such as an admin panel starts appearing in search results.
How to use Robots Txt Generator
- Set the options adjust the settings below — length, range, colours or dates.
- Click Convert the tool runs entirely in your browser — nothing is uploaded.
- Read your result it appears below the tool.
- Download the result save it for your records.
- Convert another change the options and convert again — no sign-up, no limits.
Format facts
| Input | No file needed — set the options below the box and convert. |
|---|---|
| Engine | Built-in browser engine |
| Category | Developer Tools |
Frequently asked questions
What does a robots.txt file do?
It tells search-engine crawlers which parts of your site they may visit and which they must stay away from. It is a request, not a lock — well-behaved crawlers follow it, but it does not block anyone who ignores it.
What should I put in the disallow list?
Paths that should never appear in search results, such as an admin panel, a login page, or a private uploads folder. List each path separately, separated by commas in the form.
Do I need a sitemap line?
No, it is optional. If you have a sitemap, adding its address helps crawlers find your pages. If you do not have one, leave the field blank and the line is left out.
Where does the file go?
Save it as robots.txt in the root of your site, so it is reachable at your domain followed by /robots.txt. Crawlers look for it there.
Was this tool helpful?
Thanks — your feedback helps us improve this tool.
Sorry it didn’t help — tell us what went wrong and we’ll fix it.