Robots.txt Generator
Build a valid robots.txt for search engines and AI crawlers — configured entirely in your browser
Crawler rules
One group per user-agent. Paths go one per line.
robots.txt
Save at your site root
User-agent: *
Disallow: /admin/
Disallow: /private/
Sitemap: https://example.com/sitemap.xml
Frequently asked questions
Related tools
Token Cost Calculator
Estimate LLM API costs from input and output token counts across OpenAI, Anthropic, and Google models — or plug in custom per-million-token prices
Sitemap.xml Generator
Turn a list of URLs into a valid XML sitemap for search engines, with optional lastmod, changefreq, and priority per the sitemaps.org schema
PWA Manifest Generator
Create a web app manifest.json for a Progressive Web App — name, short name, theme and background colors, display mode, orientation, start URL, and icon entries
Security.txt Generator
Generate an RFC 9116 security.txt with Contact, Expires, Encryption, Acknowledgments, Policy and more so researchers know how to report vulnerabilities to you
HTTP Header Builder
Assemble HTTP request headers from a form and export them as a raw request block, a curl command, or a JavaScript fetch() call
IPv6 Address Expander
Expand a compressed IPv6 address to its full 8-group form and compress it back per RFC 5952 — with validation, embedded-IPv4 support, and a per-group breakdown