# llms.txt Generator

> Free web tool that drafts an llms.txt file (llmstxt.org format) from a website's robots.txt, sitemap and up to 30 pages, and writes robots.txt rules for 20 AI crawlers with three policies: allow, search-only, block.

Nothing is stored. The tool's crawler identifies itself as `llms-txt-generator` and follows robots.txt.

## Main pages

- [llms.txt generator](https://llms-txt-generator-e58.pages.dev/): Enter a URL, get an llms.txt, a robots.txt block for AI crawlers and a report (pages without meta description, errors, current AI crawler access).
- [What is llms.txt?](https://llms-txt-generator-e58.pages.dev/what-is-llms-txt): The llmstxt.org format, an example, llms-full.txt, and what Google Search, Lighthouse, OpenAI, Anthropic and Perplexity have actually said about it.
- [robots.txt rules for AI crawlers](https://llms-txt-generator-e58.pages.dev/robots-txt-ai-crawlers): Official user-agent tokens of 20 AI crawlers with sources (checked 2026-10-07) and three ready-to-paste policies.

## Optional

- [Legal notice and privacy](https://llms-txt-generator-e58.pages.dev/legal): Publisher, host, privacy, and details about the llms-txt-generator crawler.