llms.txt Generator
Solo Builder·Side Project·2025
Generate structured llms.txt files from any website. Enter a URL, get LLM-ready content. Open source.
20
Pages Crawled
2
Output Files
SSE
Streaming
Zero
Storage
The Problem
The llms.txt standard helps AI models understand your site. But creating one manually means reading every page, writing summaries, and formatting it correctly. Nobody does it because it takes hours.
What I Built
Enter a URL. The tool crawls up to 20 pages via Firecrawl, extracts content, and produces two downloadable files: llms.txt (concise index with titles and descriptions) and llms-full.txt (complete text content in clean markdown). Real-time streaming progress via Server-Sent Events in a terminal-style UI. Bring your own Firecrawl API key. Nothing stored server-side.
Tech Stack
- React
- TypeScript
- Vite
- Hono
- Firecrawl
- Tailwind CSS
- shadcn/ui
Interested in working together?