Show HN: LLMS.Page – Public LLMS.txt Endpoint
llms.pageWe're sharing a free and public llms.txt generator and endpoint.
Our approach: we crawl your main page, then parse metatags and links to construct the llms.txt. The key is that this process happens without relying on any LLMs, which keeps it very fast and our operational costs extremely low. This allows us to offer it completely free.
Check it out on the homepage, or just send a GET request:
https://get.llms.page/{yourwebsite}/llms.txt
We'd appreciate any feedback or suggestions for features/improvements.
Curious if this will ever be open sourced?? Super cool project!
Yeah, once we’re happy with the algorithm, we’ll definitely publish it as open source!