# llmstxtscan.com > Free cross-platform llms.txt generator: crawls any site server-side, selects the pages an AI should read, and documents every inclusion decision. Nothing is stored. ## Core - [llms.txt Generator](https://llmstxtscan.com): Crawl a site, get a spec-compliant llms.txt, review the full inclusion decision table. - [llms.txt Validator](https://llmstxtscan.com/validator): Validate any llms.txt against the proposal: H1, summary, sections, link format, link reachability. ## Comparisons - [llms.txt vs robots.txt](https://llmstxtscan.com/vs/robots-txt): Access control versus reading guidance — why most sites need both files. - [llms.txt vs Schema.org](https://llmstxtscan.com/vs/schema): Sitewide page index versus per-page structured-data vocabulary, and when each wins. - [llms.txt vs JSON-LD](https://llmstxtscan.com/vs/json-ld): Curation layer versus data layer, with format-level differences and code samples.