Crawlsonar
AI & agents

llms.txt

A simple file at your site root that gives AI tools a curated map of your most important pages.

In plain English

Where a sitemap lists every page, llms.txt is a short, hand-picked table of contents for AI: your site name, a one-line summary, then a few sections of key links each with a short description. When an AI tool reads it, it spends its limited attention on the pages you chose rather than guessing.

It won't change your Google ranking, but it helps AI assistants and answer engines find and describe your best content.

How to fix / set it up

  1. List the pages that matter most to a newcomer (products, pricing, docs, key articles).
  2. Draft it with our llms.txt Generator, then trim and add one-line descriptions.
  3. Publish it at your site root and validate with the llms.txt Checker.

llms.txt Generatorllms.txt Checker

The technical detail

It's a Markdown file served at https://yoursite/llms.txt as text/plain or text/markdown: an H1, a summary blockquote, then ## sections of - [Title](url): description links. Keep it curated (~50 links), not a dump.

FAQ

Does Google use llms.txt?

No — Google Search ignores it. Publish it for AI tools, assistants and answer engines.

Where does the file go?

At the root of your site: https://example.com/llms.txt.

Related

← All topics in the knowledge base