(Insight) GEO · 4 min · 2026-10-24

What Is llms.txt? A Proposed File for AI

llms.txt is a proposed Markdown file that gives an AI agent a short, curated map of a site. Jeremy Howard published the proposal on 3 September 2024. The only required part is an H1 naming the site or project. It does not replace robots.txt or a sitemap, and it does not promise an AI citation.

The /llms.txt file is a proposal by Jeremy Howard, dated 3 September 2024. The current page is labeled v2. It proposes a Markdown file that gives an agent brief background, guidance, and links to more detailed Markdown. The page calls that write-up an informal overview, open for community input. Google's SEO Starter Guide does not mention the file, and the proposal does not say a search engine requires it.

What the file contains

The proposal says a file named llms.txt can sit at /llms.txt or at a subpath such as /docs/llms.txt. A file covers the URLs under its path. If more than one file applies, the proposal says to use the most specific one.

The sections, in order, are:

  • An H1 with the name of the project or site. This is the only required section.
  • An optional blockquote with a short summary.
  • Optional paragraphs or lists, with no headings, for details about the project.
  • Optional H2 sections whose lists are links. Each item is a Markdown link, then optionally a colon and a note.
  • An Optional section, by convention, for links an agent can skip when it needs a shorter context.

The marketing site publishes one at https://iseoup.com/llms.txt. It has an H1, a blockquote, and H2 sections of links. That file shows the format. Publishing it does not promise a ranking or a citation.

How it differs from robots.txt and a sitemap

The proposal separates the files by job. robots.txt tells automated tools what access is considered acceptable, such as for search indexing bots. llms.txt is information an agent can read when it needs a topic while assisting a user. The proposal says it expected the file to be useful mainly during inference, and that a training run could use the information too.

A sitemap lists indexable URLs for search engines. The proposal says a sitemap is not a substitute: it often will not list Markdown versions of pages, it does not list helpful URLs on other sites, and the pages it lists are generally too much to drop into one context window.

A sitemap is also different from a change notice: What is IndexNow? is that ping, and it does not replace the sitemap or promise that a URL will be indexed.

What llms.txt does not do

Publishing the file does not make a page eligible, selectable, or citable. What does GEO stand for? states the limit already used on this site: a citation is an observation from a stored run, not something llms.txt, schema, or a vendor file can promise. Search engines and AI providers decide what to show.

How iSEOup treats llms.txt

The free AI crawler checker requests /llms.txt on the origin. It treats a non-empty text response as found. An HTML page at that URL is not counted as the file. If the file is missing, the check says it is optional, and that it gives AI tools a short, curated map of the site. The same check reads robots.txt for ten AI crawlers, looks for noindex, and checks whether a sitemap is reachable.

Generative engine optimization software is the control plane for one isolated domain. AI visibility is tracked as prompts, mentions, and citations. A governed work order and a production receipt are how a change is closed. The longer GEO reading is GEO insights. Answer selection is AEO software. Neither product treats an llms.txt file as a citation.

FAQ

What is llms.txt?

llms.txt is a proposed Markdown file that gives an AI agent a short, curated map of a website. Jeremy Howard published the proposal on 3 September 2024 (https://llmstxt.org/). The current page is labeled v2. Google's SEO Starter Guide does not mention the file, and the proposal does not say a search engine requires it.

Where does an llms.txt file go?

The proposal says the file is named llms.txt. It can sit at /llms.txt or at a subpath such as /docs/llms.txt. A file covers the URLs under its path. If more than one file applies, the proposal says to use the most specific one. iSEOup's free checker looks for /llms.txt on the site origin.

What has to be in an llms.txt file?

The only required section is an H1 with the name of the project or site. A blockquote summary is optional. Optional H2 sections can list Markdown links, each with a name, a URL, and an optional note. The proposal uses an Optional section, by convention, for links an agent can skip.

Is llms.txt the same as robots.txt or a sitemap?

No. The proposal says robots.txt tells automated tools what access is acceptable, while llms.txt is information an agent can read when it needs a topic. A sitemap lists indexable URLs for search engines. The proposal says a sitemap is not a substitute for llms.txt.

Does llms.txt guarantee an AI citation?

No. iSEOup treats a citation as an observation from a stored query run. A citation is not something llms.txt, schema, or a vendor file can promise. Search engines and AI providers decide what to show.

How does iSEOup use llms.txt?

The free AI crawler checker requests /llms.txt and describes a missing file as optional: a short, curated map for AI tools. It also checks robots.txt, noindex, and whether a sitemap is reachable. Generative engine optimization software tracks prompts, mentions, and citations separately. The file is not a citation.