Agentic Web Census

August 2026by Omitsis

English

Trends · Sites with a valid llms.txt

Sites with a valid llms.txt across the web

A valid llms.txt tells agents what matters. It has gone up since May 2026, by more than the margin allows us to call a wobble — though last month on its own did not move.

Poor13.1%

Sites with a valid llms.txt in August 2026

What the Sites with a valid llms.txt in August 2026 is, and how it is measured

Measured on 14,373 pages, 95.8% of which carried the agentic category, with a confidence margin of ±0.44 pp.

= +0.1 pp
Sites with a valid llms.txt in August 2026 over 4 months

3.1%13.1%

14.1%2.1%Sites with a valid llms.txt · May: 3.1%Sites with a valid llms.txt · June: 9.1%Sites with a valid llms.txt · July: 13.0%Sites with a valid llms.txt · August: 13.1%Sites with a valid llms.txtMayJuneJulyAugust
Sites with a valid llms.txt, May 2026 to August 2026, one measurement a month. The last step was inside the margin, so it is a tie.

What this measures

Who moved

How to read these figures

Every figure here comes from a sample, not from counting every site — so it carries a margin: how much it could move if we had happened to sample different pages. A figure measured on a thousand pages has a wide margin; one measured on a hundred thousand has a narrow one. It matters for one thing: two figures that differ by less than the wider of their margins are not one above the other, they are tied. That is why nothing here has a position number.
SegmentJuly 2026August 2026Movement
AccuWeather0.0%100.0%▲ +100.0 pp
Act-On100.0%0.0%▼ −100.0 pp
AddShoppers0.0%100.0%▲ +100.0 pp
Aweber100.0%0.0%▼ −100.0 pp
CareCart Sales Pop Up0.0%100.0%▲ +100.0 pp
Chili Piper0.0%100.0%▲ +100.0 pp
ClearSale0.0%100.0%▲ +100.0 pp
ConvertFlow0.0%100.0%▲ +100.0 pp
FastComet100.0%0.0%▼ −100.0 pp
FullContact100.0%0.0%▼ −100.0 pp
Global-e0.0%100.0%▲ +100.0 pp
Gomag100.0%0.0%▼ −100.0 pp
GTranslate app100.0%0.0%▼ −100.0 pp
Jumpseller0.0%100.0%▲ +100.0 pp
Marko0.0%100.0%▲ +100.0 pp

How to move it on your own site

2 · Guide

27% of the score

You serve an llms.txt at your root, and it parses.

It is where you tell an agent what matters on your site instead of letting it guess. And there is a trap in the scoring worth knowing: Lighthouse gives no points for not having one, and no points for having a broken one — so a file that does not parse costs you exactly what publishing nothing would, plus the work.

What to do

  1. Create /llms.txt at your root, served as text/plain.
  2. Follow the format: a single H1 with your site name, an optional blockquote summary, then H2 sections of markdown links with short descriptions.
  3. Point it at what you want an agent to read — documentation, product pages, prices — not at your whole sitemap. It is an editorial file, not an index.
  4. Validate it before you publish. Two out of three of the sites that publish one publish one that does not parse.
  5. Keep it short enough that someone updates it. A file that goes stale describes a site that no longer exists.

A morning, mostly spent deciding what to point at.