chiprook
← AI
AIOctober 6, 2026, 13:42

Only 114 of top 1,000 sites actually serve llms.txt

A scan of the top 1,000 Tranco domains found 246 returning HTTP 200 for /llms.txt, but only 114 actually serve the file (15% of the 742 reachable over HTTPS). The other 132 return an HTML page, a redirect or a placeholder with a 200 status.

Only 114 of top 1,000 sites actually serve llms.txt
#Llms.txt
Read next
AI

185-site EU census: who actually blocks AI crawlers

Business

Traffic to top 100 news sites falls from 70M to 47M monthly visits

AI

No AI crawler requested llms.txt in 15 days of nginx logs

AI

Here's How an AI Slowdown Could Actually Be Enforced