Source record
OpenAI, Anthropic, Perplexity, and other leading AI companies have started referencing LLMs.txt when crawling sites...
txt when crawling sites. LLMs TXT is a plain text file that tells AI systems what you're about and which URLs on your site you consider to be useful and of priority. It also gives plain text versions of all your content in dot MD markdown files, so it's easier for LLMs to understand.
So I took a look to see if the top SEO and content marketing sites are implementing it. Hrefs nope. Moz?
Nope. HubSpot? Nope.
Semrush? Nope. Backlinko?
Nope. Wordstream? No.
And in fact, if you copy all the text on a page, give it to ChatGPT. Even with the navigation text and footer text and all the extra junk, ChatGPT will still do a great job understanding it. Or a YouTube transcript with the timestamps in it.
ChatGPT still gets what the content is about. So is this necessary or just hype? Well, for now it seems like it is just hype.
Learn real SEO at compactkeywords com.
Top SEO/content sites lacking `llms.txt`, combined with LLMs understanding normal page text/transcripts, is used to argue `llms.txt` may currently be hype.
Treat `llms.txt` as low-priority unless crawl logs or AI citation tests show measurable benefit; focus first on clean content architecture and accessible text.
This source is connected to llms.txt / hype review.
OpenAI, Anthropic Perplexity and other leading AI companies have started referencing LLMs.txt when crawling sites. LLMs TXT is a plain text file that tells AI systems what you're about and which URLs on your site you consider to be useful and of priority...