Major AI Platforms Have Not Confirmed Use of llms.txt Standard

Major AI platforms including OpenAI, Google, and Microsoft have not publicly confirmed the use of the emerging llms.txt standard ^[1].

This lack of confirmation suggests a gap between the efforts of website owners to organize data for artificial intelligence and the actual behavior of the bots crawling the web. If leading AI agents ignore these files, the effort to provide streamlined, AI-ready documentation remains largely symbolic.

The llms.txt standard is designed to help AI agents locate and process the most relevant information on a website more efficiently. Some entities, such as the state of Maryland, have piloted the use of these files to improve AI accessibility. "We're just doing our part to make sure AI can get the most relevant information at the time," David Holmes said.

Technical iterations of the standard continue to evolve. The llms.txt V2 update introduced formal markdown linking, which aims to help AI agents locate content more reliably, John Doe said.

However, the practical utility of the files is currently low. While the adoption of llms.txt files has increased 8.8 times ^[2], a vast majority of those files are not being accessed. Approximately 97% of llms.txt files receive zero AI requests ^[2].

This trend indicates a significant disconnect between the supply of AI-optimized files and the demand from the platforms that power modern LLMs. Jane Smith said Google's analysis shows that most of these files receive no AI requests, which highlights the limited practical uptake of the standard.

As of mid-2026, the standard remained an emerging proposal rather than a recognized industry requirement ^[1]. The leading platforms have not yet integrated the standard into their primary crawling or indexing protocols.