AI Crawler Access
llms.txt
llms.txt is a proposed standard file that tells ai systems what content you want them to read and how you'd like to be represented.
Detailed Explanation
llms.txt is an emerging standard similar to robots.txt but specifically for AI systems. It allows website owners to explicitly tell AI crawlers which content to prioritise, how to represent the brand, and what information is most important. While not yet universally adopted, early signals suggest AI platforms are beginning to respect these files. Adding an llms.txt file signals AI-readiness and can help guide how AI systems understand your content.
See How Your Site Scores on AI Crawler Access
Check your AI Visibility Score across all 12 categories.