--- id: ins_williams-cook-llms-txt-geo-astrology operator: Mark Williams-Cook operator_role: Independent SEO researcher and consultant; creator of AlsoAsked.com co_operators: [] source_url: https://www.searchenginejournal.com/how-cats-txt-showed-llms-txt-evidence-is-geo-astrology/584653/ source_type: essay source_title: "How cats.txt Showed LLMs.txt Evidence Is GEO Astrology" source_date: 2026-08-07 captured_date: 2026-08-14 domain: [aeo-llm-search, seo] lifecycle: [positioning] maturity: applied artifact_class: case-study score: { originality: 4, specificity: 4, evidence: 4, transferability: 4, source: 4 } tier: B related: [ins_aleyda-solis-aeo-offsite-corroboration-floor, ins_indig-ugc-citation-dominance] raw_ref: "" --- # The four proofs used to justify llms.txt as a GEO tactic apply equally to a satirical file about office cats, exposing all four as insufficient evidence ## Claim The standard evidence cited to validate llms.txt as a GEO tactic fails the most basic empirical test: a joke file containing fictional information about office cats passes all four proofs at the same level as a genuine llms.txt, proving the proofs measure AI system defaults rather than any meaningful signal influence. ## Mechanism Each of the four standard proofs confuses a neutral fact about how AI systems work with evidence that llms.txt changes AI behavior: 1. Crawler activity: AI crawlers fetch many files, including irrelevant ones. Fetching does not indicate reading, weighting, or trusting the content. 2. Google indexing: Google indexes anything accessible. Indexing does not indicate use by LLMs. 3. LLM content retrieval: when a retrieval-augmented system is given the contents of a file and asked about it, it will return that content. This is RAG behavior, not evidence of organic citation influence. 4. LLM endorsement: when asked "does llms.txt help?" a model returns the consensus answer in its training data, not the result of reasoning about the file. As Williams-Cook describes the fourth failure: > "When you ask a model whether llms.txt helps, it is not reasoning...It is returning the most common thing it has seen written on the subject." The structural issue is that none of these proofs test the counterfactual: would AI systems cite a site more or less without the llms.txt file? ## Conditions Holds when: practitioners are evaluating GEO tactics on the basis of the four standard proofs. The critique applies regardless of niche or content type. Fails when: a practitioner runs an actual A/B study with and without llms.txt controlling for content quality and authority signals. That study has not been published. Until it is, the effectiveness claim remains undemonstrated. ## Evidence Williams-Cook created cats.txt, a file declaring fictional office cats as official company members, and submitted it to the same four proofs: - Crawlers fetched it. - Google indexed it. - LLMs returned its content when asked about it. - ChatGPT confidently recommended cats.txt for ranking before the community revealed it was satire. Supporting data from Ahrefs: of roughly 38,000 valid llms.txt files, 97% received zero crawler requests in May 2026. John Mueller (Google) stated that "no AI system currently uses llms.txt." > "A crawler fetching a file tells you nothing about whether the contents are read, weighted, trusted, or acted upon." ## Signals - If your evidence for a GEO tactic would also apply to a file about fictional office cats, the evidence is not measuring what you think it is. - Ahrefs crawler-request data per llms.txt file is a better signal than anecdotes about model mentions. - Model endorsement of a tactic that appears frequently in its training data is circular. ## Counter-evidence Some implementations pair llms.txt with higher-quality structured content, making it hard to attribute any observed citation lift to the file versus the content improvement. Llms.txt may eventually matter if AI crawlers adopt it as a standard; the current evidence says they have not. ## Cross-references - `ins_aleyda-solis-aeo-offsite-corroboration-floor`: Aleyda Solis on third-party offsite corroboration as the actual floor for AI citation. - `ins_indig-ugc-citation-dominance`: Kevin Indig's data on what sources AI actually cites at scale.