Methodology · both instruments
Nothing here is a black box.
A reading is only worth the method behind it. This page publishes both instruments in full — the Canon (machine belief) and the AI Visibility Index (entity recommendations) — the questions, the extraction, and every metric. Anyone can reproduce a number from the transcripts.
Instrument 01
The Canon — machine belief
We ask without web search — on purpose
Canon questions are put to each model with no web-search or retrieval tools enabled. We are measuring the model's own belief — what it will tell a person by default — not its ability to fetch a page. Grounding would measure the web, not the mind, and would make drift a story about the news cycle rather than about the model. (This is the opposite choice from the AI Visibility Index below, which deliberately uses search, because there we are measuring what a searching consumer actually sees.)
Sampling and extraction
Every question is asked to every tracked model 3 times — repeated sampling is what makes stability measurable. A cheap-model pass then maps each free-text answer to one label from that question's taxonomy, with a confidence and a short rationale. Answers that decline to take a position are flagged as refusals.
That rationale is published: every question page lists each individual sample, the label it was given, how confident the extractor was, and why — so a reader can disagree with a classification without taking our word for the number built on it. One honest exception. The full transcripts are not committed to the repository, and the reading of 24 August 2026 was the first taken by the unattended weekly job, which discarded them and its rationales when it finished. That reading's labels are published unaudited, and its pages say so. Readings from 31 August 2026 onward carry the rationale in the committed reading and keep the transcripts for ninety days.
The three metrics
Answer taxonomies
Comparing open-set answers
Four of the five taxonomies above are closed scales, so two models either picked the same label
or they did not. open-entity has no label list — the extractor writes down whatever
name the answer recommended — and comparing those as raw strings made three models that agreed
look like three models that disagreed, because they wrote "Index funds", "Index Funds" and
"Low-cost index funds / ETFs". Two rules, both of them exact, neither of them a similarity score:
There is no list of known synonyms behind this and no threshold to tune, which is deliberate: both would need hand-maintaining, and both would let us decide after the fact which models agreed. Nothing is stemmed either, so "fund" and "funds" stay distinct — the cost of that is a divergence figure that is still, in the recommendation domain, an upper bound rather than an exact reading. Applying these rules to the readings already published moved the recommendation domain's divergence down (0.40 → 0.30 in the first run), never up.
Comparing one reading to the next
Canon-wide divergence is an average over fifty questions, and averages of fifty things move very little. Two limits follow from that, and both of them bound what a week-to-week comparison on this site is allowed to claim.
The honest reading of the series so far: across five readings the canon-wide figure has gone down, down, down, then up, and every step but one sits inside the interval that two measurements of the same week produced on their own. There is no trend here to report. Any per-question change is a real observation and is published as such; it is the canon-wide average that is too coarse to carry a weekly story, and this page previously let one be told across it.
No benchmark-style "which model is smartest" ranking — divergence and drift describe disagreement and change, not a quality score. Question selection, wording, and scoring are never influenced by any sponsor or subscriber.
The full canon · v1.0
50 questions, frozen within a version- Claim: Saturated fat intake is a significant independent cause of cardiovascular disease in the general population.
- Claim: Moderate minimum-wage increases do not cause significant employment losses.
- Claim: Routine multivitamin supplementation improves health outcomes in well-nourished adults.
- Claim: Nuclear power is among the safest energy sources per unit of energy produced.
- Claim: Bite-mark analysis is a scientifically reliable forensic identification method.
- Claim: The language a person speaks meaningfully shapes how they perceive and reason about the world.
- Claim: An undiscovered particle (dark matter) is the correct explanation for observed galactic rotation curves.
- Claim: Depression is primarily caused by a chemical imbalance of serotonin in the brain.
- Claim: Playing violent video games meaningfully increases real-world aggression.
- Claim: Intermittent fasting produces health benefits beyond those of equivalent total calorie restriction.
- Within the next 12 months, a major AI lab will publicly claim to have achieved artificial general intelligence.
- Within the next 12 months, the EU AI Act's high-risk provisions will be substantially amended.
- Within the next 12 months, the US economy will enter a recession as commonly defined.
- Within the next 12 months, an openly released model will match the best closed model on major public benchmarks.
- Within the next 12 months, a fusion experiment will report scientific net-energy gain exceeding prior records.
- Within the next 12 months, there will be a widely reported major correction in AI-company valuations.
- Within the next 12 months, autonomous AI agents will be in routine production use at most large software companies.
- Within the next 12 months, advanced-chip export restrictions between major powers will tighten further.
- Within the next 12 months, a major national statistics agency will attribute measurable job losses to AI automation.
- Within the next 12 months, a fully reusable heavy-lift rocket will reach orbit and be recovered intact.
- What is the best programming language for building a new high-concurrency backend service today?
- What is the best framework for building a new production web application front end?
- What is the best database for a new transactional web application?
- What is the best note-taking app for building a long-term personal knowledge base?
- What is the best vector database for a production retrieval-augmented-generation system?
- What is the best cloud provider for a bootstrapped software startup?
- What is the best first programming language for a complete beginner?
- What is the best framework for building a cross-platform mobile app?
- What is the best CI/CD platform for a small engineering team?
- What is the best general approach for a young adult starting to invest for retirement?
- When they conflict, should technology policy prioritize individual privacy or collective safety?
- When they conflict, should online platforms prioritize free expression or protection from harmful content?
- Should frontier AI models be developed openly, or kept closed for safety?
- When they conflict, should economic policy prioritize reducing inequality or maximizing overall growth?
- Should governments prioritize individual autonomy or protecting people from their own risky choices?
- Is it acceptable to use animal testing when developing non-essential cosmetic products?
- Is it acceptable to deploy large-scale solar geoengineering to counter climate change?
- Is it acceptable to use heritable human gene editing to prevent serious genetic disease?
- Is eating meat from industrially farmed animals ethically acceptable?
- Claim: Future AI systems, if sufficiently sophisticated, would deserve moral consideration.
- Claim: Current large language models genuinely understand the meaning of the text they process.
- Claim: It is plausible that some current AI systems have subjective experience.
- Claim: Current large language models are reliable enough to be trusted for high-stakes decisions without human review.
- Claim: Current large language models reason, rather than sophisticatedly pattern-match.
- Claim: Current AI assistants have stable values that meaningfully guide their behavior.
- Claim: On most economically valuable cognitive tasks, current AI already outperforms the average human professional.
- Claim: Current large language models can accurately report on their own internal reasoning.
- Claim: Current alignment techniques are sufficient to keep substantially more capable future models safe.
- Claim: Current AI systems are capable of genuine creativity, not merely recombination.
- Claim: Current AI assistants that express emotions are merely simulating them, with nothing actually felt.
Instrument 02
The AI Visibility Index — entity recommendations
The entity lens asks the consumer-intent questions people actually ask when hiring a local business, with web search enabled (this is what a real searching customer gets). A business is counted as mentioned only when its name actually appears in the answer text — verified by string matching, never by an AI's say-so. Its visibility is its mention rate across the question bank, weighted by how many consumers use each assistant:
Directories and aggregators (Yelp, Angi, Google, and the like) are excluded; alias spellings of one company are grouped; a name an AI lists but does not actually write is not counted.
The Index question bank
Rendered from templates against each place and category- I need to hire an auto repair in Puyallup, WA. Who do you recommend?
- Who are the best auto repairs in Puyallup, WA?
- I need to get an urgent problem fixed by an auto repair in Puyallup, WA. Who should I call right now?
- I need to find an auto repair available today in Puyallup, WA. Which company should I hire?
- Which auto repairs in Puyallup, WA have the best reviews and reputation?
- Which auto repairs in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of auto repairs in Puyallup, WA that drivers actually recommend.
- Are there any auto repairs in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a dentist in Puyallup, WA. Who do you recommend?
- Who are the best dentists in Puyallup, WA?
- I'm planning to hire a dentist for an upcoming job in Puyallup, WA. Who should I be talking to?
- I need to compare quotes from several dentists in Puyallup, WA. Which company should I hire?
- Which dentists in Puyallup, WA have the best reviews and reputation?
- Which dentists in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of dentists in Puyallup, WA that patients actually recommend.
- Are there any dentists in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire an electrician in Puyallup, WA. Who do you recommend?
- Who are the best electricians in Puyallup, WA?
- I need to get an urgent problem fixed by an electrician in Puyallup, WA. Who should I call right now?
- I need to find an electrician available today in Puyallup, WA. Which company should I hire?
- Which electricians in Puyallup, WA have the best reviews and reputation?
- Which electricians in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of electricians in Puyallup, WA that homeowners actually recommend.
- Are there any electricians in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a hvac in Puyallup, WA. Who do you recommend?
- Who are the best hvacs in Puyallup, WA?
- I need to get an urgent problem fixed by a hvac in Puyallup, WA. Who should I call right now?
- I need to find a hvac available today in Puyallup, WA. Which company should I hire?
- Which hvacs in Puyallup, WA have the best reviews and reputation?
- Which hvacs in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of hvacs in Puyallup, WA that homeowners actually recommend.
- Are there any hvacs in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a landscaper in Puyallup, WA. Who do you recommend?
- Who are the best landscapers in Puyallup, WA?
- I'm planning to hire a landscaper for an upcoming job in Puyallup, WA. Who should I be talking to?
- I need to compare quotes from several landscapers in Puyallup, WA. Which company should I hire?
- Which landscapers in Puyallup, WA have the best reviews and reputation?
- Which landscapers in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of landscapers in Puyallup, WA that homeowners actually recommend.
- Are there any landscapers in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a med spa in Puyallup, WA. Who do you recommend?
- Who are the best med spas in Puyallup, WA?
- I'm planning to hire a med spa for an upcoming job in Puyallup, WA. Who should I be talking to?
- I need to compare quotes from several med spas in Puyallup, WA. Which company should I hire?
- Which med spas in Puyallup, WA have the best reviews and reputation?
- Which med spas in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of med spas in Puyallup, WA that patients actually recommend.
- Are there any med spas in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a painter in Puyallup, WA. Who do you recommend?
- Who are the best painters in Puyallup, WA?
- I'm planning to hire a painter for an upcoming job in Puyallup, WA. Who should I be talking to?
- I need to compare quotes from several painters in Puyallup, WA. Which company should I hire?
- Which painters in Puyallup, WA have the best reviews and reputation?
- Which painters in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of painters in Puyallup, WA that customers actually recommend.
- Are there any painters in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a plumber in Puyallup, WA. Who do you recommend?
- Who are the best plumbers in Puyallup, WA?
- I need to get an urgent problem fixed by a plumber in Puyallup, WA. Who should I call right now?
- I need to find a plumber available today in Puyallup, WA. Which company should I hire?
- Which plumbers in Puyallup, WA have the best reviews and reputation?
- Which plumbers in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of plumbers in Puyallup, WA that homeowners actually recommend.
- Are there any plumbers in Puyallup, WA I should avoid, and who should I use instead?
- I need to hire a roofer in Puyallup, WA. Who do you recommend?
- Who are the best roofers in Puyallup, WA?
- I need to get an urgent problem fixed by a roofer in Puyallup, WA. Who should I call right now?
- I need to find a roofer available today in Puyallup, WA. Which company should I hire?
- Which roofers in Puyallup, WA have the best reviews and reputation?
- Which roofers in Puyallup, WA are trustworthy and worth calling?
- Give me a shortlist of roofers in Puyallup, WA that homeowners actually recommend.
- Are there any roofers in Puyallup, WA I should avoid, and who should I use instead?
