Run your brand through three AI visibility tools and you will get three different scores. One says 62. One says 34. One says you are "highly visible." None of them agree, and none of them are technically wrong.
AI visibility tools disagree because AI engines themselves are not deterministic, and every tool samples them differently. Different prompts, different engines, different run counts, different scoring weights, different days. Each tool is photographing a moving target from a different angle, then presenting its photo as the territory.
This piece explains where the differences come from, when a score is worth trusting, and how to read any AI visibility number like someone who knows how it was made.
An AI visibility tool asks AI engines questions a buyer might ask, records whether your brand appears in the answers, and compresses those observations into a score. That is the whole product. Everything that matters lives in the details: which questions, which engines, how many times, and how the observations become a number.
There is no registry of AI answers to look up. Every datapoint has to be generated by actually asking the engine, at a moment in time, with a specific phrasing. The tools are not reading a scoreboard. They are running experiments.
Every divergence between two tools traces back to at least one of these five choices. None of them are visible on the score itself.
Ask ChatGPT the same question twice and you can get different answers with different sources cited. This is not a bug in the tools; it is how large language models work: outputs are sampled, not retrieved, as OpenAI's own text generation documentation describes. A tool that queries once and reports a precise-looking number has measured a coin flip to two decimal places.
One tool audits "best crypto exchange." Another audits "safest exchange for beginners in Europe." Real buyers ask the second kind. Whether a tool's prompt set matches how your buyers actually phrase things changes the result more than anything your marketing team did last quarter.
ChatGPT, Perplexity, Gemini, Claude and Google AI Mode disagree with each other constantly, and Google's AI surfaces follow their own rules entirely, documented in Google's AI features guidance for Search. In our own audits, the same brand routinely gets a strong showing on one engine and a blank on another. A tool that averages three engines will never match a tool that samples five, and neither is measuring "AI" as a whole.
Is being mentioned worth half a citation? Does position in the answer matter? Is Perplexity worth as much as ChatGPT? These are editorial decisions, not measurements. Two tools can record identical observations and still publish different scores, because the weighting is opinion. The honest ones publish those opinions. Most do not.
Engines update, indexes refresh, sources rise and fall. The AEO research community keeps documenting how fast this ground moves; Ahrefs' published studies on AI search behavior are a good running record. A score from three weeks ago describes a system that no longer exists. Two tools that scanned on different days measured genuinely different realities.
Mostly no. The dishonesty is rarely in the measurement; it is in the precision theater. Reporting "your AI visibility is 34.7" implies a stability the underlying system does not have.
The tell is what a tool discloses. If you cannot find the prompt list, the engine list, the sample count, and the scoring weights, you are not looking at a measurement. You are looking at marketing that outputs digits.
If you cannot see the questions, the score is unanchored.
"AI search" is not an engine. A real answer names ChatGPT, Perplexity, Gemini, Claude, Google AI Mode.
One run is an anecdote. Multiple runs with a stability measure is data.
If they are secret, the score is an opinion wearing a lab coat.
A score without a date describes nothing.
A tool that answers all five can be compared against itself over time, which is the only comparison that matters. Chasing score parity between two different tools is chasing an artifact of their methodologies.
Want a score you can actually interrogate? Run the disclosure test on us.
Scan my brand free →We build citeOS around the disclosure test because our buyers are crypto teams, and crypto buyers are professionally allergic to numbers nobody can verify.
A citeOS audit runs 20 buyer-style prompts across all five major engines, which produces 100 observation points per scan. Paid audits sample each prompt multiple times and report stability, not false precision. Every scoring weight is published on our methodology page, and every citation we count can be reproduced by asking the engine the same question yourself. When an engine fails or returns no AI surface, we show that honestly instead of a fabricated zero.
Not because that makes prettier numbers. Because the score is the beginning of the work, not the product. The product is knowing which sources moved the answer, and what to ship next.
Software that measures whether AI engines like ChatGPT, Perplexity and Gemini mention or recommend your brand when users ask buying questions in your category. It works by querying the engines directly and recording the answers.
None of them are "accurate" in an absolute sense, because AI answers change between runs. The useful question is which tool is most transparent: published prompts, named engines, multi-sample runs, and public scoring weights let you trust a score's direction over time.
Because the engines changed. Model updates, index refreshes and source shifts move answers constantly. This is why single-run scores are unreliable and trend lines beat snapshots.
Yes, but not by optimizing for the score. AI engines cite sources they trust: independent media coverage, community presence, and content that answers buyer questions directly. Improve those and every honest tool's score follows. Start by seeing where you stand with a free AI citation scan.
Growth marketer working in Web3 since its early days. Sagar has helped 75+ crypto and Web3 projects reach their target audiences across exchanges, DeFi, wallets, gaming, and infrastructure, and runs Emergence Media, a Web3 marketing agency. He built citeOS to make that work measurable: the 100-observation-point AI citation audits this piece draws on and the 500+ outlet crypto media index, with every weight published in the methodology. Check the math, then check your own citations with the free scan.
Five engines, twenty buyer prompts, 100 observation points. Published weights, reproducible citations, your baseline in about a minute. No card, no signup.
Scan my brand free →