Educational How-To
How to Track AI Search Visibility
Version prompts, retain full answers, repeat comparable runs and separate mentions, citations, links, visits and conversions with visible uncertainty.
Brenden, Founder and search operator
7 min read
Track AI search visibility with a versioned prompt register, repeated comparable runs and the full answer evidence—not one blended score. For every observation, retain the product state, prompt, answer, sources, brand role and destination. Then connect links to first-party visits, qualified actions and revenue while reporting what cannot be attributed.
Define visibility before measuring it
“AI visibility” can mean six different events:
| Event | Definition | Evidence |
|---|---|---|
| Retrieved | A source entered the product’s working set | Often partially observable |
| Mentioned | The brand appeared in the answer | Full answer capture |
| Cited | A page was attached as a source | Source panel or inline citation |
| Linked | A usable destination was shown | Captured link |
| Visited | A session arrived from the product | Analytics or server log |
| Converted | The visitor completed a declared action | Analytics, form/call system or CRM |
Add role accuracy and claim fidelity. A brand mentioned as the wrong type of provider is visible and commercially damaged. A citation attached to an unsupported claim is not authority.
Never add these events into one arbitrary points score. A mention and a sale are not interchangeable units.
Build the prompt register
Every prompt group needs an owner and a business reason:
| Field | Required answer |
|---|---|
| Prompt ID | Stable identifier |
| Decision | Discovery, diagnosis, comparison, suitability, proof or branded verification |
| Audience | Who is asking? |
| Market | Country, region and language |
| Commercial value | Why does this decision matter? |
| Eligible brand role | Provider, product, expert, source, location or alternative |
| Exclusion | Where should the brand not appear? |
| Prompt version | Exact wording and change history |
| Product matrix | Which products and modes are valid for this question? |
| Owner | Who acts on the result? |
Do not start with hundreds of generated keyword variants. Start with questions sales, support, GSC, site search and customers can justify. A prompt without a decision or owner is reporting clutter.
Capture an observation ledger
For every run, store:
- prompt ID and version;
- exact prompt;
- product and surface;
- model or mode where visible;
- web search on or off;
- account, location and language conditions;
- conversation state;
- timestamp;
- complete answer;
- complete source list;
- brand and competitor roles;
- material inaccuracies;
- linked destination;
- screenshot or export reference;
- reviewer.
This ledger lets you inspect the evidence behind every number. A dashboard is only its summary.
If a vendor will not let you export the prompt, answer and sources behind its score, you cannot independently audit the number.
Repeat comparable runs
AI answers vary. Current research on generative-search measurement warns that single-run metrics can look more precise than the underlying system.
Use enough repetitions to support the decision and always report:
- number of valid runs;
- number of products and modes;
- date range;
- location and account controls;
- prompt version;
- observed range or interval;
- failures and exclusions.
Do not silently compare one run from last month with ten runs this month. Do not change the prompt set and label the resulting lift “visibility growth”.
Calculate transparent rates
Use denominators a reviewer can reconstruct:
Accurate mention coverage = valid runs with the brand in the eligible role ÷ all valid runs
Citation coverage = valid runs citing an owned page ÷ all valid runs
Destination accuracy = valid cited runs linking the correct page ÷ all valid cited runs
Claim fidelity = audited material claims supported by the attached source ÷ all audited material claims
Qualified action rate = suitable actions from attributable AI-assistant sessions ÷ attributable AI-assistant sessions
Show counts beside percentages. Two mentions from three runs and 200 mentions from 300 runs have the same rate and very different stability.
Separate three evidence classes
1. Direct answer evidence
What the product showed: answer, mention, role, citation and link.
2. First-party site evidence
What reached your property: verified crawler requests, referral sessions, landing pages, actions, leads and revenue.
3. Inferred influence
What may have followed without a preserved link: branded search, direct visits, sales-call mentions or assisted journeys.
Direct and first-party evidence can still have gaps. Inferred influence must never be reported as attributed revenue without a design that supports the inference.
Use Google’s current reporting correctly
Google Search Console’s generative AI performance report is currently rolling out to a subset of properties. The documented Search report covers impressions from AI Overviews and AI Mode, with page, country, date and device dimensions. It does not give you a universal cross-platform visibility report.
Google’s broader Web performance data also includes Search AI features.
Google Analytics currently classifies:
- Google AI Overviews and AI Mode under Organic Search;
- sources such as ChatGPT, Gemini, DeepSeek, Copilot and Grok under AI Assistants.
Those channel groups help organise visits. They do not measure no-click mentions, citations, answer accuracy or all lost-referrer journeys.
Build the executive view from the ledger
The executive report should show target versus actual:
| Layer | Target | Actual | Confidence | Next action |
|---|---|---|---|---|
| Prompt coverage | Declared profitable decisions | Valid tested decisions | Based on register completeness | Add or retire justified prompts |
| Accurate role | Declared eligible role | Accurate mention runs | Based on repeated answer captures | Reconcile public facts |
| Source coverage | Required evidence pages | Cited and supported pages | Based on visible sources | Improve missing source |
| Destination | Correct commercial page | Correct linked page | Based on source links | Repair internal/commercial path |
| Qualified action | Suitable action threshold | First-party observed action | Attribution-limited | Fix page or offer |
| Revenue | Finance-approved target | Collected or booked value | CRM/finance confidence | Reconcile open pipeline |
Every red metric needs an owner and a next action. “Visibility declined” is not an action.
Control prompt and competitor drift
Version changes when:
- prompt wording changes materially;
- the audience or market changes;
- a product changes surface or mode;
- a competitor enters or leaves the eligible set;
- the offer or category changes;
- the source page changes job.
Preserve the old version. Do not rewrite history so the chart stays smooth.
Competitor comparisons need eligibility rules. A multinational software platform and a local service business may both be mentioned for a broad prompt while serving completely different buyers.
Choose tools by auditability
Before buying AI visibility software, test:
- product, mode, market and language coverage;
- repeat-run support;
- full answer and source retention;
- prompt versioning;
- brand-role correction;
- competitor eligibility controls;
- export access;
- API or evidence portability;
- separation of mention, citation and link;
- attribution integration;
- pricing at the required run volume.
Automation is valuable when the manual method is already sound. Automating an undefined score produces bad evidence faster.
Turn findings into page decisions
Map each failure to an action:
| Failure | Likely action |
|---|---|
| Brand absent across products | Inspect category eligibility, public facts and source competition |
| Mention inaccurate | Reconcile owned and third-party facts |
| Competitor cited for original evidence | Publish the evidence you legitimately own |
| Page cited but claim unsupported | Fix passage and source alignment |
| Wrong destination | Repair canonical and internal commercial routing |
| Visits without qualified action | Fix audience, proof, offer or page experience |
The measurement system earns its keep only when it changes the site or commercial decision.
Use the brand-mention guide when the answer names you in the wrong role. Use the claim-level citation audit when the citation exists but does not support the claim.
What to fix first
Choose one prompt group attached to a profitable decision.
- Write its register entry and eligibility rules.
- Run the declared product matrix.
- Retain every full answer and source.
- repeat enough comparable runs to expose variation.
- calculate transparent counts and rates.
- connect attributable sessions and actions.
- identify the first failed stage.
- assign the fix, owner and retest date.
FAQ
Is there one AI visibility metric?
No. Retrieval, mention, citation, link, visit and conversion are different events with different evidence.
How many prompts should we track?
Track the smallest set that represents material customer decisions. Add prompts only when evidence or a new business decision justifies them.
How often should prompts run?
Use a cadence that matches the decision and product volatility. Keep it consistent and disclose the sample size and date range.
Can Google Search Console track AI visibility?
Its generative AI report covers eligible Google Search features for properties with access. It does not cover other AI products or no-click brand mentions.
Can GA4 show AI-assistant traffic?
Current default channels include an AI Assistants category and place Google Search AI-feature visits under Organic Search. Referral loss and no-click influence remain limitations.
Should we track sentiment?
Track factual role and claim accuracy first. A vague positive/negative score can hide a materially wrong description.
What is the biggest tracking mistake?
Changing prompts, run counts or product settings while reporting one smooth visibility trend with no retained answers.
Make every visibility claim auditable
The Searchmaxxed AI search optimisation system connects the prompt register, evidence ledger and commercial attribution path to the pages and source relationships that need to change.
Show us the decisions you need to measure.
Primary sources
Keep solving the problem
AI Visibility
Learn how to measure AI visibility, correct what answer engines say about your company and strengthen the pages and sources behind the answer.
Related resources
Your next move
Turn this search gap into the next website improvement.
We turn the evidence into a clear implementation plan across your pages, technical foundation and public authority.