Educational How-To

How to Track AI Search Visibility

Version prompts, retain full answers, repeat comparable runs and separate mentions, citations, links, visits and conversions with visible uncertainty.

Brenden, Founder and search operator

7 min read

AI Visibility

Track AI search visibility with a versioned prompt register, repeated comparable runs and the full answer evidence—not one blended score. For every observation, retain the product state, prompt, answer, sources, brand role and destination. Then connect links to first-party visits, qualified actions and revenue while reporting what cannot be attributed.

Define visibility before measuring it

“AI visibility” can mean six different events:

Event Definition Evidence
Retrieved A source entered the product’s working set Often partially observable
Mentioned The brand appeared in the answer Full answer capture
Cited A page was attached as a source Source panel or inline citation
Linked A usable destination was shown Captured link
Visited A session arrived from the product Analytics or server log
Converted The visitor completed a declared action Analytics, form/call system or CRM

Add role accuracy and claim fidelity. A brand mentioned as the wrong type of provider is visible and commercially damaged. A citation attached to an unsupported claim is not authority.

Never add these events into one arbitrary points score. A mention and a sale are not interchangeable units.

Build the prompt register

Every prompt group needs an owner and a business reason:

Field Required answer
Prompt ID Stable identifier
Decision Discovery, diagnosis, comparison, suitability, proof or branded verification
Audience Who is asking?
Market Country, region and language
Commercial value Why does this decision matter?
Eligible brand role Provider, product, expert, source, location or alternative
Exclusion Where should the brand not appear?
Prompt version Exact wording and change history
Product matrix Which products and modes are valid for this question?
Owner Who acts on the result?

Do not start with hundreds of generated keyword variants. Start with questions sales, support, GSC, site search and customers can justify. A prompt without a decision or owner is reporting clutter.

Capture an observation ledger

For every run, store:

  • prompt ID and version;
  • exact prompt;
  • product and surface;
  • model or mode where visible;
  • web search on or off;
  • account, location and language conditions;
  • conversation state;
  • timestamp;
  • complete answer;
  • complete source list;
  • brand and competitor roles;
  • material inaccuracies;
  • linked destination;
  • screenshot or export reference;
  • reviewer.

This ledger lets you inspect the evidence behind every number. A dashboard is only its summary.

If a vendor will not let you export the prompt, answer and sources behind its score, you cannot independently audit the number.

Repeat comparable runs

AI answers vary. Current research on generative-search measurement warns that single-run metrics can look more precise than the underlying system.

Use enough repetitions to support the decision and always report:

  • number of valid runs;
  • number of products and modes;
  • date range;
  • location and account controls;
  • prompt version;
  • observed range or interval;
  • failures and exclusions.

Do not silently compare one run from last month with ten runs this month. Do not change the prompt set and label the resulting lift “visibility growth”.

Calculate transparent rates

Use denominators a reviewer can reconstruct:

Accurate mention coverage = valid runs with the brand in the eligible role ÷ all valid runs

Citation coverage = valid runs citing an owned page ÷ all valid runs

Destination accuracy = valid cited runs linking the correct page ÷ all valid cited runs

Claim fidelity = audited material claims supported by the attached source ÷ all audited material claims

Qualified action rate = suitable actions from attributable AI-assistant sessions ÷ attributable AI-assistant sessions

Show counts beside percentages. Two mentions from three runs and 200 mentions from 300 runs have the same rate and very different stability.

Separate three evidence classes

1. Direct answer evidence

What the product showed: answer, mention, role, citation and link.

2. First-party site evidence

What reached your property: verified crawler requests, referral sessions, landing pages, actions, leads and revenue.

3. Inferred influence

What may have followed without a preserved link: branded search, direct visits, sales-call mentions or assisted journeys.

Direct and first-party evidence can still have gaps. Inferred influence must never be reported as attributed revenue without a design that supports the inference.

Use Google’s current reporting correctly

Google Search Console’s generative AI performance report is currently rolling out to a subset of properties. The documented Search report covers impressions from AI Overviews and AI Mode, with page, country, date and device dimensions. It does not give you a universal cross-platform visibility report.

Google’s broader Web performance data also includes Search AI features.

Google Analytics currently classifies:

  • Google AI Overviews and AI Mode under Organic Search;
  • sources such as ChatGPT, Gemini, DeepSeek, Copilot and Grok under AI Assistants.

Those channel groups help organise visits. They do not measure no-click mentions, citations, answer accuracy or all lost-referrer journeys.

Build the executive view from the ledger

The executive report should show target versus actual:

Layer Target Actual Confidence Next action
Prompt coverage Declared profitable decisions Valid tested decisions Based on register completeness Add or retire justified prompts
Accurate role Declared eligible role Accurate mention runs Based on repeated answer captures Reconcile public facts
Source coverage Required evidence pages Cited and supported pages Based on visible sources Improve missing source
Destination Correct commercial page Correct linked page Based on source links Repair internal/commercial path
Qualified action Suitable action threshold First-party observed action Attribution-limited Fix page or offer
Revenue Finance-approved target Collected or booked value CRM/finance confidence Reconcile open pipeline

Every red metric needs an owner and a next action. “Visibility declined” is not an action.

Control prompt and competitor drift

Version changes when:

  • prompt wording changes materially;
  • the audience or market changes;
  • a product changes surface or mode;
  • a competitor enters or leaves the eligible set;
  • the offer or category changes;
  • the source page changes job.

Preserve the old version. Do not rewrite history so the chart stays smooth.

Competitor comparisons need eligibility rules. A multinational software platform and a local service business may both be mentioned for a broad prompt while serving completely different buyers.

Choose tools by auditability

Before buying AI visibility software, test:

  • product, mode, market and language coverage;
  • repeat-run support;
  • full answer and source retention;
  • prompt versioning;
  • brand-role correction;
  • competitor eligibility controls;
  • export access;
  • API or evidence portability;
  • separation of mention, citation and link;
  • attribution integration;
  • pricing at the required run volume.

Automation is valuable when the manual method is already sound. Automating an undefined score produces bad evidence faster.

Turn findings into page decisions

Map each failure to an action:

Failure Likely action
Brand absent across products Inspect category eligibility, public facts and source competition
Mention inaccurate Reconcile owned and third-party facts
Competitor cited for original evidence Publish the evidence you legitimately own
Page cited but claim unsupported Fix passage and source alignment
Wrong destination Repair canonical and internal commercial routing
Visits without qualified action Fix audience, proof, offer or page experience

The measurement system earns its keep only when it changes the site or commercial decision.

Use the brand-mention guide when the answer names you in the wrong role. Use the claim-level citation audit when the citation exists but does not support the claim.

What to fix first

Choose one prompt group attached to a profitable decision.

  1. Write its register entry and eligibility rules.
  2. Run the declared product matrix.
  3. Retain every full answer and source.
  4. repeat enough comparable runs to expose variation.
  5. calculate transparent counts and rates.
  6. connect attributable sessions and actions.
  7. identify the first failed stage.
  8. assign the fix, owner and retest date.

FAQ

Is there one AI visibility metric?

No. Retrieval, mention, citation, link, visit and conversion are different events with different evidence.

How many prompts should we track?

Track the smallest set that represents material customer decisions. Add prompts only when evidence or a new business decision justifies them.

How often should prompts run?

Use a cadence that matches the decision and product volatility. Keep it consistent and disclose the sample size and date range.

Can Google Search Console track AI visibility?

Its generative AI report covers eligible Google Search features for properties with access. It does not cover other AI products or no-click brand mentions.

Can GA4 show AI-assistant traffic?

Current default channels include an AI Assistants category and place Google Search AI-feature visits under Organic Search. Referral loss and no-click influence remain limitations.

Should we track sentiment?

Track factual role and claim accuracy first. A vague positive/negative score can hide a materially wrong description.

What is the biggest tracking mistake?

Changing prompts, run counts or product settings while reporting one smooth visibility trend with no retained answers.

Make every visibility claim auditable

The Searchmaxxed AI search optimisation system connects the prompt register, evidence ledger and commercial attribution path to the pages and source relationships that need to change.

Show us the decisions you need to measure.

Primary sources

Keep solving the problem

AI Visibility

Learn how to measure AI visibility, correct what answer engines say about your company and strengthen the pages and sources behind the answer.

Explore AI Visibility guides

Related resources

Your next move

Turn this search gap into the next website improvement.

We turn the evidence into a clear implementation plan across your pages, technical foundation and public authority.

See the AI search system

Start with the audit