methodology
Measuring AEO without vanity metrics
Which AI visibility metrics are real, which are theater, and how Shopify teams should report progress to leadership.
Real metrics
- Fixed-panel SoV (blended + per model)
- Prompt coverage (# money prompts with a citable owner URL)
- Technical pass rate on hero SKUs
- Fetch success for AI user-agents
- Shopping readiness on hero offers
Vanity metrics
- Word counts of “AI blogs”
- Screenshots without prompt control
- Rank tracking for “ChatGPT” keywords on Google
- Raw AI referral spikes without brand mention context
Reporting template
- SoV this week vs last (same panel)
- Top 5 prompt wins/losses
- Tech fails opened/closed
- Next ship
Owner: methodology. Cadence: weekly rhythm.