Bots · Shopify AEO / GEO
AI crawlers every Shopify store should allow
Entity pages for GPTBot, ClaudeBot, PerplexityBot and peers — User-Agent facts, robots.txt patterns, and Shopify verification steps for AEO/GEO. How-to allow rules live on Learn.
These pages own the crawler entity query (bot name / User-Agent). Short definitions also appear in the dictionary and link here for detail. We do not create per-category bot pages — that would multiply duplicates.
- GPTBot — OpenAI. OpenAI crawler used to gather web content that may inform ChatGPT and related products.
- OAI-SearchBot — OpenAI. OpenAI bot associated with search-style retrieval for ChatGPT.
- ChatGPT-User — OpenAI. User-agent seen when ChatGPT fetches pages on a user’s behalf during browsing.
- ClaudeBot — Anthropic. Anthropic crawler that fetches public pages for Claude-related features.
- Claude-User — Anthropic. Anthropic user-agent for on-demand fetches initiated from Claude.
- PerplexityBot — Perplexity. Perplexity crawler used to retrieve sources for cited answers.
- Google-Extended — Google. Google control for Gemini / grounding-related uses of site content (separate from Googlebot SEO crawling).
- CCBot — Common Crawl. Common Crawl bot; datasets are widely reused by AI systems.
- Applebot-Extended — Apple. Apple control related to Apple Intelligence / generative features using web content.
- Bytespider — ByteDance. ByteDance crawler associated with AI/data collection programs.
- Diffbot — Diffbot. Commercial web-data crawler used by various AI and knowledge products.
- TopMentionBot — TopMention. TopMention’s own crawler for AI-visibility technical audits when a merchant requests a scan.
Scan your Shopify store free
TopMention is the Shopify AEO/GEO platform — see whether ChatGPT, Claude, Perplexity and Gemini mention your brand, and who's winning your category.