technical

Allow GPTBot, ClaudeBot, and PerplexityBot on Shopify

How to update Shopify robots.txt so AI crawlers can read your store — without opening checkout — plus verification and security-app pitfalls.

Updated 2026-07-19

If AI crawlers cannot fetch your pages, models cannot cite or recommend you reliably. Many Shopify themes and apps default to aggressive blocks.

This page owns the Shopify how-to. Entity facts for each crawler live under /bots. Broader robots strategy: robots.txt for AI crawlers. Security apps: Shopify security apps vs AI crawlers.

Bots that matter for AI visibility

Practical robots.txt approach

In Shopify admin → Online Store → Preferences → bots / robots, or robots.txt.liquid, allow AI user-agents on storefront paths while keeping checkout, carts, and account areas disallowed.

Example pattern:

User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: *
Disallow: /checkouts
Disallow: /cart
Disallow: /account

Verify (do not skip)

  1. Fetch homepage + a hero PDP as each AI user-agent
  2. Confirm HTTP 200 with real product HTML (not a challenge wall)
  3. Review security/CDN apps for blanket bot blocks
  4. Re-run a TopMention tech audit

After access works

Move to schema/Shopping (JSON-LD guide), citability, and measurement (methodology).

Category checklists: /guides → crawler-access.

Run a free AI visibility scan

See if ChatGPT recommends your brand — and what to fix first.

Scan my Shopify store