Bots / OpenAI
OAI-SearchBot
OpenAI bot associated with search-style retrieval for ChatGPT.
Identity
- Name: OAI-SearchBot
- Operator: OpenAI
- User-Agent:
OAI-SearchBot
OpenAI bot associated with search-style retrieval for ChatGPT. Treat this page as the entity owner for “OAI-SearchBot” / User-Agent facts. The Shopify how-to for allowing AI crawlers lives on Learn so we do not compete with that head term here.
Typical robots.txt directive
User-agent: OAI-SearchBot
Allow: /
Match the User-Agent string your logs actually see. Some operators use multiple agents (fetch vs training). When in doubt, allow the answer-oriented agents you care about and document intentional denials.
Shopify notes
Treat like GPTBot for storefront allow rules; verify PDPs are not challenge-walled.
Implementation steps
- Edit robots.txt in Shopify admin (or your SEO app’s robots template)
- Allow storefront paths; keep /checkouts, /cart, /account disallowed under User-agent: *
- Review security/bot apps for blanket AI blocks
- Test on the custom domain customers use (not only *.myshopify.com)
- Treat like GPTBot for storefront allow rules; verify PDPs are not challenge-walled.
When to allow
- You want answer engines operated by this company to fetch public storefront HTML
- Your PDPs and collections should be eligible as citation or Shopping sources
- robots.txt already allows general crawling but AI agents were accidentally blocked
When teams deny
- A security incident requires temporary lockdown (re-open when safe)
- You intentionally do not want this operator fetching your storefront
How to verify
- Confirm robots.txt includes a clear rule for OAI-SearchBot / OAI-SearchBot
- Fetch homepage and a hero PDP; expect HTTP 200 with real product HTML
- Ensure bot challenges / walls do not trigger for this User-Agent on public paths
- Re-run a TopMention tech scan to confirm crawler checks move toward pass
Related
- How to allow AI crawlers on Shopify
- What is OAI-SearchBot? (short definition)
- What is an AI crawler?
- What is robots.txt?
- TopMentionBot disclosure
- Same operator: