What is User-Agent?

Short definition

The identifier a crawler sends in HTTP requests.

Why it matters for Shopify brands

robots.txt rules are matched per User-Agent such as GPTBot.

AI visibility work mixes measurement language (share of voice, prompt panels) with technical language (crawlers, schema, Shopping). Clear definitions keep teams from optimizing the wrong surface — for example chasing Google rankings while ChatGPT still cannot fetch product HTML.

Examples in practice

• Shoppers and operators encounter “User-Agent” when researching AI recommendations, ChatGPT Shopping, or technical AI readiness.
• On TopMention pages, “User-Agent” is defined here so guides and ask pages can link to a single owner URL instead of redefining it.

How TopMention uses this term

• Dictionary owns the “What is …?” primary intent for this term.
• Related Learn primers are linked from nearby terms when a how-to exists.
• If this term names a crawler, the /bots entity page is the deeper owner for User-Agent facts.
• Ask and guide templates link here for definitions instead of competing H1s.

Common mistakes

• Treating the term as interchangeable with classic SEO rankings
• Creating multiple pages that all try to rank for the same definitional query
• Using the jargon in H1s on guide pages (guides should stay category-modified how-tos)

Go deeper

• Category guides (applications, not definitions)
• Ask hubs (shopper questions)

Related terms

• robots.txt — A file that tells crawlers which paths they may fetch.
• GPTBot — OpenAI crawler used to gather web content that may inform ChatGPT and related products.