AI crawlers in robots.txt
GPTBot, Google-Extended and PerplexityBot must be allowed. Blocking them removes your store from AI shopping research entirely.
AI crawlers read raw HTML — not a rendered browser. Score ten technical factors in 30 seconds and see what stops ChatGPT, Perplexity and Google AI Overviews from citing your Shopify or ecommerce site.
Enter a store URL to score ten technical factors that affect whether AI crawlers can read and cite your ecommerce site.
Same idea as thetechnical AI visibility framework— adapted for UK ecommerce. See also Victoria Olsina’sAEO and GEO experts roundup(LoudCrowd listed for ecommerce). Local service businesses:loudcrowd.digital checker.
GPTBot, Google-Extended and PerplexityBot must be allowed. Blocking them removes your store from AI shopping research entirely.
Machine-readable manifests help AI find category hubs, policies and brand facts — especially on large Shopify catalogues.
Product, Organization and FAQPage JSON-LD give AI extractable prices, ranges and policies. Thin themes often ship without them.
If titles, descriptions and schema only load via JavaScript, LLMs may see empty product shells — common after custom headless builds.
Google guidance · AEO
Google’s web.dev guidance covers AI agents that browse and act on your store. Our checker scores the crawlability layer those agents and answer engines share — raw HTML, robots.txt, llms.txt and schema.
See Google’s overview:Build agent-friendly websites(web.dev). Below is how that advice maps to our free checker and AEO work.
| Agent-friendly guidance | LoudCrowd checker & AEO |
|---|---|
| Readable product HTML (not JS-only theme shells) | Readable text in HTML — H1, title and body copy visible without executing JavaScript |
| Product schema and machine-readable entity signals | JSON-LD Product/Organization, FAQ schema, llms.txt and ai.txt |
| AI crawlers allowed to fetch store pages | robots.txt — GPTBot, Google-Extended, PerplexityBot not blocked |
| Accessibility tree: roles, names and labelled forms | Fixed in theme CRO — semantic buttons, labelled checkout fields, stable PDP layout |
| Stable CTAs on PDP and collection templates | Shopify SEO + CRO — consistent add-to-cart and trust paths agents and shoppers follow |
Technical crawlability is step one. AEO adds extractable FAQs, category hubs and entity consistency so AI recommends your store — not just reads it.
Product schema, readable collection HTML and llms.txt matter when shoppers ask AI for the best Shopify store in your niche. Technical readiness is step one — ourAEO programmes fix entity signals, category hubs and citation-ready content.
Yes. Enter any store or brand URL and get a score in about 30 seconds — no signup. It checks technical factors AI crawlers use, not whether ChatGPT will recommend you.
Yes. Shopify themes vary — some serve rich HTML, others lean on JavaScript. The checker reads raw HTML the way GPTBot and PerplexityBot often do.
Ten technical checks combine into a score out of 100. Higher means AI systems are more likely to read, classify and extract product and brand facts from your pages.
No. This is technical readiness only. Citations also need authority, reviews, product schema, category hubs and consistent entity signals — our AEO and Shopify SEO work covers that.
Google renders JavaScript for indexing. Many AI crawlers fetch raw HTML only. This tool mirrors what LLMs often see, plus ai.txt, llms.txt and FAQ schema.
For UK ecommerce and Shopify, stay on this agency checker. For trades and local service businesses (roofers, solicitors, etc.), see loudcrowd.digital GEO services.
Book a 15-minute call — we will walk through your score and what AEO would change for your catalogue.