Posts by angeo
Comments by angeo
The robots.txt rule that looks like it blocks AI crawlers and does not
Here is a robots.txt that appears to keep OpenAI's crawler out of two sensitive paths:
User-agent:
Disallow: /checkout/
Disallow: /customer/
User-agent: GPTBot
Crawl-delay: 1...
Sometime in the last two years you probably added a rule to robots.txt to keep AI crawlers out. A lot of us did. The intent was reasonable: don't train on my content without asking.
Go look at what you actually wrote. There is a good chance it reads...
Sometime in the last two years you probably added a rule to robots.txt to keep AI crawlers out. A lot of us did. The intent was reasonable: don't train on my content without asking.
Go look at what you actually wrote. There is a good chance it reads...
Sometime in the last two years you probably added a rule to robots.txt to keep AI crawlers out. A lot of us did. The intent was reasonable: don't train on my content without asking.
Go look at what you actually wrote. There is a good chance it reads...
Sometime in the last two years you probably added a rule to robots.txt to keep AI crawlers out. A lot of us did. The intent was reasonable: don't train on my content without asking.
Go look at what you actually wrote. There is a good chance it reads...
Most robots.txt files in production were written years ago, for one crawler, with one goal: let Google in, keep it out of the admin panel.
That file is still doing its job. But it's now also answering a question nobody asked it: whether ChatGPT, Cla...
The problem: you did the AEO work — robots.txt allows GPTBot, llms.txt is live, Product schema is complete — and GA4 shows... nothing. That's not because the work failed. It's because AI referral traffic hides in the wrong buckets: ChatGPT clicks lan...
Adobe's upgrade notice for Commerce 2.4.7 lists two options. There are four. Here's the complete technical breakdown — including the two zero-license paths Adobe won't mention in the email.
The timeline
From Adobe's published lifecycle table:
| Mi...
> Originally published at angeo.devhttps://angeo.dev/magento-2-ai-brand-visibility/. This is a cross-post; the canonical version lives there.
Short answer: when your customers ask ChatGPT, Claude or Perplexity "where should I buy this?", you current...
Everyone's telling you to add llms.txt for AI search. The 2026 data says it gets 0.1% of crawler tra
I'll save you the suspense: yes, you should still ship llms.txt on your Magento store. But not for the reason every "AEO guide" is selling you — and if you're shipping it instead of fixing the things that actually get you cited in ChatGPT, you've opt...
Groq vs GPT-4.1 vs Claude vs Gemini: a real e-commerce benchmark on 200 product descriptions
TL;DR. We ran 200 product descriptions through OpenAI GPT-4.1 / GPT-4.1-mini, Anthropic Claude Sonnet 4.6 / Haiku 4.5, Google Gemini 2.0 Flash, and Groq's ...
> Originally published on angeo.devhttps://angeo.dev/magento-product-description-invisible-ai-chatgpt/
You installed robots.txt rules for GPTBot. You generated llms.txt. You added Product schema. The AEO audit is green. ChatGPT still recommends yo...
chevron_left