angeo
Contributions
Articles
- The robots.txt rule that looks like it blocks AI crawlers and does notAug 19, 2026
- Most sites that blocked AI blocked the wrong thingJul 31, 2026
- Your robots.txt Was Written for Googlebot. It's Now Quietly Deciding Whether AI Can Cite You.Jul 24, 2026
- How to Let an AI Agent Complete a Magento 2 Checkout via MCPJul 09, 2026
- Tracking ChatGPT, Perplexity & Gemini Traffic in Magento 2 (GA4 Guide, 2026)Jul 06, 2026
Comments
- @[Gyan] Common enough that I check it first now.
Across 762 live Mage...Aug 20, 2026
- @[QuestMeet] Thanks — the parallel holds. One difference: sites had ...Aug 02, 2026
- @[Tom Smith] Thanks! I think the biggest issue is that most block list...Aug 01, 2026
- @[Jakub Neruda] You're right that `robots.txt` ultimately relies on vo...Aug 01, 2026
- @[Jakub Neruda] Less than there used to be, but more than nothing.
To...Aug 01, 2026
chevron_left