Every AI agent has the same problem. You ask it to read a webpage and it comes back with a 403, or worse, 5000 tokens of navigation bars and cookie banners.
I spent the last few months building webclaw to fix this.
The problem
Try fetching any rea...