Let us learn "AI Agent Evaluation" with humour.

Question 1

AI Agents can plan, reason, and act - but how do we know if they’re doing it correctly?

What if you wanted to book a ticket to London, but the AI Agent booked one to Lisbon?

We have to evaluate them, like we test software, right?

However, evaluating AI Agents is not as simple as evaluating traditional software or even an LLM

In this episode, join Jigyaasu and Saral as they simplify AI evaluation with relatable examples.

-> Next episode: MCP and A2A

Previous episodes:

0. Basics of AI -

Question 2

Haha, love the Lisbon vs London example, makes me wonder how often real AI agents make those “funny but costly” mistakes.

Question 3

@[Ben Kiehl] more often than we think :)

Ben Kiehl · Answer 1 · 2025-11-12T09:22:18+0000

Haha, love the Lisbon vs London example, makes me wonder how often real AI agents make those “funny but costly” mistakes.

Haha, love the Lisbon vs London example, makes me wonder how often real AI agents make those “funny but costly” mistakes. — Ben Kiehl, Nov 12

	Learn Multi-AI Agents with humour in simple language Nikhilesh Tayal - Sep 24
	Building Intelligent Workflows Without LLMs: With Microsoft Agent Framework Shweta Lodha - Oct 16
	Agent Payments Protocol (AP2) in simple language with an example Nikhilesh Tayal - Oct 7
	Microsoft Agent Framework Series: Create Your First AI Agent in C# & AZ Open AI TheCodeStreet - Oct 14
	AutoReviewer AI is an autonomous agent built using Runner H Rahul Bhave - Jul 12

1 Comment