Everyone’s Building AI Agents. Here’s the One I Built for Myself

Everyone’s Building AI Agents. Here’s the One I Built for Myself

posted 1 min read

These days, everyone seems to be building AI agents.

So I figured I should probably build one too.

But instead of another generic demo, I wanted to solve a small problem I actually had.

Over time, I had collected a bunch of blog posts and technical notes in a folder. I wanted a quick way to understand them without opening every file one by one.

Questions like:

  • What topics do I write about most?
  • Do some posts contradict each other?
  • Can I create a learning path from my own notes?

Uploading everything to ChatGPT did not feel right.

My content. My machine.

So I built a small local RAG agent.

How it works

It reads markdown files, understands their meaning, and lets me query across all of them in plain English.

Under the hood, it looks something like this:

Markdown Files
      ↓
Chunking & Parsing
      ↓
nomic-embed-text (via Ollama)
      ↓
ChromaDB (local vector storage)
      ↓
Relevant Context Retrieval
      ↓
Mistral (via Ollama)
      ↓
Answer

Everything runs locally on my laptop.

No cloud. No external APIs. Just Python and a few focused tools.

Where AI Actually Helped

The architecture was clear before I started coding. The “vibe coding” part was mostly using AI to speed up repetitive work like tests, boilerplate, and wiring pieces together.

Idea to working CLI in about a week.

I’ve open sourced the project if you want to take a look:

Repo: Knowledge Onboarding Agent

What’s next

Next, I might add PDF support and a lightweight web UI.

Curious to know, have you built something similar recently? If yes, what problem did you solve?

Also curious, if you were building this, would you keep it fully local or use cloud APIs? What would you do differently?

More Posts

Sovereign Intelligence: The Complete 25,000 Word Blueprint (Download)

Pocket Portfolio - Apr 1

Architecting a Local-First Hybrid RAG for Finance

Pocket Portfolio - Feb 25

The Privacy Gap: Why sending financial ledgers to OpenAI is broken

Pocket Portfolio - Feb 23

How I Built a React Portfolio in 7 Days That Landed ₹1.2L in Freelance Work

Dharanidharan - Feb 9

AI Agents Don't Have Identities. That's Everyone's Problem.

Tom Smithverified - Mar 13
chevron_left

Related Jobs

View all jobs →

Commenters (This Week)

3 comments
2 comments
1 comment

Contribute meaningful comments to climb the leaderboard and earn badges!