Posts by Joe Munene

@Joe Munene

Joe Munene

AI researcher & full-stack engineer | Building LLMs from scratch
Nairobi my-portfolio-peach-eta-42.vercel.app Joined May 2026
1k Points19 Badges4 Connections5 Followers8 Following

Posts by Joe Munene

Joe Munene in Articles 4 min read
I built a red-team scanner for MCP servers. Then I pointed it at the real ones. The Model Context Protocol lets an AI agent connect to external tools: a filesystem, GitHub, Slack, a database. Each server an agent connects to advertises a list of to...
Joe Munene in Articles 3 min read
I've been building GhostLM — a decoder-only transformer trained from scratch in PyTorch on cybersecurity data. No pretrained weights, every component hand-written. A few weeks ago I published a post about fixing a leaky train/val split that made my ...
Joe Munene in Articles 7 min read
What I Learned Building a Cybersecurity LLM From Scratch: 30,000 Steps, 3 Data Rewrites, and One Capacity Ceiling I started building GhostLM thinking the hard part would be the transformer architecture. I was wrong. The architecture took one day. T...
Joe Munene in Articles 2 min read
I've been building GhostLM for the past few months — a decoder-only transformer trained entirely from scratch in PyTorch on cybersecurity data. No pretrained weights, no HuggingFace wrappers. Every component hand-written. Phase 1 looked promising. Af...
post-cover-16399
chevron_left

Latest Jobs

View all jobs →