The Problem: My Friend's Nightly Struggle
My friend Carlos is a field supervisor in the construction industry. He spends his entire day walking around sites, inspecting materials, and dealing with contractors. But his real nightmare began at 6:00 PM: he had to sit down for two hours to manually transcribe all his messy WhatsApp voice notes into his company's structured Google Sheets and PowerBI dashboards.
He was exhausted, and his family missed him in the evenings. I knew I had to build something for him.
What I Built
I built a WhatsApp-based AI assistant that completely automates his data entry. Now, Carlos just sends a WhatsApp voice note like: "Today we received 50 bags of cement from supplier X, but 3 were damaged. Total cost \$250."
The system automatically:
- Receives the audio via Webhook.
- Downloads the .ogg file using the WhatsApp Business API.
- Transcribes the audio using Whisper (Open-Source AI).
- Extracts the exact entities (Material, Quantity, Status, Cost) using an LLM.
- Pushes the clean, structured JSON directly into his Google Sheets.
Demo & Architecture
Here is a look under the hood using Make (formerly Integromat) to orchestrate the workflow:
(If you want to see the exact step-by-step technical guide on how I solved the tricky WhatsApp Media ID download, check out my deep-dive technical post on DEV.to)
Why Open Innovation Matters for This Project
Open-source AI is the absolute core of this solution, specifically OpenAI's Whisper model.
For Carlos, open innovation matters for two critical reasons:
- Language & Slang: Carlos speaks Spanish with heavy local construction slang. Proprietary, rigid voice-to-text models fail miserably at this. Whisper's open-source architecture allows for incredibly robust multilingual transcription that actually understands him.
- Future Data Privacy: Because Whisper is open-source, if Carlos's company ever demands strict data privacy (keeping audio files off third-party servers), we have the freedom to take this exact workflow and run Whisper locally on a private server or even a laptop on the construction site with no internet. Open innovation gives us the flexibility to scale without vendor lock-in.
I handed the bot over to Carlos yesterday. His response? "You just gave me my evenings back." That's the power of building for a friend. 🚀
