Corrupted‑to‑Gold: MDM Foundations
This build takes intentionally corrupted CSV files and transforms them into clean, trusted, analytics‑ready Delta tables. The pipeline demonstrates real‑world data engineering constraints: inconsistent delimiters,...
I built the Mini Ingestion Framework MIF — a deterministic, SOP‑driven future engine that turns simple user requirements into a complete Spark ingestion pipeline.
MIF uses a numbered SOP library to generate:
a minimal SOP subset
ordered inge...
Over the past few years, my professional journey has taken an unexpected but deeply meaningful turn. What began as a focused path in Functional Safety—SIS, SIL, lifecycle governance, risk modeling—has steadily converged with a growing passion for dat...
Just wrapped up a real‑world debugging arc inside Azure Synapse — the kind that reminds you data engineering is built on investigation, not just pipelines.
A simple task “load 18 months of NYC Taxi data into the Silver
layer” turned into a full b...
My path into cognitive engineering didn’t begin with code.
It began in human systems — safety, governance, compliance, and the mechanics of how people behave under pressure. These environments taught me a truth that has shaped everything I build toda...