Week 3 of Data Engineering Zoomcamp by @DataTalksClub complete! Just finished Module 3 - Data Warehousing with BigQuery. Learned how to: Create external tables from GCS bucket data Build materialized tables in BigQuery Partition and cluster tables for performance Understand columnar storage and query optimization Analyze NYC taxi data at scale Working with 20M+ records and learning how partitioning reduces query costs!
Here's my homework solution: https://github.com/Derrick-Ryan-Giggs/Module-3-Data-Warehousing-BigQuery-homework
Following along with this amazing free course - who else is learning data engineering? You can sign up here: https://github.com/DataTalksClub/data-engineering-zoomcamp/
Partitioning cutting query costs is such a cool win, nice work. Did you notice any big performance difference once clustering was added?
Contribute meaningful comments to climb the leaderboard and earn badges!
