A dbt project that ingests and transforms UK Environment Agency flood monitoring data. This started as a blog post about building a data pipeline with DuckDB. I then built this as a learning exercise ...
A Data Warehousing project for retail sales using dimension modelling best practices with SCD type 2 on AWS Redshift. Utilizing AWS Lambda, Glue Workflows and Python Shell jobs to create and automate ...