//Blog
Notes from the pipeline
Practical write-ups on data engineering: pipelines, data quality, modelling, and the lessons I learn shipping them.
Topics
Latest post
3 min readEN
SCD Type 2 with dbt snapshots, explained with Airbnb data
How dbt snapshots keep the full history of changing records — timestamp vs check strategies, the columns dbt adds, and how to query a table as it was on any date.
Read4 min readEN
Rules aren’t enough: adding ML to data quality checks
Hard-coded quality rules catch the problems you anticipated. Here is how I layer ML anomaly classification on top — without drowning people in alerts.
Read