Architecture & Design10 min
Building Robust Data Pipelines: From Design to Production
Build robust data pipelines from design to production: batch + streaming, Airflow, dbt, Flink, observability, and the failure modes that sink real pipelines.
Tag
3 posts
Architecture & Design10 min
Build robust data pipelines from design to production: batch + streaming, Airflow, dbt, Flink, observability, and the failure modes that sink real pipelines.
Event streaming in 2026: Kafka, Pulsar, Redpanda, Kinesis. Topic design, exactly-once semantics, schema evolution, and the failure patterns that matter.
Architecture & Design10 min
Database migration strategies: blue-green, shadow reads, dual-writes, and expand-contract. Zero-downtime playbooks that survive real production traffic.