Architecture & Design10 min
Building Robust Data Pipelines: From Design to Production
Build robust data pipelines from design to production: batch + streaming, Airflow, dbt, Flink, observability, and the failure modes that sink real pipelines.
Tag
2 posts
Architecture & Design10 min
Build robust data pipelines from design to production: batch + streaming, Airflow, dbt, Flink, observability, and the failure modes that sink real pipelines.
Event streaming in 2026: Kafka, Pulsar, Redpanda, Kinesis. Topic design, exactly-once semantics, schema evolution, and the failure patterns that matter.