Apache Iceberg vs. Delta Lake vs. Apache Hudi: The 2026 Benchmark
An empirical benchmark evaluating metadata management, write amplification, compaction cost, and concurrent query latency across the three major Lakehouse table formats.
Engineering Publications
Technical Articles & Architectural Guides
4 technical guides · Spark · Kafka · Lakehouse · Flink
Research-based technical deep-dives on distributed streaming, Lakehouse internals, and Spark performance.
Zero-ZooKeeper Kafka KRaft & Spark Streaming in Production
KRaft vs. ZooKeeper architecture, a production migration path, controller resilience and exactly-once Spark Structured Streaming design patterns.
Production Apache Spark 3.x Tuning: Eliminating Shuffles & Skew
A production guide to broadcast joins, Adaptive Query Execution, key salting, executor sizing and stable performance on shuffle-heavy workloads.
Apache Flink vs. Spark Structured Streaming: Real-Time Data Pipelines at Scale
Event-driven versus micro-batch processing, state management, checkpointing, latency, throughput and Lakehouse integration.