Each section below answers one big question about data engineering, and each page inside it answers one smaller question on the way there.

Streaming Pipelines

How do I build a correct, fault-tolerant streaming pipeline in Spark?

Spark Performance

Why is my Spark job slow, and how do I find out?

Lakehouse Table Formats

How do table formats give a data lake database-like behavior?