Engineering · Software Engineering (Applied)

Data Engineering

A topic within Software Engineering (Applied), itself one of 12 topics in that field and part of Engineering.

Reading on Data Engineering

2 works

Essay2013

The Log: What every software engineer should know about real-time data's unifying abstraction

Jay Kreps

Argues the append-only log, not the database table, is the right shared abstraction for moving data between the many systems a modern company runs, and traces how that insight became Kafka.

link checked 17 Sept 2026

Engineering · Software Engineering (Applied)

FreeIntermediate

Essay2011

How to Beat the CAP Theorem

Nathan Marz

Argues a data system does not have to choose one horn of the CAP theorem if it separates an immutable batch layer, which is allowed to be slow but must be correct, from a fast approximate layer that only has to cover the most recent data.

Engineering · Software Engineering (Applied)

FreeAdvanced

Reading on Data Engineering

The Log: What every software engineer should know about real-time data's unifying abstraction

How to Beat the CAP Theorem

Other topics in Software Engineering (Applied)