Notes on Kafka at High Throughput

19 November 2026

Kafka is useful when a producer can generate data faster than the downstream consumer can process it.

Basic architecture

A typical system looks like:

API | v Kafka | v Consumer

Backpressure

The Kafka topic acts as a buffer between the producer and consumer.