StoatFlow

Posts tagged “Deep Dive”

All posts
KIP-1035: Why Kafka Streams 4.3 lets state stores own their offsets
Deep Dive

KIP-1035: Why Kafka Streams 4.3 lets state stores own their offsets

Kafka Streams kept each task's changelog offsets in a separate checkpoint file that could drift from the state it described. KIP-1035, in Kafka 4.3, moves them inside the state store — atomic with the data, and the keystone for transactional state stores.
Hartmut Armbruster

Hartmut Armbruster

KIP-1271: record headers in state stores, and the cost of a value format
Deep Dive

KIP-1271: record headers in state stores, and the cost of a value format

KIP-1271/1285 let a state store keep a record's headers next to its value — shipped in Apache Kafka 4.3.0. What the KIP is, where Kafka Streams has got to (and what is still in flight), how StoatFlow 1.0.0 compares — and why a one-varint format change becomes an engine-wide one.
Hartmut Armbruster

Hartmut Armbruster