Consumer Offsets

Apache Kafka stores the offsets at which a Consumer Group has been reading.

The offsets committed are in a Kafka Topic named __consumer_offsets

When a Consumer in a Consumer Group has processed data received, it should be periodically committing the offsets.

The Kafka Broker will write to consumer_offsets, not the Consumer Group itself).

If a Consumer fails, it will be able to read back from where it left off thanks to the committed Consumer Offset.

References

Flashcards

Consumer Offsets are stored::: __consumer-offsets

True/False, Consumers are responsible for committing their Consumer Offsets to the __consumer_offsets topic:: false, the Broker will write to __consumer_offsets