Kafka Streams for Data Processing
What is Kafka Streams?
- Easy data processing and transformation library within Kafka
- Ships with Kafka Library
- No separate cluster needed for Kafka Streams as opposed to Flink
- Has exactly once capabilities
- On record at a time processing (no batching)
- Works for any application size
Kafka Stream vs Spark Streaming, NiFi, Flink?
- Data streaming over micro batch
- Cluster required for other options besides Kafka Stream
- Scales easily by just adding java processes
- Exactly once semantics
- All code-based