Kafka Dead Letter Queue in Kafka Streams (KIP-1034) Introduction Kafka Streams 4.2.0 was released on February 16th, and it brings more than just improvements to exception handling and the dead letter queue (DLQ) mechanism. With KIP-1034 included in this release, Kafka Streams now provides native DLQ routing support that directly integrates with: * DeserializationExceptionHandler * ProcessingExceptionHandler * ProductionExceptionHandler
Kafka Processing Error Handling in Kafka Streams Introduction A major concern when developing Kafka Streams applications is handling processing errors. Processing errors occur when the implemented logic in a Kafka Streams application fails to process a record correctly. Let’s illustrate what processing errors are with a concrete example from our Supply Chain domain: a DeliveryBooked event
EventDriven Designing Kafka Streams Applications For the past 4 years, our journey into the heart of Kafka's capabilities has been shaped by two pivotal concepts: Master Topologies and Micro Topologies. These conceptual frameworks have become the backbone of our Kafka Streams application design, offering a comprehensive and granular understanding of our end-to-