Skip to content

This is a Pumpjack Data Works internship task where we have to setup a system which will keep the data stream from getting lost before going into the Kafka Broker and alert the producer to resend that specific data packet. All things networking included.

Notifications You must be signed in to change notification settings

Blankscreen-exe/kafka-docker-deadletterqueue

Repository files navigation

Kafka DeadLetter Exchange/Delay Mechanism

Introduction

This mechanism is introduced as a solution to data being rejected or dropped before being produced to a Kafka-Broker Topic. We also consider the possibilities that a Kafka Broker sends a data packet but that data is not recieved by a consumer. This mechanism simply resolved that issue and established a Dead Letter Queue as a reliable queue which will not only host a sequence of dead-letters but also the corrupted data which should be allowed to enter into a Kafka Queue.

References

1- Error Handling via Dead Letter Queue in Apache Kafka (source: kai-waehner.de)

About

This is a Pumpjack Data Works internship task where we have to setup a system which will keep the data stream from getting lost before going into the Kafka Broker and alert the producer to resend that specific data packet. All things networking included.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published