You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My team is building an application in C# that reads from one Kafka cluster and writes to another. It is vital that:
Events are written in order
No event is skipped
Initially we used an awaited ProduceAsync call but were concerned about speed. It goes much faster when using Produce, but we have noticed that the code continues after calling it, before the delivery report has been received.
Does this mean that we continue producing entries even though we don't know the status of earlier entries? Can we stop producing entries when some event fails?
Initially we thought about committing to to the source Kafka in the delivery report, but we are concerned about committing events after one has failed or otherwise had an error. Is there any guarantee that the delivery report will:
always be made?
always be in order?
What happens if the report is unable to be received, is the entry still written into the Kafka?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
My team is building an application in C# that reads from one Kafka cluster and writes to another. It is vital that:
Initially we used an awaited ProduceAsync call but were concerned about speed. It goes much faster when using Produce, but we have noticed that the code continues after calling it, before the delivery report has been received.
Does this mean that we continue producing entries even though we don't know the status of earlier entries?
Can we stop producing entries when some event fails?
Initially we thought about committing to to the source Kafka in the delivery report, but we are concerned about committing events after one has failed or otherwise had an error. Is there any guarantee that the delivery report will:
What happens if the report is unable to be received, is the entry still written into the Kafka?
Beta Was this translation helpful? Give feedback.
All reactions