Skip to content

When does the high level consumer actually call poll? #4095

Answered by edenhill
JSoet asked this question in Q&A
Discussion options

You must be logged in to vote

This means that consume() and consumer_poll() (et.al) consume() does not have any side effects, it simply pops messages off the internal prefetch queue.

Messages are prefetched in backgrounds threads to achieve the queued.min.messages (et.al) configuration properties.
As the queue count drops below the configured thresholds, more messages will be pre-fetched from the brokers.

https://github.com/edenhill/librdkafka/wiki/FAQ#how-are-partitions-fetched

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@JSoet
Comment options

Answer selected by JSoet
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants