-
We are using the high level consumer and so we use the I assume that calling |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
This means that consume() and consumer_poll() (et.al) consume() does not have any side effects, it simply pops messages off the internal prefetch queue. Messages are prefetched in backgrounds threads to achieve the queued.min.messages (et.al) configuration properties. https://github.com/edenhill/librdkafka/wiki/FAQ#how-are-partitions-fetched |
Beta Was this translation helpful? Give feedback.
This means that consume() and consumer_poll() (et.al) consume() does not have any side effects, it simply pops messages off the internal prefetch queue.
Messages are prefetched in backgrounds threads to achieve the queued.min.messages (et.al) configuration properties.
As the queue count drops below the configured thresholds, more messages will be pre-fetched from the brokers.
https://github.com/edenhill/librdkafka/wiki/FAQ#how-are-partitions-fetched