Export Helper persistent queue for retry capabilities only

[shreeramkulkarni]

In Export Helper, I am aware that the sending_queue can be configured to be a persistent queue. But when set, file-based queue is not only used for retry capabilities but also for storing the batches for normal exports.

Also as per the readme,

There is no in-memory queue when set.

This means no in-memory buffer is used at all and all the batch are queued in the file.
Wouldn't it be better if we can use the persistent queue ONLY for retry and in-memory queue would be normal batch exports??

This can help save disk space as I expect retry operation occurrences to be way lower than normal exports. Also, could be faster as the collector would have lower file reads during the exports.

Is there another way to have the persistent queue for retries only and in-memory for normal exports? Any insights or suggestions on this are highly appreciated!

Thanks