How to paritition batches into different payload #199

Unanswered

gangliao asked this question in Ideas

gangliao
Mar 14, 2021
Maintainer

Requirement:

Each payload's size is up to 256 KB but could be larger when we compress the batches (~4x). How to ensure that the payload limit is not exceeded?

Replies: 1 comment

gangliao
Mar 15, 2021
Maintainer Author

It seems that it can only be divided by traversing the metadata of the batch.

0 replies

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment