Skip to content

Latest commit

 

History

History
13 lines (9 loc) · 624 Bytes

V1beta1Batcher.md

File metadata and controls

13 lines (9 loc) · 624 Bytes

V1beta1Batcher

Batcher specifies optional payload batching available for all components

Properties

Name Type Description Notes
max_batch_size int Specifies the max number of requests to trigger a batch [optional]
max_latency int Specifies the max latency to trigger a batch [optional]
timeout int Specifies the timeout of a batch [optional]

[Back to Model list] [Back to API list] [Back to README]