v1.0.0
Stable Release
Notice: This release is not backwards compatible
-
Breaking Changes
- pre / post processing class functions get 3 arguments, see example
- Add support for per-request state storage, passing information between the pre/post processing functions
-
Features & Bug fixes
- Optimize serving latency while collecting statistics
- Fix metric statistics collecting auto-refresh issue
- Fix live update of model preprocessing code
- Add
pandas
to the default serving container - Add per endpoint/variable statistics collection control
- Add
CLEARML_EXTRA_PYTHON_PACKAGES
for easier additional python package support (serving inference container) - Upgrade Nvidia Triton base container image to 22.04 (requires Nvidia drivers 510+)
- Add Kubernetes Helm chart