v0.8.0
Pre-release
Pre-release
0.8.0 (2024-04-25)
Features
- deps: upgrade ray version (cc61b85)
- ray: adapt to native docker client instead of docker sdk (#138) (7d19ccb)
- ray: add accelerator and custom resource support (#118) (f974f98)
- ray: add llava 13b to predeploy list (3fd5914)
- ray: add metadata and infer constructor for llm tasks (#137) (be122d1)
- ray: generate sha256 as tag if not presented (#120) (6abb538)
- ray: inject accelerator type at runtime (#121) (f78a2d0)
- ray: support containerized model serving (#116) (ad0f250)
- ray: support custom accelerator type (#134) (ae6c139)
- ray: use env for resource and deprecate deploy/undeploy (#124) (a58bc50)
- ray: use tmp folder for image building (#122) (9512cec)
Bug Fixes
- deps: downgrade ray to avoid grpc servicer issue (#128) (9ead421)
- dockerfile: avoid build hang at ARG statement (#130) (f02a27c)
- ray: fix etrypoint module not found (#126) (f1ed83d)
- ray: fix missing default resource value (#129) (b2f564a)
- ray: fix multi-platform build stage (6f358fd)
- ray: support target platform for image building (#127) (f4825fc)