Skip to content

v0.8.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@droplet-bot droplet-bot released this 25 Apr 22:06
d0f3f90

0.8.0 (2024-04-25)

Features

  • deps: upgrade ray version (cc61b85)
  • ray: adapt to native docker client instead of docker sdk (#138) (7d19ccb)
  • ray: add accelerator and custom resource support (#118) (f974f98)
  • ray: add llava 13b to predeploy list (3fd5914)
  • ray: add metadata and infer constructor for llm tasks (#137) (be122d1)
  • ray: generate sha256 as tag if not presented (#120) (6abb538)
  • ray: inject accelerator type at runtime (#121) (f78a2d0)
  • ray: support containerized model serving (#116) (ad0f250)
  • ray: support custom accelerator type (#134) (ae6c139)
  • ray: use env for resource and deprecate deploy/undeploy (#124) (a58bc50)
  • ray: use tmp folder for image building (#122) (9512cec)

Bug Fixes

  • deps: downgrade ray to avoid grpc servicer issue (#128) (9ead421)
  • dockerfile: avoid build hang at ARG statement (#130) (f02a27c)
  • ray: fix etrypoint module not found (#126) (f1ed83d)
  • ray: fix missing default resource value (#129) (b2f564a)
  • ray: fix multi-platform build stage (6f358fd)
  • ray: support target platform for image building (#127) (f4825fc)