Repositories list

• UChi-JCL.github.io

  Public
  HTML

  •0•0•0•0•Updated Oct 18, 2024Oct 18, 2024

• CacheGen

  Public
  Python

  •8•63•5•0•Updated Oct 9, 2024Oct 9, 2024

• chameleonAPI

  Public
  Python

  •

  Apache License 2.0

  •0•5•0•0•Updated May 26, 2024May 26, 2024

• Grace

  Public
  Python

  •

  Other

  •3•21•3•1•Updated May 20, 2024May 20, 2024

• vllm

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •4.5k•1•0•0•Updated May 20, 2024May 20, 2024