Pinned Loading

1. xLLM xLLM Public

   A lightweight llama2 inference framework. It can inference llama2-7b with 166+ tokens/s on signle 4090.

   C++ 3 1

2. hands-on-kernels hands-on-kernels Public

   High Performance Kernels on GPU/CPU

   Python 3