0.2.3

What's Changed

Added support for quantized models. 4-bit and 8-bit are supported using the --q flag.

New Contributors

• @blakejakopovic made their first contribution in #25

Full Changelog: 0.2.2...0.2.3