An easy to use Open source colection of Notebooks and other stuff for quantizing LLMs.
#1 download one of the Notebooks to a jupiter notebook enviroment. #2 Set your varuables; LLM to quantize, bits, group size, etc. #3 let it run and after everything is done, use the last part to upload it to hugging face.
This github repo is made as a project to make Information around LLM quantization and make stuff like that More easy. If you notice something that looks wrong or know how to make something better, Open a Pull request, if your request looks good it will be approved.