Guide on how to create nunchaku weights
#5
by vibhavagarwal5 - opened
Hi, so good to see someone outside of the nunchaku team generating these weights, can you outline the process and the steps in order to achieve the same. What all is required and how to even do this via deepcompressor for other models if needed or even replicate this for your qwen models.
vibhavagarwal5 changed discussion title from How to create nunchaku weights to Guide on how to create nunchaku weights