GGUF convert code
#2
by
AminJhn
- opened
Hey there! I am trying to convert my fine-tuned vibevoice into a gguf format for inference but cant find proper code or converter any where. The architecture is currently unsupported to any known converter like llama.cpp. Can anyone help me with that?
guess ggc v6 works with the converted f16 gguf
Tnx for the response but I am a little confused, I mean I want to findout how to actually convert my model to gguf, not to use an inference the converted gguf. Can you help me with that?