Require compiling by yourself
git clone https://github.com/ggml-org/llama.cpp --branch pr-17592
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release
- Downloads last month
- 55
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for lovedheart/Kimi-Linear-REAP-35B-A3B-Instruct-GGUF
Base model
moonshotai/Kimi-Linear-48B-A3B-Instruct