Seed-OSS-36B-Instruct

GGUF quant of https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct with better precision applied to attention related layers for better performance.

Downloads last month
101
GGUF
Model size
36B params
Architecture
seed_oss
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for altomek/Seed-OSS-36B-Instruct-XXL-GGUF

Quantized
(39)
this model

Collection including altomek/Seed-OSS-36B-Instruct-XXL-GGUF