altomek
/

Seed-OSS-36B-Instruct-XXL-GGUF

Text Generation

Model card Files Files and versions

Seed-OSS-36B-Instruct

GGUF quant of https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct with better precision applied to attention related layers for better performance.

Downloads last month: 101

GGUF

Model size

36B params

Architecture

seed_oss

Hardware compatibility

Log In to add your hardware

Model tree for altomek/Seed-OSS-36B-Instruct-XXL-GGUF

Base model

ByteDance-Seed/Seed-OSS-36B-Instruct

Quantized

(39)

this model

Collection including altomek/Seed-OSS-36B-Instruct-XXL-GGUF

XXL GGUF

Inspired by Unsloth XL quants, I started mastering my own GGUF quants with gool to make them even better then XL ones. • 8 items • Updated 19 days ago