Q3.5-9B-Opus-DA-GGUF
Q3.5-9B-Opus-DA (Qwen3.5 Distilled-Abliterated) is a reasoning-focused model built on Qwen/Qwen3.5-9B. This model is optimized for rich, detailed, and context-aware reasoning, leveraging multi-stage training on Opus reasoning traces combined with advanced refusal direction analysis and ablation-based training strategies to reduce internal refusal behaviors while preserving strong reasoning and instruction-following performance.
This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.
Note: This model is experimental and may generate artifacts.
Model Files
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Q3.5-9B-Opus-DA.BF16.gguf | BF16 | 17.9 GB | Download |
| Q3.5-9B-Opus-DA.F16.gguf | F16 | 17.9 GB | Download |
| Q3.5-9B-Opus-DA.F32.gguf | F32 | 35.8 GB | Download |
| Q3.5-9B-Opus-DA.Q8_0.gguf | Q8_0 | 9.53 GB | Download |
| Q3.5-9B-Opus-DA.mmproj-bf16.gguf | mmproj-bf16 | 922 MB | Download |
| Q3.5-9B-Opus-DA.mmproj-f16.gguf | mmproj-f16 | 922 MB | Download |
| Q3.5-9B-Opus-DA.mmproj-f32.gguf | mmproj-f32 | 1.82 GB | Download |
| Q3.5-9B-Opus-DA.mmproj-q8_0.gguf | mmproj-q8_0 | 624 MB | Download |
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
- Downloads last month
- 382
8-bit
16-bit
32-bit
