Q3.5-9B-Opus-DA-GGUF

Q3.5-9B-Opus-DA (Qwen3.5 Distilled-Abliterated) is a reasoning-focused model built on Qwen/Qwen3.5-9B. This model is optimized for rich, detailed, and context-aware reasoning, leveraging multi-stage training on Opus reasoning traces combined with advanced refusal direction analysis and ablation-based training strategies to reduce internal refusal behaviors while preserving strong reasoning and instruction-following performance.

This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.

Note: This model is experimental and may generate artifacts.

Model: https://huggingface.co/prithivMLmods/Q3.5-9B-Opus-DA

Model Files

File Name Quant Type File Size File Link
Q3.5-9B-Opus-DA.BF16.gguf BF16 17.9 GB Download
Q3.5-9B-Opus-DA.F16.gguf F16 17.9 GB Download
Q3.5-9B-Opus-DA.F32.gguf F32 35.8 GB Download
Q3.5-9B-Opus-DA.Q8_0.gguf Q8_0 9.53 GB Download
Q3.5-9B-Opus-DA.mmproj-bf16.gguf mmproj-bf16 922 MB Download
Q3.5-9B-Opus-DA.mmproj-f16.gguf mmproj-f16 922 MB Download
Q3.5-9B-Opus-DA.mmproj-f32.gguf mmproj-f32 1.82 GB Download
Q3.5-9B-Opus-DA.mmproj-q8_0.gguf mmproj-q8_0 624 MB Download

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

Downloads last month
382
GGUF
Model size
9B params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

8-bit

16-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for prithivMLmods/Q3.5-9B-Opus-DA-GGUF

Finetuned
Qwen/Qwen3.5-9B
Quantized
(3)
this model

Datasets used to train prithivMLmods/Q3.5-9B-Opus-DA-GGUF

Collection including prithivMLmods/Q3.5-9B-Opus-DA-GGUF