QuantTrio
/

DeepSeek-V3.1-AWQ-Lite

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (1)

random atrifacts on larger outputs

#4 opened 2 months ago by

[request] DeepSeek-V3.1-Terminus

#3 opened 2 months ago by

ooof this fits in 4x96gb can we get this for the new 3.2 Speciale ase well please :)

#2 opened 3 months ago by