Inference Providers
Active filters: awq
prism-ml/Ternary-Bonsai-27B-AWQ-4bit
Image-Text-to-Text
• 27B • Updated • 3.37k
• • 18
prism-ml/Bonsai-27B-AWQ-4bit
Image-Text-to-Text
• 27B • Updated • 1.05k
• 8
QuantTrio/Qwen3.6-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 1.17M
• 22
cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit
Image-Text-to-Text
• 36B • Updated • 1.73M
• 87
pearsonkyle/gemma4-31b-imatrix-mtp-GGUF
Image-Text-to-Text
• 31B • Updated • 16k
• 3
casperhansen/llama-3-8b-instruct-awq
Text Generation
• 8B • Updated • 27.8k
• 31
Qwen/Qwen2.5-VL-32B-Instruct-AWQ
Image-Text-to-Text
• 33B • Updated • 497k
• 65
Text Generation
• 8B • Updated • 646k
• 52
Any-to-Any
• 11B • Updated • 115k
• 20
stelterlab/NextCoder-32B-AWQ
Text Generation
• 33B • Updated • 9
• 4
QuantTrio/Qwen3.5-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 111k
• 44
mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-AWQ-4bit
Text Generation
• 29B • Updated • 124
• 2
alonsoko/gemma-4-31b-it-abliterated-heretic-AWQ-W4A16
Image-Text-to-Text
• 32B • Updated • 7.77k
• 14
shawnw3i/Huihui-Qwen3.6-27B-abliterated-AWQ-MTP
Image-Text-to-Text
• 6B • Updated • 34.7k
• 11
feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-AWQ-INT4
Image-Text-to-Text
• 36B • Updated • 1.6k
• 7
mconcat/Qwopus3.6-27B-v2-AWQ-4bit
Text Generation
• 11B • Updated • 5.5k
• 10
sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-AWQ
Text Generation
• 9B • Updated • 6.86k
• 3
philbert440/Qwen3.6-27B-Uncensored-Cyber-W4A16-AWQ
28B • Updated • 546
• 1
JunHowie/Qwythos-9B-Claude-Mythos-5-1M-AWQ
Text Generation
• 9B • Updated • 1.09k
• 1
LostGentoo/Qwen3-Embedding-8B-AWQ
Feature Extraction
• 8B • Updated • 160
• 1
8B • Updated • 18
• 1
groxaxo/Nemotron-3-Embed-1B-AWQ-W4A16
Feature Extraction
• 1B • Updated • 49
• 1
Image-Text-to-Text
• 1B • Updated • 2
Ar4ikov/OmniCoder-9B-AWQ-W4A16-ASYM
Image-Text-to-Text
• 10B • Updated • 1
divaspoudel/iol-Qwen2.5-14B-Instruct-AWQ
Text Generation
• 15B • Updated • 148
• 3
casperhansen/mpt-7b-8k-chat-awq
Text Generation
• Updated • 17
• 3
casperhansen/falcon-7b-awq
Text Generation
• Updated • 16
• 1
casperhansen/vicuna-7b-v1.5-awq
Text Generation
• Updated • 10
• 3
casperhansen/vicuna-7b-v1.5-awq-gemv
Text Generation
• Updated • 6
• 1
casperhansen/mpt-7b-8k-chat-awq-gemv
Text Generation
• Updated • 9