Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42

Base only

Active filters: llima

simaai/llava-1.5-7b-hf-a16w4

Image-Text-to-Text • Updated Jun 20 • 4

simaai/Llama-3.1-8B-Instruct-GPTQ-a16w4

Text Generation • Updated 5 days ago • 1

simaai/Llama-3.2-3B-Instruct-Autoround-a16w4

Text Generation • Updated 5 days ago • 1

simaai/Phi-3.5-mini-instruct-Autoround-a16w4

Text Generation • Updated 5 days ago • 3

simaai/gemma-3-4b-it-a16w4

Text Generation • Updated Jun 20 • 43

simaai/Llama-2-7B-chat-hf-GPTQ-a16w4

Text Generation • Updated 5 days ago • 1

simaai/whisper-small-a16w8

Automatic Speech Recognition • Updated about 14 hours ago

simaai/Gemma-3-1B-it-GPTQ-a16w4

Text Generation • Updated 5 days ago • 1

simaai/Mistral-7B-Instruct-v0.3-Autoround-a16w4

Text Generation • Updated 5 days ago • 5

simaai/Gemma3-SigLIP448-GPTQ-a16w4

Image-Text-to-Text • Updated 5 days ago • 20

simaai/Qwen2.5-0.5B-Instruct-Autoround-a16w4

Text Generation • Updated 5 days ago • 2

simaai/Qwen2.5-7B-Instruct-Autoround-a16w4

Text Generation • Updated 5 days ago

simaai/Qwen3-0.6B-Autoround-a16w4

Text Generation • Updated 5 days ago • 13

simaai/Qwen3-1.7B-GPTQ-a16w4

Text Generation • Updated 5 days ago

simaai/Qwen3-4B-Instruct-2507-GPTQ-a16w4

Text Generation • Updated 5 days ago • 6

simaai/Qwen3-8B-GPTQ-a16w4

Text Generation • Updated 5 days ago • 1

simaai/LFM2-VL-450M-Autoround-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/LFM2-VL-1.6B-Autoround-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/LFM2-VL-3B-Autoround-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/Qwen2.5-VL-3B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/Qwen3-VL-4B-Instruct-Autoround-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/Qwen3-VL-8B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/Qwen2.5-1.5B-Instruct-Autoround-a16w4

Text Generation • Updated 5 days ago

simaai/Llama-3.2-1B-Instruct-GPTQ-a16w4

Text Generation • Updated Jun 20

simaai/LFM2-350M-a16w4

Text Generation • Updated 5 days ago

simaai/LFM2-1.2B-Autoround-a16w4

Text Generation • Updated 5 days ago

simaai/LFM2-2.6B-Autoround-a16w4

Text Generation • Updated 5 days ago

simaai/Qwen2.5-3B-Instruct-Autoround-a16w4

Text Generation • Updated 5 days ago

simaai/Qwen2.5-VL-7B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated 5 days ago

simaai/Qwen3-VL-2B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated 5 days ago