Borealis 4B Instruct GGUF (Preview)
Release: Dec 22nd, 2025.
Model summary
NbAiLab/borealis-4b-instruct-preview-gguf are quantized versions in GGUF format of a 4B-parameter instruction-tuned preview model intended for early testing and feedback. It is an experiment and should be treated as pre-release quality.
The original model is NbAiLab/borealis-4b-instruct-preview.
| Model | Bits | Format |
|---|---|---|
| NbAiLab/borealis-4b-instruct-preview | BF16 | Transformers (safetensors) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 8 | GGUF (q8_0) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 16 | GGUF (f16) |
| NbAiLab/borealis-4b-instruct-preview-gguf | BF16 | GGUF (bf16) |
| NbAiLab/borealis-4b-instruct-preview-mlx | 32 | MLX |
| NbAiLab/borealis-4b-instruct-preview-mlx-8bits | 8 | MLX (quantized) |
- Downloads last month
- 326
Hardware compatibility
Log In
to view the estimation
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for NbAiLab/borealis-4b-instruct-preview-gguf
Base model
google/gemma-3-4b-pt
Finetuned
google/gemma-3-4b-it
Finetuned
NbAiLab/borealis-4b-instruct-preview