llmware
/

minicpm-2.6-gguf

Model card Files Files and versions

minicpm-2.6-gguf

minicpm-2.6-gguf is a GGUF Q4_K_M quantized version of MiniCPM-2.6, providing a fast, small inference implementation, optimized for AI PCs.

Model Description

Developed by: openbmb
Quantized by: bartowksi
Model type: minicpmv
Parameters: 7 billion
Model Parent: openbmb/MiniCPM-V-2_6
Language(s) (NLP): English
License: Apache 2.0
Uses: Chat, general-purpose LLM
Quantization: int4

Model Card Contact

llmware website

Downloads last month: 40

GGUF

Model size

8B params

Architecture

qwen2

Hardware compatibility

Log In to view the estimation

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for llmware/minicpm-2.6-gguf

Base model

openbmb/MiniCPM-V-2_6

Quantized

(13)

this model