openbmb
/

MiniCPM3-4B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

This repo includes the GGUF versions of MiniCPM3-4B:

minicpm3-4b-fp16.gguf
minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month: 6,667

GGUF

Model size

4.07B params

Architecture

minicpm3

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for openbmb/MiniCPM3-4B-GGUF

Base model

openbmb/MiniCPM3-4B

Quantized

(3)

this model

Quantizations

1 model

Collection including openbmb/MiniCPM3-4B-GGUF

MiniCPM

The MiniCPM family of LLMs and VLLMs. • 31 items • Updated 18 days ago • 54