Felladrin
/

gguf-sharded-Q5_K_L-granite-3.0-3b-a800m-instruct

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Sharded GGUF version of bartowski/granite-3.0-3b-a800m-instruct-GGUF.

Downloads last month: 76

GGUF

Model size

3.37B params

Architecture

granitemoe

Inference API

Unable to determine this model's library. Check the docs .

Model tree for Felladrin/gguf-sharded-Q5_K_L-granite-3.0-3b-a800m-instruct

Base model

ibm-granite/granite-3.0-3b-a800m-base

Finetuned

ibm-granite/granite-3.0-3b-a800m-instruct

Quantized

bartowski/granite-3.0-3b-a800m-instruct-GGUF

Quantized

(1)

this model