Edit Models filters

Model Tree

raincandy-u/Llama-3-5B-Sheard

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

6

Full-text search

Active filters: raincandy-u/Llama-3-5B-Sheard

PrunaAI/raincandy-u-Llama-3-5B-Sheard-QUANTO-int4bit-smashed

PrunaAI/raincandy-u-Llama-3-5B-Sheard-QUANTO-int8bit-smashed

PrunaAI/raincandy-u-Llama-3-5B-Sheard-QUANTO-int2bit-smashed

PrunaAI/raincandy-u-Llama-3-5B-Sheard-HQQ-2bit-smashed

Text Generation • Updated Jul 19 • 108

PrunaAI/raincandy-u-Llama-3-5B-Sheard-HQQ-4bit-smashed

Text Generation • Updated Jul 19 • 16

PrunaAI/raincandy-u-Llama-3-5B-Sheard-QUANTO-float8bit-smashed