LlamaFinetune
/

Meta-Llama-3.1-8B-Instruct-bnb-4bits

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

Model Card for Model ID

Below is the orginal model card as this is just a 4-bit version of that.

Model Details

Downloads last month: 2

Safetensors

Model size

4.65B params

Tensor type

FP16

·

F32

·

U8

·

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.