unsloth
/

Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (4)

Vllm running error

#9 opened about 1 month ago by

Suggestion for Meta-Llama 3.1-8B Instruct change model

#8 opened 3 months ago by

upload adapter_config.json

#6 opened 3 months ago by

Support for MPS?

#5 opened 3 months ago by

Update config.json

#4 opened 3 months ago by

RuntimeError: Unsloth: `unsloth/Meta-Llama-3.1-8B-bnb-4bit` is not a base model or a PEFT model.

#3 opened 4 months ago by