HF1BitLLM
/

Llama3-8B-1.58-100B-tokens

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Resources

View closed (5)

added missing imports

#12 opened 9 days ago by

Triton error while running demo code

#11 opened about 1 month ago by

Slower than standard Llama 8b?

#10 opened about 1 month ago by

I found some errors when building on a rpi 5

#9 opened about 1 month ago by

You can try to convert DeepSeek-V2.5 or Llama-3.1-Nemotron-70B-Instruct-HF?

#8 opened about 1 month ago by

Finetuning this model

#7 opened about 2 months ago by

GGUF conversion

#3 opened 2 months ago by