hugging-quants
/

Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-405B-BNB-NF4-BF16 / generation_config.json

Commit History

Add files using upload-large-folder tool

9b870bd
verified

mdouglas HF staff commited on Sep 16

Upload folder using huggingface_hub

16f4d79
verified

mdouglas HF staff commited on Jul 28