meta-llama
/

Llama-3.1-405B-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Config KV Heads should be 8 now?

#16

by tanmaylaud - opened Aug 10

Aug 10

https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-FP8/blob/f6b70b010c2a119cdb3401d158f3d1a347118b1d/config.json#L19

ArthurZ

Meta Llama org Aug 14

Yep it should

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment