nvidia
/

Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (9)

AssertionError: Torch not compiled with CUDA enabled

#35 opened about 9 hours ago by

Upload 4 files

#34 opened about 21 hours ago by

FP8 Quantized model now available! (only requires half the original model's VRAM)

#33 opened 2 days ago by

Reparación de Gadgets

#32 opened 4 days ago by

Update README.md

#31 opened 5 days ago by

Request: DOI

#30 opened 9 days ago by

Journey

#29 opened 9 days ago by

Update README.md

#27 opened 10 days ago by

Is there an AWQ quant version?

#26 opened 10 days ago by

Request: DOI

#25 opened 12 days ago by

Suitable hardware config for usage this model

#22 opened 16 days ago by

Templete Prompt

#20 opened 17 days ago by

Any way I can run it on my low-mid tier HP Desktop? specs attached as a .png, btw i know its probably a long shot.

#18 opened 18 days ago by

How to inference it on a 40 GB A100 and 80 GB Ram of Colab PRO?

#17 opened 18 days ago by

nvdiallm

#16 opened 20 days ago by

Update README.md

#12 opened 21 days ago by

[EVALS] Metrics compared to 3.1-70b Instruct by Meta

#11 opened 22 days ago by

Congrats to the Nvidia team!

#10 opened 22 days ago by

Will quantised version be available?

#9 opened 22 days ago by

Adding Evaluation Results

#8 opened 22 days ago by

leaderboard-pr-bot

the model is not optimize in term of inference

#7 opened 22 days ago by

there are 3 "r"s in the playful "strawrberry"?

#6 opened 23 days ago by

405B version

#5 opened 23 days ago by

Other lanuage ablity

#4 opened 23 days ago by

What's the difference between Instruct-HF vs Instruct?

#2 opened 23 days ago by

Turn inference ON?

#1 opened 23 days ago by