1 contributor

History: 24 commits

bartowski

Upload Llama-3.1-Nemotron-70B-Instruct-HF.imatrix with huggingface_hub

c77d000 verified 24 days ago

Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_L
Upload folder using huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M
Upload folder using huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K
Upload folder using huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0
Upload folder using huggingface_hub 24 days ago
.gitattributes

4.19 kB

Upload Llama-3.1-Nemotron-70B-Instruct-HF.imatrix with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ1_M.gguf

16.8 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ1_M.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_M.gguf

24.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_M.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XS.gguf

21.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XS.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XXS.gguf

19.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XXS.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ3_M.gguf

31.9 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ3_M.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ3_XXS.gguf

27.5 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ3_XXS.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ4_XS.gguf

37.9 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ4_XS.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K.gguf

26.4 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K_L.gguf

27.4 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K_L.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L.gguf

37.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M.gguf

34.3 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S.gguf

30.9 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_XL.gguf

38.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_XL.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0.gguf

40.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_L.gguf

43.3 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_L.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M.gguf

42.5 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S.gguf

40.3 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S.gguf

48.7 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S.gguf with huggingface_hub 24 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.imatrix

24.9 MB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF.imatrix with huggingface_hub 24 days ago