mradermacher
/

dolphin-2.9.2-Phi-3-Medium-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

dolphin-2.9.2-Phi-3-Medium-i1-GGUF

1 contributor

History: 18 commits

mradermacher's picture

uploaded from nethype/db2

37186cc verified 28 days ago

.gitattributes

2.65 kB

uploaded from nethype/db2 28 days ago
README.md

256 Bytes

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ1_M.gguf

3.33 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ2_M.gguf

4.78 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ2_XS.gguf

4.2 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ2_XXS.gguf

3.8 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ3_M.gguf

6.3 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ3_XXS.gguf

5.42 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-IQ4_XS.gguf

7.51 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q2_K.gguf

5.2 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q3_K_M.gguf

6.75 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q3_K_S.gguf

6.06 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q4_K_M.gguf

8.4 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q4_K_S.gguf

7.96 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q5_K_S.gguf

9.62 GB
LFS

uploaded from nethype/db2 28 days ago
dolphin-2.9.2-Phi-3-Medium.i1-Q6_K.gguf

11.5 GB
LFS

uploaded from nethype/db2 28 days ago
imatrix.dat

7.79 MB
LFS

uploaded from nethype/db2 28 days ago