Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
NeuralsirkrishnaShadow-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
33be248
NeuralsirkrishnaShadow-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
cf655779796743f10105ef3fc993390dcc7f2d8d5cff6393935f6ab758e19c53
33be248
verified
7 months ago
.gitattributes
2.26 kB
cf655779796743f10105ef3fc993390dcc7f2d8d5cff6393935f6ab758e19c53
7 months ago
NeuralsirkrishnaShadow-7B.IQ3_XS.gguf
3.02 GB
LFS
df74e222300baf4a8db848515e7709080040a5a592b455970b57d9c28f3a0c1e
7 months ago
NeuralsirkrishnaShadow-7B.IQ4_XS.gguf
3.94 GB
LFS
42f68adb44848e5c6868e0a5cbb9d5b56059864ad077aebd9ea66462f3788de2
7 months ago
NeuralsirkrishnaShadow-7B.Q2_K.gguf
2.72 GB
LFS
4f76c7977261bea934e2a2984e2feef45052cb87433e6775bdbfd8ebfd1cb158
7 months ago
NeuralsirkrishnaShadow-7B.Q3_K_L.gguf
3.82 GB
LFS
4859f3c925d1bf0371cd0a5d7beeb0c4d61f63b699fd25be894d3e8313018863
7 months ago
NeuralsirkrishnaShadow-7B.Q3_K_M.gguf
3.52 GB
LFS
e14015e20824d4b1907b65e5c440e0ca96dba2573a0b37088db2cc3e5d9c6768
7 months ago
NeuralsirkrishnaShadow-7B.Q3_K_S.gguf
3.16 GB
LFS
cd01b2b2e2bc78e62923606844fa702a25324a29e680547024e6fb5bcc1aeb86
7 months ago
NeuralsirkrishnaShadow-7B.Q4_K_M.gguf
4.37 GB
LFS
20a1bedb0631750b738d764396a35781ff95a1f0bf41649f11deab26edae8007
7 months ago
NeuralsirkrishnaShadow-7B.Q4_K_S.gguf
4.14 GB
LFS
17645977f9ae8d48a8d41cb2c84f04df927a0044e54c8c603b2b96dc18125f9f
7 months ago
NeuralsirkrishnaShadow-7B.Q5_K_M.gguf
5.13 GB
LFS
abe506ed17cb1b017bf7cdba77ba2df7111f9e76a95fd6ca438de9d78016d7db
7 months ago
NeuralsirkrishnaShadow-7B.Q5_K_S.gguf
5 GB
LFS
cf655779796743f10105ef3fc993390dcc7f2d8d5cff6393935f6ab758e19c53
7 months ago