Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Sdff-Ltba
/
LightChatAssistant-TypeB-2x7B-GGUF
like
13
Text Generation
GGUF
TFMC/imatrix-dataset-for-japanese-llm
Japanese
mistral
mixtral
Merge
Mixture of Experts
Not-For-All-Audiences
nsfw
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
19922df
LightChatAssistant-TypeB-2x7B-GGUF
1 contributor
History:
15 commits
Sdff-Ltba
Upload lca.imatrix
19922df
verified
7 months ago
.gitattributes
2.64 kB
Upload lca.imatrix
7 months ago
LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf
5.61 GB
LFS
Rename lca_iq3s_imatrix.gguf to LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_iq3xxs_imatrix.gguf
4.99 GB
LFS
Rename lca_iq3xxs_imatrix.gguf to LightChatAssistant-TypeB-2x7B_iq3xxs_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_iq4xs_imatrix.gguf
6.9 GB
LFS
Rename lca_iq4xs_imatrix.gguf to LightChatAssistant-TypeB-2x7B_iq4xs_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q4_k_m.gguf
7.78 GB
LFS
Rename lca_q4_k_m.gguf to LightChatAssistant-TypeB-2x7B_q4_k_m.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q4_k_s.gguf
7.34 GB
LFS
Rename lca_q4_k_s.gguf to LightChatAssistant-TypeB-2x7B_q4_k_s.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q5_k_m.gguf
9.13 GB
LFS
Rename lca_q5_k_m.gguf to LightChatAssistant-TypeB-2x7B_q5_k_m.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q6_k.gguf
10.6 GB
LFS
Rename lca_q6_k.gguf to LightChatAssistant-TypeB-2x7B_q6_k.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q8.gguf
13.7 GB
LFS
Rename lca_q8.gguf to LightChatAssistant-TypeB-2x7B_q8.gguf
7 months ago
README.md
1.75 kB
Update README.md
7 months ago
lca.imatrix
8.4 MB
LFS
Upload lca.imatrix
7 months ago