Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Sdff-Ltba
/
LightChatAssistant-TypeB-2x7B-GGUF
like
13
Text Generation
GGUF
TFMC/imatrix-dataset-for-japanese-llm
Japanese
mistral
mixtral
Merge
Mixture of Experts
Not-For-All-Audiences
nsfw
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
main
LightChatAssistant-TypeB-2x7B-GGUF
1 contributor
History:
29 commits
Sdff-Ltba
Update README.md
9f6669f
verified
7 months ago
.gitattributes
Safe
2.88 kB
Upload LightChatAssistant-TypeB-2x7B_q4_k_s_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B.imatrix
Safe
8.4 MB
LFS
Upload LightChatAssistant-TypeB-2x7B.imatrix
7 months ago
LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf
Safe
5.61 GB
LFS
Upload LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_iq3xxs_imatrix.gguf
Safe
4.99 GB
LFS
Upload LightChatAssistant-TypeB-2x7B_iq3xxs_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_iq4xs_imatrix.gguf
Safe
6.9 GB
LFS
Upload LightChatAssistant-TypeB-2x7B_iq4xs_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q4_k_m_imatrix.gguf
Safe
7.78 GB
LFS
Upload LightChatAssistant-TypeB-2x7B_q4_k_m_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q4_k_s_imatrix.gguf
Safe
7.34 GB
LFS
Upload LightChatAssistant-TypeB-2x7B_q4_k_s_imatrix.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q5_k_m.gguf
Safe
9.13 GB
LFS
Rename lca_q5_k_m.gguf to LightChatAssistant-TypeB-2x7B_q5_k_m.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q6_k.gguf
Safe
10.6 GB
LFS
Rename lca_q6_k.gguf to LightChatAssistant-TypeB-2x7B_q6_k.gguf
7 months ago
LightChatAssistant-TypeB-2x7B_q8.gguf
Safe
13.7 GB
LFS
Rename lca_q8.gguf to LightChatAssistant-TypeB-2x7B_q8.gguf
7 months ago
README.md
Safe
2.39 kB
Update README.md
7 months ago