Sdff-Ltba
/

LightChatAssistant-TypeB-2x7B-GGUF

Text Generation

Mixture of Experts

Not-For-All-Audiences

nsfw

Inference Endpoints

Model card Files Files and versions Community

LightChatAssistant-TypeB-2x7B-GGUF

1 contributor

History: 26 commits

Sdff-Ltba's picture

Upload LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf

b5f53cc verified 7 months ago

.gitattributes

2.88 kB

Upload LightChatAssistant-TypeB-2x7B_q4_k_s_imatrix.gguf 7 months ago
LightChatAssistant-TypeB-2x7B.imatrix

8.4 MB
LFS

Upload LightChatAssistant-TypeB-2x7B.imatrix 7 months ago
LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf

5.61 GB
LFS

Upload LightChatAssistant-TypeB-2x7B_iq3s_imatrix.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_iq3xxs_imatrix.gguf

4.99 GB
LFS

Upload LightChatAssistant-TypeB-2x7B_iq3xxs_imatrix.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_iq4xs_imatrix.gguf

6.9 GB
LFS

Upload LightChatAssistant-TypeB-2x7B_iq4xs_imatrix.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_q4_k_m_imatrix.gguf

7.78 GB
LFS

Upload LightChatAssistant-TypeB-2x7B_q4_k_m_imatrix.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_q4_k_s_imatrix.gguf

7.34 GB
LFS

Upload LightChatAssistant-TypeB-2x7B_q4_k_s_imatrix.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_q5_k_m.gguf

9.13 GB
LFS

Rename lca_q5_k_m.gguf to LightChatAssistant-TypeB-2x7B_q5_k_m.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_q6_k.gguf

10.6 GB
LFS

Rename lca_q6_k.gguf to LightChatAssistant-TypeB-2x7B_q6_k.gguf 7 months ago
LightChatAssistant-TypeB-2x7B_q8.gguf

13.7 GB
LFS

Rename lca_q8.gguf to LightChatAssistant-TypeB-2x7B_q8.gguf 7 months ago
README.md

1.76 kB

Update README.md 7 months ago