I'm having some issues with the DeepSeek-V2-Lite-Chat.Q5_K_M.gguf file.
First of all, thank you for providing such a great resource. However, I'm having some issues with the DeepSeek-V2-Lite-Chat.Q5_K_M.gguf file. The details are as follows:
Problem Description:
When I try to load and use the model, it doesn't work. There are some error messages that indicate that the file may be corrupted or incomplete.
I've checked the download process to make sure the internet connection is stable and the file is complete, but the problem persists. Therefore, we kindly ask for your assistance in confirming if there is a problem with the DeepSeek-V2-Lite-Chat.Q5_K_M.gguf file, or provide any possible solutions.
Seems that the Deepseek V2 support has already updated, but I haven’t noticed it yet.
However now I am dealing with llama.cpp build error and so may not be able to help you now.
You can use this instead: https://huggingface.co/legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF/
Thank you very much for your prompt reply and relevant resources!
First of all, thank you so much for providing such a great resource. I'd appreciate any guidance regarding the issues I'm having with the DeepSeek-V2-Lite-Chat.Q5_K_M.gguf file.
Thank you for notifying me that DeepSeek V2 support has been updated. Although you are currently dealing with a build error with llama.cpp and cannot assist immediately, your reply has been very helpful.
Also, thanks for providing the link to an alternative resource (https://huggingface.co/legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF). I will try to use this file to solve my problem.
Thank you again for your help and support!