Can you please post your computed imatrices to your repo?

#2
by Joseph717171 - opened

I love you the work that you guys are doing. Is it possible for you to post your computed imatrices (for GGUF) to your repo? I know the whole of the community would really appreciate it. A lot of us love to quantize, but the time and computation requirements to compute the imatrix for each individual llm using wiki-text-raw, etc makes it difficult for people without the computational resources to compute them - a lot of us just reverting to standard quantizations because of this. It would be amazing if you guys created and hosted a IMatrices repo. That way others can benefit and make use of your work and your computed imatrices. Thanks for your time and consideration. 😁

Joseph717171 changed discussion title from Can you please post your imatrices to your repo? to Can you please post your computed imatrices to your repo?

Sign up or log in to comment