Edit model card

Mistral Nemo is a 12-billion-parameter model, designed to handle instructive tasks and general conversational use. It can be further customized for specific applications through fine-tuning or prompt engineering

This repo includes two different quantizaion sizes of mistral nemo gguf models, which are very applicable for deploying and using in PCs, laptops or mobiles.

If you are a Mac user, the following free wonderful AI tools can help you to read and understand PDFs effectively:

  • If you are using Zotero for managing and reading your personal PDFs, PapersGPT is a free plugin which can assist you to chat PDFs effectively by your local mistral.

  • you can directly download the beautiful ChatPDFLocal MacOS app from here, load one or batch PDF files at will, and quickly experience the effect of the model through chat reading. PS. Click here to subscribe and you can use ChatPDFLocal for free.

Downloads last month
55
GGUF
Model size
12.2B params
Architecture
llama

4-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .