Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ This is GGML format quantised 4-bit, 5-bit and 8-bit models of [MosaicML's MPT-7
|
|
16 |
|
17 |
This repo is the result of converting to GGML and quantising.
|
18 |
|
19 |
-
Please note that these MPT GGMLs are **not compatbile with llama.cpp**.
|
20 |
|
21 |
## Repositories available
|
22 |
|
@@ -39,8 +39,10 @@ Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Right no
|
|
39 |
These files are **not** compatible with llama.cpp.
|
40 |
|
41 |
Currently they can be used with:
|
42 |
-
* The
|
|
|
43 |
* [rustformers' llm](https://github.com/rustformers/llm)
|
|
|
44 |
|
45 |
As other options become available I will endeavour to update them here (do let me know in the Community tab if I've missed something!)
|
46 |
|
|
|
16 |
|
17 |
This repo is the result of converting to GGML and quantising.
|
18 |
|
19 |
+
Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Please see below for a list of tools known to work with these model files.
|
20 |
|
21 |
## Repositories available
|
22 |
|
|
|
39 |
These files are **not** compatible with llama.cpp.
|
40 |
|
41 |
Currently they can be used with:
|
42 |
+
* The ctransformers Python library: [ctransformers](https://github.com/marella/ctransformers)
|
43 |
+
* The GPT4All-UI which uses ctransformers: [GPT4All-UI](https://github.com/nomic-ai/gpt4all-ui)
|
44 |
* [rustformers' llm](https://github.com/rustformers/llm)
|
45 |
+
* The example `mpt` binary provided with [ggml](https://github.com/ggerganov/ggml)
|
46 |
|
47 |
As other options become available I will endeavour to update them here (do let me know in the Community tab if I've missed something!)
|
48 |
|