Transformers
mpt
Composer
MosaicML
llm-foundry
TheBloke commited on
Commit
d9c62d1
1 Parent(s): 92aa228

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -16,7 +16,7 @@ This is GGML format quantised 4-bit, 5-bit and 8-bit models of [MosaicML's MPT-7
16
 
17
  This repo is the result of converting to GGML and quantising.
18
 
19
- Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Right now they can only be used in a couple of tools. This is bound to improve in the near future.
20
 
21
  ## Repositories available
22
 
@@ -39,8 +39,10 @@ Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Right no
39
  These files are **not** compatible with llama.cpp.
40
 
41
  Currently they can be used with:
42
- * The example `mpt` binary provided with [ggml](https://github.com/ggerganov/ggml)
 
43
  * [rustformers' llm](https://github.com/rustformers/llm)
 
44
 
45
  As other options become available I will endeavour to update them here (do let me know in the Community tab if I've missed something!)
46
 
 
16
 
17
  This repo is the result of converting to GGML and quantising.
18
 
19
+ Please note that these MPT GGMLs are **not compatbile with llama.cpp**. Please see below for a list of tools known to work with these model files.
20
 
21
  ## Repositories available
22
 
 
39
  These files are **not** compatible with llama.cpp.
40
 
41
  Currently they can be used with:
42
+ * The ctransformers Python library: [ctransformers](https://github.com/marella/ctransformers)
43
+ * The GPT4All-UI which uses ctransformers: [GPT4All-UI](https://github.com/nomic-ai/gpt4all-ui)
44
  * [rustformers' llm](https://github.com/rustformers/llm)
45
+ * The example `mpt` binary provided with [ggml](https://github.com/ggerganov/ggml)
46
 
47
  As other options become available I will endeavour to update them here (do let me know in the Community tab if I've missed something!)
48