bartowski commited on
Commit
cb6f417
1 Parent(s): 0a63312

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +5 -7
README.md CHANGED
@@ -1,17 +1,11 @@
1
  ---
2
  quantized_by: bartowski
3
  pipeline_tag: text-generation
4
- tags:
5
- - language
6
- - granite-3.1
7
- license: apache-2.0
8
- inference: false
9
- base_model: ibm-granite/granite-3.1-8b-instruct
10
  ---
11
 
12
  ## Llamacpp imatrix Quantizations of granite-3.1-8b-instruct
13
 
14
- Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4341">b4341</a> for quantization.
15
 
16
  Original model: https://huggingface.co/ibm-granite/granite-3.1-8b-instruct
17
 
@@ -27,6 +21,10 @@ Run them in [LM Studio](https://lmstudio.ai/)
27
  <|start_of_role|>assistant<|end_of_role|>
28
  ```
29
 
 
 
 
 
30
  ## Download a file (not the whole branch) from below:
31
 
32
  | Filename | Quant type | File Size | Split | Description |
 
1
  ---
2
  quantized_by: bartowski
3
  pipeline_tag: text-generation
 
 
 
 
 
 
4
  ---
5
 
6
  ## Llamacpp imatrix Quantizations of granite-3.1-8b-instruct
7
 
8
+ Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4369">b4369</a> for quantization.
9
 
10
  Original model: https://huggingface.co/ibm-granite/granite-3.1-8b-instruct
11
 
 
21
  <|start_of_role|>assistant<|end_of_role|>
22
  ```
23
 
24
+ ## What's new:
25
+
26
+ Fix tokenizer
27
+
28
  ## Download a file (not the whole branch) from below:
29
 
30
  | Filename | Quant type | File Size | Split | Description |