Commit
•
eb06cc5
1
Parent(s):
7c38986
Added demo using exllama and colab
Browse files
README.md
CHANGED
|
@@ -174,6 +174,9 @@ Please see the Responsible Use Guide available at https://ai.meta.com/llama/resp
|
|
| 174 |
```
|
| 175 |
|
| 176 |
# Demo script
|
|
|
|
|
|
|
|
|
|
| 177 |
## How to use this GPTQ model from Python code
|
| 178 |
|
| 179 |
First make sure you have [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) installed:
|
|
|
|
| 174 |
```
|
| 175 |
|
| 176 |
# Demo script
|
| 177 |
+
|
| 178 |
+
[Google Colab ExLlama implementation](https://colab.research.google.com/drive/1mbwWNt5IpGxYG9mXE1kOcROlrnvxhuRo?usp=sharing)
|
| 179 |
+
|
| 180 |
## How to use this GPTQ model from Python code
|
| 181 |
|
| 182 |
First make sure you have [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) installed:
|