NeuML
/

Llama-3.1_OpenScholar-8B-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

davidmezzetti commited on 3 days ago

Commit

979b997

•

1 Parent(s): ef5845c

Update README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ tags:
 This is [Llama-3.1_OpenScholar-8B](https://huggingface.co/OpenScholar/Llama-3.1_OpenScholar-8B) with AWQ Quantization applied using the following code.
-_Based on this [example code](https://github.com/casper-hansen/AutoAWQ/blob/main/examples/quantize.py)_
 ```python
 import torch

 This is [Llama-3.1_OpenScholar-8B](https://huggingface.co/OpenScholar/Llama-3.1_OpenScholar-8B) with AWQ Quantization applied using the following code.
+_Based on this [example code](https://github.com/casper-hansen/AutoAWQ/blob/main/examples/quantize.py)._
 ```python
 import torch