Sandiago21
/

llama-13b-hf-prompt-answering

Text Generation

decapoda-research-13b-hf

prompt answering

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Sandiago21 commited on Jun 6, 2023

Commit

0addb44

•

1 Parent(s): 590318d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -101,7 +101,7 @@ from transformers import GenerationConfig, LlamaTokenizer, LlamaForCausalLM
 tokenizer = LlamaTokenizer.from_pretrained("chainyo/alpaca-lora-7b")
 model = LlamaForCausalLM.from_pretrained(
-    "chainyo/alpaca-lora-7b",
     load_in_8bit=True,
     torch_dtype=torch.float16,
     device_map="auto",

 tokenizer = LlamaTokenizer.from_pretrained("chainyo/alpaca-lora-7b")
 model = LlamaForCausalLM.from_pretrained(
+    "Sandiago21/llama-13b-hf-prompt-answering",
     load_in_8bit=True,
     torch_dtype=torch.float16,
     device_map="auto",