h2oai
/

h2ovl-mississippi-2b

aghorbani commited on 21 days ago

Commit

18fea53

•

1 Parent(s): 01c5310

fix typo re model_path (#3)

- fix typo re model_path (5e63af0bc26c6d651705d2dd85d079baceff9ddb)

Co-authored-by: Asghar Ghorbani <aghorbani@users.noreply.huggingface.co>

Files changed (1) hide show

README.md CHANGED Viewed

@@ -55,7 +55,7 @@ model = AutoModel.from_pretrained(
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
     trust_remote_code=True).eval().cuda()
-tokenizer = AutoTokenizer.from_pretrained(path, trust_remote_code=True, use_fast=False)
 generation_config = dict(max_new_tokens=1024, do_sample=True)

     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
     trust_remote_code=True).eval().cuda()
+tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True, use_fast=False)
 generation_config = dict(max_new_tokens=1024, do_sample=True)