FlagAlpha
/

Llama3-Chinese-8B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

wuyongyu commited on Apr 24

Commit

8d84de9

•

1 Parent(s): f6c7fde

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -19,8 +19,8 @@ import torch
 model_id = "FlagAlpha/Llama3-Chinese-8B-Instruct"
 pipeline = transformers.pipeline(
-    "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto"
 )
-pipeline("介绍一下机器学习?")
 ```

 model_id = "FlagAlpha/Llama3-Chinese-8B-Instruct"
 pipeline = transformers.pipeline(
+    "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.float16}, device_map="auto"
 )
+print(pipeline("介绍一下机器学习?"))
 ```