cjvt
/

OPT_GaMS-1B-Chat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

dvres commited on Aug 26

Commit

48afb24

•

1 Parent(s): f9e0c0c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -43,7 +43,7 @@ model_id = ("cjvt/OPT_GaMS-1B-Chat")
 pipeline = transformers.pipeline(
         "text-generation",
         model=model_id,
-        device_map="cpu"
     )
 # Example of response generation

 pipeline = transformers.pipeline(
         "text-generation",
         model=model_id,
+        device_map="auto"
     )
 # Example of response generation