LumiOpen
/

Viking-7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jonabur commited on May 16

Commit

efee9d2

•

1 Parent(s): 6e93406

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -109,10 +109,10 @@ Training Checkpoints are available as branches in the repository.  Checkpoints w
 The transformers library allows you to load a checkpoint from a branch as follows:
 ```python
-branch = "200B"
 model = transformers.AutoModelForCausalLM.from_pretrained(
     "LumiOpen/Viking-7B",
-    torch_dtype=torch.bfloat16,
     revision=branch,
 )
 ```

 The transformers library allows you to load a checkpoint from a branch as follows:
 ```python
+branch = "2000B"
 model = transformers.AutoModelForCausalLM.from_pretrained(
     "LumiOpen/Viking-7B",
+    torch_dtype=torch.bfloat16 if torch.cuda.is_bf16_supported() else torch.float16,
     revision=branch,
 )
 ```