mosaicml
/

mosaic-bert-base

Model card Files Files and versions Community

jacobfulano commited on Dec 27, 2023

Commit

3970aa9

•

1 Parent(s): 785d4c8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -53,7 +53,7 @@ config file and reload the model.
 ```python
 config = transformers.BertConfig.from_pretrained('mosaicml/mosaic-bert-base')
-config.alibi_starting_size = 1024 # maximum sequence length updated to 4096
 mosaicbert = AutoModelForMaskedLM.from_pretrained('mosaicml/mosaic-bert-base',config=config,trust_remote_code=True)
 ```

 ```python
 config = transformers.BertConfig.from_pretrained('mosaicml/mosaic-bert-base')
+config.alibi_starting_size = 1024 # maximum sequence length updated to 1024 from config default of 512
 mosaicbert = AutoModelForMaskedLM.from_pretrained('mosaicml/mosaic-bert-base',config=config,trust_remote_code=True)
 ```