Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
abhi-mosaic ybelkada commited on
Commit
27ef178
1 Parent(s): 665b290

Update modeling_mpt.py (#40)

Browse files

- Update modeling_mpt.py (8cb832182c6514e485a7a6fd8e426f1c659a165b)


Co-authored-by: Younes Belkada <ybelkada@users.noreply.huggingface.co>

Files changed (1) hide show
  1. modeling_mpt.py +1 -0
modeling_mpt.py CHANGED
@@ -23,6 +23,7 @@ Tokenizer = Union[PreTrainedTokenizer, PreTrainedTokenizerFast]
23
  class MPTPreTrainedModel(PreTrainedModel):
24
  config_class = MPTConfig
25
  base_model_prefix = 'model'
 
26
 
27
  class MPTModel(MPTPreTrainedModel):
28
 
 
23
  class MPTPreTrainedModel(PreTrainedModel):
24
  config_class = MPTConfig
25
  base_model_prefix = 'model'
26
+ _no_split_modules = ["MPTBlock"]
27
 
28
  class MPTModel(MPTPreTrainedModel):
29