Adding model_type gpt_neo to config.json
Browse filesWithout explicit model_type key in config.json, model prediction is failing for Sagemaker HuggingFaceModel api.
Error received while predicting
"""
ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (400) from primary with message "{
"code": 400,
"type": "InternalServerException",
"message": "Unrecognized model in /.sagemaker/mms/models/stabilityai__japanese-stablelm-base-alpha-7b.
Should have a `model_type` key in its config.json,
or contain one of the following strings in its name: vision-encoder-decoder, trocr, fnet, segformer, gptj, layoutlmv2, beit, rembert, visual_bert, canine, roformer, clip, bigbird_pegasus, deit, luke, detr, gpt_neo, big_bird, speech_to_text_2, speech_to_text, vit, wav2vec2, m2m_100, convbert, led, blenderbot-small, retribert, ibert, mt5, t5, mobilebert, distilbert, albert, bert-generation, camembert, xlm-roberta, pegasus, marian, mbart, megatron-bert, mpnet, bart, blenderbot, reformer, longformer, roberta, deberta-v2, deberta, flaubert, fsmt, squeezebert, hubert, bert, openai-gpt, gpt2, transfo-xl, xlnet, xlm-prophetnet, prophetnet, xlm, ctrl, electra, speech-encoder-decoder, encoder-decoder, funnel, lxmert, dpr, layoutlm, rag, tapas, splinter, sew-d, sew, unispeech-sat, unispeech"
}
"""
- config.json +2 -1
@@ -26,5 +26,6 @@
|
|
26 |
"use_bias_in_mlp": false,
|
27 |
"use_cache": true,
|
28 |
"use_parallel_residual": true,
|
29 |
-
"vocab_size": 65536
|
|
|
30 |
}
|
|
|
26 |
"use_bias_in_mlp": false,
|
27 |
"use_cache": true,
|
28 |
"use_parallel_residual": true,
|
29 |
+
"vocab_size": 65536,
|
30 |
+
"model_type" : "gpt_neo"
|
31 |
}
|