KeyError: 'opt' on calling predictor.predict in Sagemaker
#6
by
waynedsouza
- opened
The range of opt models throw a KeyError 'opt' when calling predictor.predict
Turns out this issue emanates from here https://github.com/huggingface/transformers/blob/main/src/transformers/models/auto/configuration_auto.py#L100
and manifest as,
2022-08-09T03:07:44,087 [INFO ] W-facebook__opt-125m-1-stdout com.amazonaws.ml.mms.wlm.WorkerLifeCycle - File "/opt/conda/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 372, in getitem
2022-08-09T03:07:44,088 [INFO ]
W-facebook__opt-125m-1-stdout com.amazonaws.ml.mms.wlm.WorkerLifeCycle - KeyError: 'opt'
implying an older transformer version being used on sagemaker