Error loading model due to ValueError: 'device_map' had weights offloaded to disk
#18
by
csmith-enpro
- opened
I am on a Amazon Linux 2 EC2 and trying to load the model, I get this error:ValueError: The current device_maphad weights offloaded to the disk. Please provide anoffload_folderfor them. Alternatively, make sure you havesafetensors installed if the model you are using offers the weights in this format.
Any help? Is this a memory issue?