runtime error
Exit code: 1. Reason: Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s][A Loading checkpoint shards: 25%|βββ | 1/4 [00:06<00:20, 7.00s/it][A Loading checkpoint shards: 50%|βββββ | 2/4 [00:19<00:19, 9.94s/it][A Loading checkpoint shards: 75%|ββββββββ | 3/4 [00:32<00:11, 11.49s/it][A Loading checkpoint shards: 100%|ββββββββββ| 4/4 [00:35<00:00, 8.08s/it][A Loading checkpoint shards: 100%|ββββββββββ| 4/4 [00:35<00:00, 8.79s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 11, in <module> model = AutoPeftModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/auto.py", line 130, in from_pretrained return cls._target_peft_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 545, in from_pretrained model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1154, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 377, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.13, base_model.model.model.layers.14, base_model.model.model.layers.15, base_model.model.model.layers.16, base_model.model.model.layers.17, base_model.model.model.layers.18, base_model.model.model.layers.19, base_model.model.model.layers.20, base_model.model.model.layers.21, base_model.model.model.layers.22, base_model.model.model.layers.23, base_model.model.model.layers.24, base_model.model.model.layers.25, base_model.model.model.layers.26, base_model.model.model.layers.27, base_model.model.model.layers.28, base_model.model.model.layers.29, base_model.model.model.layers.30, base_model.model.model.layers.31, base_model.model.model.norm, base_model.model.model.rotary_emb, base_model.model.lm_head.
Container logs:
Fetching error logs...