RuntimeError: Error opening /Phi-3-mini-4k-instruct-onnx/cpu_and_mobile/genai_config.json
#14
by
davesoma
- opened
RuntimeError: Error opening /Phi-3-mini-4k-instruct-onnx/cpu_and_mobile/genai_config.json
Any idea on what is wrong with genai_config.json?
Within the cpu_and_mobile folder for the Phi-3 mini 4K ONNX repo, there are two options to choose from: cpu-int4-rtn-block-32 and cpu-int4-rtn-block-32-acc-level-4. You can pick one of those two options. As you can see here, the /Phi-3-mini-4k-instruct-onnx/cpu_and_mobile/genai_config.json file path does not exist.
kvaishnavi
changed discussion status to
closed