ImportError

#26
by kris-123 - opened

Following is the error trying to run zephyr-7b-alpha using HuggingFaceLLM method in llama_index.llms locally:

ImportError: Using load_in_8bit=True requires Accelerate: pip install accelerate and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes or pip install bitsandbytes

Libraries installed already:
transformers - tried both 4.34.1 and 4.35.0.dev0
accelerate - 0.23.0
bistandbytes - 0.41.1

+1, seems that whatever I install in the notebook is not visible from within the huggingface lib that llama index uses

Sign up or log in to comment