requirements.txt

huggingface_hub==0.24.2
transformers==4.43.1
https://github.com/abetlen/llama-cpp-python/releases/download/v0.2.83-cu124/llama_cpp_python-0.2.83-cp310-cp310-linux_x86_64.whl