xtuner

/

llava-internlm-7b

like 0

Cannot install xtuner[deepspeed] pip install 'xtuner[deepspeed]' because of Pip dependency resolution involving the mpi4py-mpich package. This is on an Ubuntu 20.04 machine

Python 3.11.7 | packaged by conda-forge | (main, Dec 15 2023, 08:38:37) [GCC 12.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.version
'3.11.7 | packaged by conda-forge | (main, Dec 15 2023, 08:38:37) [GCC 12.3.0]'

ERROR: Cannot install xtuner[deepspeed]==0.1.0, xtuner[deepspeed]==0.1.1, xtuner[deepspeed]==0.1.10, xtuner[deepspeed]==0.1.11, xtuner[deepspeed]==0.1.2, xtuner[deepspeed]==0.1.3, xtuner[deepspeed]==0.1.4, xtuner[deepspeed]==0.1.5, xtuner[deepspeed]==0.1.6, xtuner[deepspeed]==0.1.7, xtuner[deepspeed]==0.1.8 and xtuner[deepspeed]==0.1.9 because these package versions have conflicting dependencies.

The conflict is caused by:
    xtuner[deepspeed] 0.1.11 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.10 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.9 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.8 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.7 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.6 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.5 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.4 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.3 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.2 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.1 depends on mpi4py-mpich; extra == "deepspeed"
    xtuner[deepspeed] 0.1.0 depends on mpi4py-mpich; extra == "deepspeed"

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts