Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
raw
history blame contribute delete
191 Bytes
To make a local build for DeepSpeed:
git clone https://github.com/microsoft/DeepSpeed/
cd DeepSpeed
rm -rf build
TORCH_CUDA_ARCH_LIST="8.6" DS_BUILD_CPU_ADAM=1 DS_BUILD_UTILS=1 pip install .