Text Generation
Transformers
PyTorch
TensorBoard
Safetensors
bloom
Eval Results
text-generation-inference
Inference Endpoints

Infrastructure required to fine tune bloom 176B model on downstream tasks

#196
by rajabmondal7 - opened

How much GPU memory required to fine tune bloom 176B model on downstream tasks ?

How much gpu memory do i need to fine tune Bloom 176B on a100 gpus?

You need at least 3 a100 80gb's

Sign up or log in to comment