Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
raw
history blame
146 Bytes
Optimizer and scheduler
DeepSpeed and Transformers optimizer and scheduler can be mixed and matched as long as you don't enable offload_optimizer.