Accelerate uses this configuration file to automatically setup the correct training environment based on your selected training options in accelerate config. | |
accelerate config | |
When you run accelerate config, you'll be prompted with a series of options to configure your training environment. This section covers some of the most important FSDP options. |