torch.distributed.optim

若API未标明支持情况则代表该API暂无验证结果,待验证后更新表格。

API名称

是否支持

限制与说明

torch.distributed.optim.DistributedOptimizer

     

torch.distributed.optim.DistributedOptimizer.step

     

torch.distributed.optim.PostLocalSGDOptimizer

     

torch.distributed.optim.PostLocalSGDOptimizer.step

     

torch.distributed.optim.ZeroRedundancyOptimizer

     

torch.distributed.optim.ZeroRedundancyOptimizer.add_param_group

     

torch.distributed.optim.ZeroRedundancyOptimizer.consolidate_state_dict

     

torch.distributed.optim.ZeroRedundancyOptimizer.join_hook

     

torch.distributed.optim.ZeroRedundancyOptimizer.load_state_dict

     

torch.distributed.optim.ZeroRedundancyOptimizer.state_dict

     

torch.distributed.optim.ZeroRedundancyOptimizer.step