torch.distributed.optim

API名称

是否支持

限制与说明

torch.distributed.optim.DistributedOptimizer

否

  

torch.distributed.optim.DistributedOptimizer.step

否

  

torch.distributed.optim.PostLocalSGDOptimizer

否

  

torch.distributed.optim.PostLocalSGDOptimizer.load_state_dict

否

  

torch.distributed.optim.PostLocalSGDOptimizer.state_dict

否

  

torch.distributed.optim.PostLocalSGDOptimizer.step

否

  

torch.distributed.optim.ZeroRedundancyOptimizer

否

  

torch.distributed.optim.ZeroRedundancyOptimizer.add_param_group

否

  

torch.distributed.optim.ZeroRedundancyOptimizer.consolidate_state_dict

否

  

torch.distributed.optim.ZeroRedundancyOptimizer.join_hook

否

  

torch.distributed.optim.ZeroRedundancyOptimizer.load_state_dict

否

  

torch.distributed.optim.ZeroRedundancyOptimizer.state_dict

否

  

torch.distributed.optim.ZeroRedundancyOptimizer.step

否