torch.distributed.fsdp

API名称

是否支持

限制与说明

torch.distributed.fsdp.FullyShardedDataParallel

否

  

torch.distributed.fsdp.FullyShardedDataParallel.apply

否

  

torch.distributed.fsdp.FullyShardedDataParallel.clip_grad_norm_

否

  

torch.distributed.fsdp.FullyShardedDataParallel.forward

否

  

torch.distributed.fsdp.FullyShardedDataParallel.named_buffers

否

  

torch.distributed.fsdp.FullyShardedDataParallel.named_parameters

否

  

torch.distributed.fsdp.FullyShardedDataParallel.no_sync

否

  

torch.distributed.fsdp.FullyShardedDataParallel.register_comm_hook

否

  

torch.distributed.fsdp.BackwardPrefetch

否

  

torch.distributed.fsdp.ShardingStrategy

否

  

torch.distributed.fsdp.MixedPrecision

否

  

torch.distributed.fsdp.CPUOffload

否