torch.distributed.tensor.parallel
若API“是否支持”为“是”，“限制与说明”为“-”，说明此API和原生API支持度保持一致。
API名称 |
是否支持 |
限制与说明 |
|---|---|---|
torch.distributed.tensor.parallel.parallelize_module |
是 |
- |
torch.distributed.tensor.parallel.style.RowwiseParallel |
是 |
- |
torch.distributed.tensor.parallel.style.ColwiseParallel |
是 |
- |
torch.distributed.tensor.parallel.style.PairwiseParallel |
是 |
- |
torch.distributed.tensor.parallel.style.SequenceParallel |
是 |
- |
torch.distributed.tensor.parallel.style.make_input_replicate_1d |
是 |
- |
torch.distributed.tensor.parallel.style.make_input_reshard_replicate |
是 |
- |
torch.distributed.tensor.parallel.style.make_input_shard_1d |
是 |
- |
torch.distributed.tensor.parallel.style.make_input_shard_1d_last_dim |
否 |
- |
torch.distributed.tensor.parallel.style.make_output_replicate_1d |
是 |
- |
torch.distributed.tensor.parallel.style.make_output_reshard_tensor |
是 |
- |
torch.distributed.tensor.parallel.style.make_output_shard_1d |
是 |
- |
torch.distributed.tensor.parallel.style.make_output_tensor |
是 |
- |
torch.distributed.tensor.parallel.fsdp.enable_2d_with_fsdp |
是 |
- |
torch.distributed.tensor.parallel.ddp.pre_dp_module_transform |
是 |
- |