torch.distributed.tensor.parallel

若API“是否支持”“是”“限制与说明”“-”,说明此API和原生API支持度保持一致。

API名称

是否支持

限制与说明

torch.distributed.tensor.parallel.parallelize_module

-

torch.distributed.tensor.parallel.style.RowwiseParallel

-

torch.distributed.tensor.parallel.style.ColwiseParallel

-

torch.distributed.tensor.parallel.style.PairwiseParallel

-

torch.distributed.tensor.parallel.style.SequenceParallel

-

torch.distributed.tensor.parallel.style.make_input_replicate_1d

-

torch.distributed.tensor.parallel.style.make_input_reshard_replicate

-

torch.distributed.tensor.parallel.style.make_input_shard_1d

-

torch.distributed.tensor.parallel.style.make_input_shard_1d_last_dim

-

torch.distributed.tensor.parallel.style.make_output_replicate_1d

-

torch.distributed.tensor.parallel.style.make_output_reshard_tensor

-

torch.distributed.tensor.parallel.style.make_output_shard_1d

-

torch.distributed.tensor.parallel.style.make_output_tensor

-

torch.distributed.tensor.parallel.fsdp.enable_2d_with_fsdp

-

torch.distributed.tensor.parallel.ddp.pre_dp_module_transform

-