torch.distributed.pipelining
若API“是否支持”为“是”，“限制与说明”为“-”，说明此API和原生API支持度保持一致。
API名称 |
是否支持 |
限制与说明 |
|---|---|---|
torch.distributed.pipelining.SplitPoint |
是 |
- |
torch.distributed.pipelining.pipeline |
是 |
- |
torch.distributed.pipelining.Pipe |
是 |
- |
torch.distributed.pipelining.pipe_split |
是 |
- |
torch.distributed.pipelining.microbatch.TensorChunkSpec |
是 |
- |
torch.distributed.pipelining.microbatch.split_args_kwargs_into_chunks |
是 |
- |
torch.distributed.pipelining.microbatch.merge_chunks |
是 |
- |
torch.distributed.pipelining.stage.PipelineStage |
是 |
- |
torch.distributed.pipelining.stage.build_stage |
是 |
- |
torch.distributed.pipelining.schedules.ScheduleGPipe |
是 |
- |
torch.distributed.pipelining.schedules.Schedule1F1B |
是 |
- |
torch.distributed.pipelining.schedules.ScheduleInterleaved1F1B |
是 |
- |
torch.distributed.pipelining.schedules.ScheduleLoopedBFS |
是 |
- |
torch.distributed.pipelining.schedules.PipelineScheduleSingle |
是 |
- |
torch.distributed.pipelining.schedules.PipelineScheduleSingle.step |
是 |
- |
torch.distributed.pipelining.schedules.PipelineScheduleMulti |
是 |
- |
torch.distributed.pipelining.schedules.PipelineScheduleMulti.step |
是 |
- |
torch.distributed.pipelining.schedules.ScheduleFlexibleInterleaved1F1B |
是 |
- |
torch.distributed.pipelining.schedules.ScheduleInterleavedZeroBubble |
是 |
- |