torch.nn.functional

Convolution functions

表1 Convolution functions

序号

API名称

是否支持

1

conv_transpose1d

2

conv_transpose2d

3

conv_transpose3d

4

conv1d

5

conv2d

6

conv3d

7

fold

8

unfold

Pooling functions

表2 Pooling functions

序号

API名称

是否支持

1

adaptive_avg_pool1d

2

adaptive_avg_pool2d

3

adaptive_avg_pool3d

是,仅支持D=1,H=1,W=1场景

4

adaptive_max_pool1d

5

adaptive_max_pool2d

6

adaptive_max_pool3d

7

avg_pool1d

8

avg_pool2d

9

avg_pool3d

10

lp_pool1d

11

lp_pool2d

12

max_pool1d

13

max_pool2d

14

max_pool3d

15

max_unpool1d

16

max_unpool2d

17

max_unpool3d

Non-linear activation functions

表3 Non-linear activation functions

序号

API名称

是否支持

1

celu

2

elu

3

elu_

4

gelu

5

glu

6

gumbel_softmax

7

hardshrink

8

hardtanh

9

hardtanh_

10

leaky_relu

11

leaky_relu_

12

log_softmax

13

logsigmoid

14

prelu

15

relu

16

relu_

17

relu6

18

rrelu

19

rrelu_

20

selu

21

sigmoid

22

softmax

23

softmin

24

softplus

25

softshrink

26

softsign

27

tanh

28

tanhshrink

29

threshold

30

threshold_

Normalization functions

表4 Normalization functions

序号

API名称

是否支持

1

batch_norm

2

instance_norm

3

layer_norm

4

local_response_norm

5

normalize

Linear functions

表5 Linear functions

序号

API名称

是否支持

1

bilinear

2

linear

Dropout functions

表6 Dropout functions

序号

API名称

是否支持

1

alpha_dropout

2

dropout

3

dropout2d

4

dropout3d

Sparse functions

表7 Sparse functions

序号

API名称

是否支持

1

embedding

2

embedding_bag

3

one_hot

Distance functions

表8 Distance functions

序号

API名称

是否支持

1

cosine_similarity

2

pairwise_distance

3

pdist

Loss functions

表9 Loss functions

序号

API名称

是否支持

1

binary_cross_entropy

2

binary_cross_entropy_with_logits

3

cosine_embedding_loss

4

cross_entropy

5

ctc_loss

是,仅支持2维输入

6

hinge_embedding_loss

7

kl_div

8

l1_loss

9

margin_ranking_loss

10

mse_loss

11

multi_margin_loss

12

multilabel_margin_loss

13

multilabel_soft_margin_loss

14

nll_loss

15

poisson_nll_loss

16

smooth_l1_loss

17

soft_margin_loss

18

triplet_margin_loss

Vision functions

表10 Vision functions

序号

API名称

是否支持

1

affine_grid

2

grid_sample

3

interpolate

4

pad

5

pixel_shuffle

6

upsample

7

upsample_bilinear

8

upsample_nearest

DataParallel functions

表11 DataParallel functions

序号

API名称

是否支持

1

torch.nn.parallel.data_parallel