torch.nn.functional

Convolution functions

表1 Convolution functions

序号

API名称

是否支持

1

conv_transpose1d

2

conv_transpose2d

3

conv_transpose3d

4

conv1d

5

conv2d

6

conv3d

7

fold

8

unfold

Pooling functions

表2 Pooling functions

序号

API名称

是否支持

1

adaptive_avg_pool1d

2

adaptive_avg_pool2d

3

adaptive_avg_pool3d

是,仅支持D=1,H=1,W=1场景

4

adaptive_max_pool1d

5

adaptive_max_pool2d

6

adaptive_max_pool3d

7

avg_pool1d

8

avg_pool2d

9

avg_pool3d

10

lp_pool1d

11

lp_pool2d

12

max_pool1d

13

max_pool2d

14

max_pool3d

15

max_unpool1d

16

max_unpool2d

17

max_unpool3d

Non-linear activation functions

表3 Non-linear activation functions

序号

API名称

是否支持

1

celu

2

elu

3

elu_

4

gelu

5

glu

6

gumbel_softmax

7

hardshrink

8

hardsigmoid

9

hardswish

10

hardtanh

11

hardtanh_

12

leaky_relu

13

leaky_relu_

14

log_softmax

15

logsigmoid

16

prelu

17

relu

18

relu_

19

relu6

20

rrelu

21

rrelu_

22

selu

23

sigmoid

24

silu

25

softmax

26

softmin

27

softplus

28

softshrink

29

softsign

30

tanh

31

tanhshrink

32

threshold

33

threshold_

Normalization functions

表4 Normalization functions

序号

API名称

是否支持

1

batch_norm

2

instance_norm

3

layer_norm

4

local_response_norm

5

normalize

Linear functions

表5 Linear functions

序号

API名称

是否支持

1

bilinear

2

linear

Dropout functions

表6 Dropout functions

序号

API名称

是否支持

1

alpha_dropout

2

dropout

3

dropout2d

4

dropout3d

5

feature_alpha_dropout

Sparse functions

表7 Sparse functions

序号

API名称

是否支持

1

embedding

2

embedding_bag

3

one_hot

Distance functions

表8 Distance functions

序号

API名称

是否支持

1

cosine_similarity

2

pairwise_distance

3

pdist

Loss functions

表9 Loss functions

序号

API名称

是否支持

1

binary_cross_entropy

是,参数y仅支持y=1,y=0

2

binary_cross_entropy_with_logits

3

cosine_embedding_loss

4

cross_entropy

5

ctc_loss

是,仅支持2维输入

6

hinge_embedding_loss

7

kl_div

8

l1_loss

9

margin_ranking_loss

10

mse_loss

11

multi_margin_loss

12

multilabel_margin_loss

13

multilabel_soft_margin_loss

14

nll_loss

15

poisson_nll_loss

16

smooth_l1_loss

17

soft_margin_loss

18

triplet_margin_loss

19

triplet_margin_with_distance_loss

Vision functions

表10 Vision functions

序号

API名称

是否支持

1

affine_grid

2

grid_sample

3

interpolate

4

pad

5

pixel_shuffle

6

pixel_unshuffle

7

upsample

8

upsample_bilinear

9

upsample_nearest

DataParallel functions

表11 DataParallel functions

序号

API名称

是否支持

1

torch.nn.parallel.data_parallel