torch.nn.functional

Convolution functions

表1 Convolution functions

序号

API名称

是否支持

1

conv_transpose1d

2

conv_transpose2d

3

conv_transpose3d

4

conv1d

5

conv2d

6

conv3d

7

fold

8

unfold

Pooling functions

表2 Pooling functions

序号

API名称

是否支持

1

adaptive_avg_pool1d

2

adaptive_avg_pool2d

3

adaptive_avg_pool3d

是,仅支持D=1,H=1,W=1场景

4

adaptive_max_pool1d

5

adaptive_max_pool2d

6

adaptive_max_pool3d

7

avg_pool1d

8

avg_pool2d

9

avg_pool3d

10

fractional_max_pool2d

11

fractional_max_pool3d

12

lp_pool1d

13

lp_pool2d

14

max_pool1d

15

max_pool2d

16

max_pool3d

17

max_unpool1d

18

max_unpool2d

19

max_unpool3d

Non-linear activation functions

表3 Non-linear activation functions

序号

API名称

是否支持

1

batch_norm

2

celu

3

elu

4

elu_

5

gelu

6

glu

7

group_norm

8

gumbel_softmax

9

hardshrink

10

hardsigmoid

11

hardswish

12

hardtanh

13

hardtanh_

14

instance_norm

15

layer_norm

16

leaky_relu

17

leaky_relu_

18

local_response_norm

19

log_softmax

20

logsigmoid

21

mish

22

normalize

23

prelu

24

relu

25

relu_

26

relu6

27

rrelu

28

rrelu_

29

selu

30

sigmoid

31

silu

32

softmax

33

softmin

34

softplus

35

softshrink

36

softsign

37

tanh

38

tanhshrink

39

threshold

40

threshold_

Linear functions

表4 Linear functions

序号

API名称

是否支持

1

bilinear

2

linear

Dropout functions

表5 Dropout functions

序号

API名称

是否支持

1

alpha_dropout

2

dropout

3

dropout2d

4

dropout3d

5

feature_alpha_dropout

Sparse functions

表6 Sparse functions

序号

API名称

是否支持

1

embedding

2

embedding_bag

3

one_hot

Distance functions

表7 Distance functions

序号

API名称

是否支持

1

cosine_similarity

2

pairwise_distance

3

pdist

Loss functions

表8 Loss functions

序号

API名称

是否支持

1

binary_cross_entropy

是,参数y仅支持y=1,y=0

2

binary_cross_entropy_with_logits

3

cosine_embedding_loss

4

cross_entropy

5

ctc_loss

是,仅支持2维输入

6

gaussian_nll_loss

7

hinge_embedding_loss

8

huber_loss

9

kl_div

10

l1_loss

11

margin_ranking_loss

12

mse_loss

13

multi_margin_loss

14

multilabel_margin_loss

15

multilabel_soft_margin_loss

16

nll_loss

17

poisson_nll_loss

18

smooth_l1_loss

19

soft_margin_loss

20

triplet_margin_loss

21

triplet_margin_with_distance_loss

Vision functions

表9 Vision functions

序号

API名称

是否支持

1

affine_grid

2

grid_sample

3

interpolate

4

pad

5

pixel_shuffle

6

pixel_unshuffle

7

upsample

8

upsample_bilinear

9

upsample_nearest

DataParallel functions

表10 DataParallel functions

序号

API名称

是否支持

1

torch.nn.parallel.data_parallel