torch.nn.functional

Convolution functions

表1 Convolution functions

序号

API名称

是否支持

1

conv1d

2

conv2d

3

conv3d

4

conv_transpose1d

5

conv_transpose2d

6

conv_transpose3d

7

unfold

8

fold

Pooling functions

表2 Pooling functions

序号

API名称

是否支持

1

avg_pool1d

2

avg_pool2d

3

avg_pool3d

4

max_pool1d

5

max_pool2d

6

max_pool3d

7

max_unpool1d

8

max_unpool2d

9

max_unpool3d

10

lp_pool1d

11

lp_pool2d

12

adaptive_max_pool1d

13

adaptive_max_pool2d

14

adaptive_max_pool3d

15

adaptive_avg_pool1d

16

adaptive_avg_pool2d

17

adaptive_avg_pool3d

是,仅支持D=1,H=1,W=1场景

18

fractional_max_pool2d

19

fractional_max_pool3d

Non-linear activation functions

表3 Non-linear activation functions

序号

API名称

是否支持

1

threshold

2

threshold_

3

relu

4

relu_

5

hardtanh

6

hardtanh_

7

hardswish

8

relu6

9

elu

10

elu_

11

selu

12

celu

13

leaky_relu

14

leaky_relu_

15

prelu

16

rrelu

17

rrelu_

18

glu

19

gelu

20

logsigmoid

21

hardshrink

22

tanhshrink

23

softsign

24

softplus

25

softmin

26

softmax

27

softshrink

28

gumbel_softmax

29

log_softmax

30

tanh

31

sigmoid

32

hardsigmoid

33

silu

34

mish

35

batch_norm

36

group_norm

37

instance_norm

38

layer_norm

39

local_response_norm

40

normalize

Linear functions

表4 Linear functions

序号

API名称

是否支持

1

linear

2

bilinear

Dropout functions

表5 Dropout functions

序号

API名称

是否支持

1

dropout

2

alpha_dropout

3

feature_alpha_dropout

4

dropout2d

5

dropout3d

Sparse functions

表6 Sparse functions

序号

API名称

是否支持

1

embedding

2

embedding_bag

3

one_hot

Distance functions

表7 Distance functions

序号

API名称

是否支持

1

pairwise_distance

2

cosine_similarity

3

pdist

Loss functions

表8 Loss functions

序号

API名称

是否支持

1

binary_cross_entropy

是,参数y仅支持y=1,y=0

2

binary_cross_entropy_with_logits

3

poisson_nll_loss

4

cosine_embedding_loss

5

cross_entropy

6

ctc_loss

是,仅支持2维输入

7

gaussian_nll_loss

8

hinge_embedding_loss

9

kl_div

10

l1_loss

11

mse_loss

12

margin_ranking_loss

13

multilabel_margin_loss

14

multilabel_soft_margin_loss

15

multi_margin_loss

16

nll_loss

17

huber_loss

18

smooth_l1_loss

19

soft_margin_loss

20

triplet_margin_loss

21

triplet_margin_with_distance_loss

Vision functions

表9 Vision functions

序号

API名称

是否支持

1

pixel_shuffle

2

pixel_unshuffle

3

pad

4

interpolate

5

upsample

6

upsample_nearest

7

upsample_bilinear

8

grid_sample

9

affine_grid

DataParallel functions

表10 DataParallel functions

序号

API名称

是否支持

1

torch.nn.parallel.data_parallel