aclrtLaunchKernel

Applicability

Product

Supported

Atlas 350 Accelerator Card

Atlas A3 training product/Atlas A3 inference product

Atlas A2 training product/Atlas A2 inference product

Atlas 200I/500 A2 inference product

Atlas inference product

Atlas training product

Description

Starts the compute task of the corresponding operator. This API is asynchronous. The operator here is a custom operator developed by using Ascend C.

Prototype

1
aclError aclrtLaunchKernel(aclrtFuncHandle funcHandle, uint32_t numBlocks, const void *argsData, size_t argsSize, aclrtStream stream)

Parameters

Parameter

Input/Output

Description

funcHandle

Input

Kernel function handle. For details about the type definition, see aclrtFuncHandle.

funcHandle obtained by the aclrtBinaryGetFunction call based on kernelName.

numBlocks

Input

Number of cores on which a kernel function will be executed.

argsData

Input

Pointer to the device memory address that stores all input parameters of the kernel function.

For details about the memory allocation API, see Memory Management.

The device that executes the task delivered by this API must be the same as the device that contains the memory used by argsData.

argsSize

Input

Value of argsData, in bytes.

stream

Input

Stream for executing the task. For details about the type definition, see aclrtStream.

Returns

0 on success; otherwise, failure. For details, see aclError.

Reference

All the APIs listed in the following table enable the compute tasks of the corresponding operators. However, their functions and usage modes are different.

API

How Kernel Function Parameter Values Are Passed

Where Kernel Function Parameter Values Are Stored

Configuration Customizable to Deliver

aclrtLaunchKernel

Specify the device memory address pointer for storing all input arguments of the kernel function.

Device memory

No

aclrtLaunchKernelV2

Specify the device memory address pointer for storing all input arguments of the kernel function.

Device memory

Yes

aclrtLaunchKernelWithConfig

Specify the parameter list handle aclrtArgsHandle.

Host memory

Yes

aclrtLaunchKernelWithHostArgs

Specify the host memory address pointer for storing all input arguments of the kernel function.

Host memory

Yes