aclSetInputTensorAddr

Function Usage

After aclOpExecutor reuse is enabled by the aclSetAclOpExecutorRepeatable call, if the input device memory address changes, the device memory address recorded in the input aclTensor needs to be updated.

Prototype

aclnnStatus aclSetInputTensorAddr(aclOpExecutor *executor, const size_t index, aclTensor *tensor, void *addr)

Parameters

Parameter

Input/Output

Description

executor

Input

aclOpExecutor that is set to the reusable state.

index

Input

Index of the input aclTensor to be updated, starting from 0.

tensor

Input

aclTensor pointer to be updated.

addr

Input

Device storage address to be updated to the specified aclTensor.

Returns

0 on success; else, failure.

Examples

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
// Create the input and output aclTensor and aclTensorList.
std::vector<int64_t> shape = {1, 2, 3};
aclTensor tensor1 = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT,
nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr);
aclTensor tensor2 = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT,
nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr);
aclTensor tensor3 = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT,
nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr);
aclTensor output = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT,
nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr);
aclTensor *list[] = {tensor1, tensor2};
auto tensorList = aclCreateTensorList(list, 2);
uint64_t workspace_size = 0;
aclOpExecutor *executor;
// The AddCustom operator has two inputs (aclTensorList and aclTensor) and one output (aclTensor).
// Call the first-phase API.
aclnnAddCustomGetWorkspaceSize(tensorList, tensor3, output, &workspace_size, &executor);     
// Set the executor to be reusable.
aclSetAclOpExecutorRepeatable(executor);                                                      
void *addr;
aclSetInputTensorAddr(executor, 0, tensor1, addr);   // Update the device address of the first aclTensor in the input tensor list.
aclSetInputTensorAddr(executor, 1, tensor2, addr);  // Update the device address of the second aclTensor in the input tensor list.
aclSetInputTensorAddr(executor, 2, tensor3, addr);  // Update the device address of the input aclTensor.
.......
// Call the second-phase API.
aclnnAddCustom(workspace, workspace_size, executor, stream);          
// Clear the executor.
aclDestroyAclOpExecutor(executor);