aclSetInputTensorAddr
Function Usage
After aclOpExecutor reuse is enabled by the aclSetAclOpExecutorRepeatable call, if the input device memory address changes, the device memory address recorded in the input aclTensor needs to be updated.
Prototype
aclnnStatus aclSetInputTensorAddr(aclOpExecutor *executor, const size_t index, aclTensor *tensor, void *addr)
Parameters
Parameter |
Input/Output |
Description |
|---|---|---|
executor |
Input |
aclOpExecutor that is set to the reusable state. |
index |
Input |
Index of the input aclTensor to be updated, starting from 0. |
tensor |
Input |
aclTensor pointer to be updated. |
addr |
Input |
Device storage address to be updated to the specified aclTensor. |
Returns
0 on success; else, failure.
Examples
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | // Create the input and output aclTensor and aclTensorList. std::vector<int64_t> shape = {1, 2, 3}; aclTensor tensor1 = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT, nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr); aclTensor tensor2 = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT, nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr); aclTensor tensor3 = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT, nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr); aclTensor output = aclCreateTensor(shape.data(), shape.size(), aclDataType::ACL_FLOAT, nullptr, 0, aclFormat::ACL_FORMAT_ND, shape.data(), shape.size(), nullptr); aclTensor *list[] = {tensor1, tensor2}; auto tensorList = aclCreateTensorList(list, 2); uint64_t workspace_size = 0; aclOpExecutor *executor; // The AddCustom operator has two inputs (aclTensorList and aclTensor) and one output (aclTensor). // Call the first-phase API. aclnnAddCustomGetWorkspaceSize(tensorList, tensor3, output, &workspace_size, &executor); // Set the executor to be reusable. aclSetAclOpExecutorRepeatable(executor); void *addr; aclSetInputTensorAddr(executor, 0, tensor1, addr); // Update the device address of the first aclTensor in the input tensor list. aclSetInputTensorAddr(executor, 1, tensor2, addr); // Update the device address of the second aclTensor in the input tensor list. aclSetInputTensorAddr(executor, 2, tensor3, addr); // Update the device address of the input aclTensor. ....... // Call the second-phase API. aclnnAddCustom(workspace, workspace_size, executor, stream); // Clear the executor. aclDestroyAclOpExecutor(executor); |
Parent topic: Basic APIs