Release

Function

Releases the input tensor object memory.

Format

void Release()

Parameters

None

Usage Example

Construct a tensor object whose name is INPUT_IDS, data type is INT64, and data shape is {1, 2}, and then releases the data memory space of the object.

std::string name = "INPUT_IDS";
mindie_llm::InferDataType dataType = mindie_llm::InferDataType::TYPE_INT64;
std::vector<int64_t> dataShape = {1, 2};
auto inputsTensor = std::make_shared<mindie_llm::InferTensor>(name, dataType, dataShape);
inputsTensor->Release();

Return Value

None

Parent topic: InferTensor