get_tensor_by_name

Function

Obtains a tensor based on the name.

C++ Prototype

Status GetTensorByName(const std::string& tensorName, TensorPtr &tensor)

Python Prototype

get_tensor_by_name(tensor_name, tensor)

Parameters

Parameter	Mandatory/Optional	Description	Value
tensor_name	Mandatory	Tensor name.	Valid string type
tensor	Mandatory	Obtained tensor.	Valid InferTensor class. For details, see InferTensor.

Usage Example

Obtain a tensor from infer_request based on the name.

name = "INPUT_IDS"
shape = np.array([1,1], dtype=np.int64)
runtime_tensor = llm_manager_python.InferTensor(name, shape, llm_manager_python.InferDataType.TYPE_INT64)
status = infer_request.get_tensor_by_name(name, runtime_tensor)

Parent topic: InferRequest