It is a data class that defines the input and output data structures of model inference.
The tensor class involves resource allocation on the device, which conflicts with the scope of MxDeInit. Therefore, the scope of the tensor class must be smaller than the scope of MxDeInit.
API |
Atlas inference product |
Atlas 800I A2 inference product |
||
|---|---|---|---|---|
BatchConcat |
√ |
√ |
√ |
√ |
Clone |
√ |
√ |
√ |
x |
GetByteSize |
√ |
√ |
√ |
√ |
GetData |
√ |
√ |
√ |
√ |
GetDataType |
√ |
√ |
√ |
√ |
GetDeviceId |
√ |
√ |
√ |
√ |
GetMemoryType |
√ |
√ |
√ |
x |
GetReferRect |
√ |
√ |
√ |
x |
GetShape |
√ |
√ |
√ |
√ |
GetValidRoi |
√ |
√ |
√ |
x |
IsEmpty |
√ |
√ |
√ |
x |
IsWithMargin |
√ |
√ |
√ |
x |
Malloc |
√ |
√ |
√ |
√ |
operator = |
√ |
√ |
√ |
x |
operator == |
√ |
√ |
√ |
x |
SetShape |
√ |
√ |
√ |
x |
Tensor |
√ |
√ |
√ |
√ |
~Tensor |
√ |
√ |
√ |
√ |
TensorFree |
√ |
√ |
√ |
x |
TensorMalloc |
√ |
√ |
√ |
√ |
ToDevice |
√ |
√ |
√ |
√ |
ToDvpp |
√ |
√ |
√ |
x |
ToHost |
√ |
√ |
√ |
√ |
SetReferRect |
x |
√ |
x |
x |
SetTensorValue |
√ |
√ |
√ |
x |
SetValidRoi |
√ |
√ |
√ |
x |
Transpose |
√ |
√ |
√ |
x |