TensorPlacement
enum TensorPlacement {
kOnDeviceHbm, ///< The tensor is located on the device.
kOnHost, ///< The tensor is located on the host.
kFollowing, ///< The tensor is located on the host, and the data follows the structure.
kOnDeviceP2p, ///< The tensor is located on the device. The P2P memory refers to the address space that is mapped from the device memory to the PCIe BAR space so that the NPU can access the address space across PCIe.
kTensorPlacementEnd
};
Parent topic: gert Namespace