Device Management Scenario

Scenario

In this scenario, you already have a Kubernetes cluster and want to use your own scheduler to deploy NPU jobs. In addition, the NPU Device Management feature can be used. You need to deploy the NPU management component of the compute (worker) node on the newly managed NPU server.

List of Components to Be Installed

**Table 1** Components to be installed in the device management scenario
Component	Function
Ascend Docker Runtime	Allows containers to use Ascend NPUs.
Ascend Device Plugin	Supports NPU device management.
(Optional) NPU-Exporter	Supports monitoring of NPU device management status. Install it when you need to use the function.

Component Deployment Modes

For details about the component installation positions, see Component Installation Positions.
Both the Ascend Device Plugin and NPU-Exporter support container deployment and binary deployment. For details about the differences, see Differences Between Container and Binary Deployment.
The NPU-Exporter can provide the HTTP or HTTPS service during startup. For details about the differences between the two services, see Differences Between HTTP and HTTPS.
The Ascend Docker Runtime is installed using the .run package. For details about how to obtain the .run package, see Software Package Description.

Installation Procedure

Obtain the software packages for installing the components. For details, see Software Package Description.
Install the Ascend Docker Runtime. For details, see Installing the Ascend Docker Runtime.
Perform operations based on the component deployment mode.
- If the components are deployed in containers, create images for the components by referring to Creating an Image.
- If the Ascend Device Plugin and NPU-Exporter are deployed using binary files, skip this step.
Create a user on the nodes where the components are deployed. For details, see Creating a User Account.
Create a log directory on the nodes where the components are deployed. For details, see Creating a Log Directory.
(Optional) Import the certificate required by the NPU-Exporter to start the HTTPS service. For details, see Importing a Certificate and KubeConfig File. If the HTTP service is started, skip this step.
(Optional) Import the KubeConfig file used by the Ascend Device Plugin to connect to Kubernetes. For details, see Importing a Certificate and KubeConfig File. If the ServiceAccount is used, skip this step.
Create a namespace in Kubernetes. For details, see Creating a Namespace.
Label the nodes. For details, see Creating a Node Label.
Start each component. For details, see Common Operations.

Parent topic: Typical Installation Scenarios