Tuning Workflow

You are advised to perform subgraph tuning and then operator tuning. The reason is that performing subgraph tuning first can generate the graph partition mode. After subgraph tuning is complete, the operators are partitioned into the final shapes. Operator tuning can then be performed based on the final shapes. If operator tuning is performed first, the shapes of the tuned operators are not the final shapes after operator partitioning. This does not meet the actual application scenarios.

Figure 1 shows the tuning procedure. Table 1 describes the detailed operations.

Figure 1 Tuning procedure
Table 1 Tuning procedure description

Operation

Reference

  • Set up the development environment.
  • Set up the operating environment.

Environment Setup

Configure the key certificate.

Configuring the Key Certificate

Start NCS.

NCS Startup

Set environment variables.

Setting Environment Variables

  • Perform subgraph tuning.
  • Performing operator tuning.

Running AOE Tuning