Error "The pointer[origin_node_output_addr] is null" Is Displayed When a Training Job Is Executed Under MindSpore

Symptom

The message "The pointer[origin_node_output_addr] is null." is displayed during building when a model training job under MindSpore is executed.

Figure 1 Compilation error

Cause Analysis

The MindSpore graph fails to be built, possibly due to outdated build data being loaded from the cache after model parameter modifications.

Solution

  • (Recommended) Method 1: Delete the files in the graph build cache path specified by MS_COMPILER_CACHE_PATH.
  • Method 2: Modify the training startup script to disable graph build cache.
    export MS_COMPILER_CACHE_ENABLE=0