What's New in 7.0.RC3

Analysis and Migration

The migration tool can generate an affinity API analysis report.

msModelSlim

• The foundation model quantization supports the W8A8 per-token quantization scenario of MOE models.
• The foundation model quantization supports the W8A16 quantization scenario of the MOE model weight.
• Foundation model quantization supports the communication int8 quantization scenario.
• Per-group quantization is supported for W4A16 weight quantization GPTQ and HQQ.
• The foundation model quantization W8A16 supports the per-group quantization scenario.
• Long-sequence compression of foundation models is supported.

Performance Tuning Tool

• The online version lightweight dotting is supported in the PyTorch scenario.

• Non-intrusive profiling is supported in the PyTorch scenario.
• GC identification is supported in the PyTorch scenario.
• Dynamic profiling is supported in the MindSpore scenario.
• The call stack flame graph can be displayed in the MindSpore scenario.
• MSPTI computing task performance APIs are supported.

Operator Development Tools

• The msProf tool supports the inter-core load analysis diagram and roofline model diagram.
• The msProf tool supports segment-based collection through the mstx API.
• The msSanitizer tool supports the detection of uninitialized variables.
• The msSanitizer tool supports synchronization detection in the pipeline.

MindStudio Insight

• Data can be imported by dragging files.
• The timeline area can be selected.
• Comparison and analysis can be performed based on the hierarchical structure of the parallelism strategy.
• The Timeline, Memory, and Operator tab pages can be compared, and operator tuning profile data can be compared.
• Tiling load balancing analysis is supported.
• Operators can be used for the roofline analysis of loads.

Common Capability

The tools are adapted to the Atlas 200T A2 Box16 heterogeneous subrack, Atlas 800T A2 training server, Atlas 900 A2 PoD cluster basic unit, and Atlas 300I A2.

Analysis and Migration

The X2MindSpore tool is no longer released. For details, see MSAdapter.

Advisor

The Advisor tool is no longer released. It is recommended that MindStudio Insight integrate the Advisor tool. For details, see MindStudio Insight User Guide.

MindStudio IDE User Guide

MindStudio IDE User Guide, MindStudio Independent Installation Guide, and MindStudio Plugin Installation Guide are no longer released. In the future, the optimization page visualization is integrated by MindStudio Insight User Guide. Move to MindStudio Insight User Guide. Move the rest to Operator Tools Training and Inference Development Tools.

MindStudio Independent Installation Guide

MindStudio Plugin Installation Guide