--enable_graph_parallel

Description

Automatically partitions an original foundation model.

See Also

• The automatic partitioning function can be enabled only after foundation model distributed build is enabled by --distributed_cluster_build. Then, the original foundation model can be automatically partitioned based on the requirements in the --graph_parallel_option_path file.
• --cluster_config is required in the algorithm-based partitioning scenario.

Argument

• 1: Enables automatic partitioning.
• 0 (default): Disables automatic partitioning.

Suggestions and Benefits

None

Example

atc --distributed_cluster_build=1 --cluster_config=./numa_config_2p.json --model=./matmul2.pb --enable_graph_parallel="1" --graph_parallel_option_path=./parallel_option.json --soc_version=<soc_version>  --output=test_parallel --framework=3 --log=debug

Applicability

Atlas Training Series Product

Dependencies and Restrictions

None