--shard_model_dir

Description

Sets the path where each slice model file is stored.

This option applies to scenarios where the original foundation model has been partitioned for the distributed inference environment and the slice models contain communication operators.

See Also

• This option takes effect only after foundation model distributed build is enabled by --distributed_cluster_build and must be used together with --model_relation_config. The relation parameter is used to express the data association and distributed communication group relationships between multiple slice models.
• --cluster_config is required when the model contains communication operators.

Argument

Argument: Path of the slice model file.

Format: The path can contain letters, digits, underscores (_), hyphens (-), and periods (.).

Suggestions and Benefits

None

Example

atc --distributed_cluster_build=1 --cluster_config=../numa_config_4p.json --output=1_increase_4p --framework=1 --log=debug --shard_model_dir=../1_air --model_relation_config=./model_relation_config.json --soc_version=<soc_version> 

Applicability

Atlas Training Series Product

Dependencies and Restrictions

None