--oo_level
Description
Extended parameter for debugging. It cannot be used in commercial products and will be released as a formal function in later versions.
Multi-level optimization options for graph build include subgraph optimization, full graph optimization, and static shape model sinking.
Static shape model sinking: In this approach, the input and output shapes of all operators in a static shape model can be determined at build time, allowing for model-level memory orchestration and operator tiling computation to be completed on the host. These computations are then batched and sent to the device stream when the model is loaded, but they are not executed immediately. Instead, the execution of all tasks within the model is triggered by deliver model execution tasks.
See Also
None
Argument
- O1: Performs only optimizations related to static sinking, such as InferShape (output tensor shape inference), constant folding, dead-edge elimination, and other optimizations.
- O3 (default): Enables all optimizations.
Suggestions and Benefits
None
Example
--oo_level=O1
Applicability
Restrictions
None