欧拉系统 22.03
驱动 23.rc3
cann 7.0.0
torch 和 torch_npu 2.1

报错日志：

11/14/23 21:11:58] INFO colossalai - colossalai - INFO: /home/lclhx/ColossalAI/colossalai/initialize.py:66 launch
INFO colossalai - colossalai - INFO: Distributed environment is initialized, world size: 4
Warning: Device do not support double dtype now, dtype cast repalce with float.
Warning: Device do not support double dtype now, dtype cast repalce with float.
Warning: Device do not support double dtype now, dtype cast repalce with float.
Warning: Device do not support double dtype now, dtype cast repalce with float.
InnerRun:/home/lclhx/pytorch/torch_npu/csrc/framework/OpParamMaker.cpp:203 NPU error, error code is 500001
[Error]: The internal ACL of the system is incorrect.
Rectify the fault based on the error information in the log, or you can ask us at follwing gitee link by issues: https://gitee.com/ascend/pytorch/issue
E90000: Compile operator failed, cause:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.

This probably means that you are not using fork to start your
    child processes and you have forgotten to use the proper idiom
    in the main module:

        if __name__ == '__main__':
            freeze_support()
            ...

    The "freeze_support()" line can be omitted if the program
    is not going to be frozen to produce an executable.   File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/interface.py", line 33, in cann_kb_init
return RouteServer.initialize(**locals())

File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
return func(cls, *args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 166, in initialize
cls.bank_process_pool = ctx.Pool(cann_kb_process_num)
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/context.py", line 119, in Pool
return Pool(processes, initializer, initargs, maxtasksperchild,
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/pool.py", line 212, in init
self._repopulate_pool()
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/pool.py", line 303, in _repopulate_pool
return self._repopulate_pool_static(self._ctx, self.Process,
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/pool.py", line 326, in _repopulate_pool_static
w.start()
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/process.py", line 121, in start
self._popen = self._Popen(self)
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/context.py", line 291, in _Popen
return Popen(process_obj)
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/popen_forkserver.py", line 35, in init
super().init(process_obj)
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/popen_fork.py", line 19, in init
self._launch(process_obj)
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/popen_forkserver.py", line 42, in _launch
prep_data = spawn.get_preparation_data(process_obj._name)
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
_check_not_importing_main()
File "/home/lclhx/miniconda3/envs/npu/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
raise RuntimeError('''

TraceBack (most recent call last):
    [GraphOpt][InitializeInner][InitTbeFunc] Failed to init tbe.[FUNC:InitializeInner][FILE:tbe_op_store_adapter.cc][LINE:1638]
    [SubGraphOpt][PreCompileOp][InitAdapter] InitializeAdapter adapter [tbe_op_adapter] failed! Ret [4294967295][FUNC:InitializeAdapter][FILE:op_store_adapter_manager.cc][LINE:85]
    [SubGraphOpt][PreCompileOp][Init] Initialize op store adapter failed, OpsStoreName[tbe-custom].[FUNC:Initialize][FILE:op_store_adapter_manager.cc][LINE:126]
    [FusionMngr][Init] Op store adapter manager init failed.[FUNC:Initialize][FILE:fusion_manager.cc][LINE:125]
    PluginManager InvokeAll failed.[FUNC:Initialize][FILE:ops_kernel_manager.cc][LINE:104]
    OpsManager initialize failed.[FUNC:InnerInitialize][FILE:gelib.cc][LINE:237]
    GELib::InnerInitialize failed.[FUNC:Initialize][FILE:gelib.cc][LINE:165]
    [Initialize][Ge]GEInitialize failed. ge result = 4294967295[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
    [Init][Compiler]Init compiler failed[FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]
    [Set][Options]OpCompileProcessor init failed![FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]
    [Init][Env]init env failed![FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]
    build op model failed, result = 500001[FUNC:ReportInnerError][FILE:log_inner.cpp][LINE:145]