下面是问题dui'zhan

[2025-02-06 16:26:02,314] [295] [281464756302176] [llm] [INFO] [dist.py-77] : initialize_distributed has been Set 

2025-02-06 16:26:02,462 [ERROR] model.py:39 - [Model]    >>> Exception:call aclnnInplaceZero failed, detail:EZ9999: Inner Error! 

EZ9999: [PID: 295] 2025-02-06-16:26:02.454.891 Parse dynamic kernel config fail. 

        TraceBack (most recent call last): 

       AclOpKernelInit failed opType 

       ZerosLike ADD_TO_LAUNCHER_LIST_AICORE failed. 

 

[ERROR] 2025-02-06-16:26:02 (PID:295, Device:2, RankID:-1) ERR01100 OPS call acl api failed 

Traceback (most recent call last): 

  File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize 

    return self.python_model.initialize(config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 146, in initialize 

    self.generator = Generator( 

                     ^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py", line 79, in __init__ 

    self.generator_backend = get_generator_backend(model_config) 

                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/__init__.py", line 26, in get_generator_backend 

    return generator_cls(model_config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_torch.py", line 96, in __init__ 

    super().__init__(model_config) 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_backend.py", line 107, in __init__ 

    self.model_wrapper = get_model_wrapper(model_config, backend_type) 

                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 15, in get_model_wrapper 

    return wrapper_cls(**model_config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 46, in __init__ 

    self.model_runner.load_weights() 

  File "/usr/local/Ascend/atb-models/atb_llm/runner/model_runner.py", line 149, in load_weights 

    self.model = self.model_cls(self.config, weights, inference_mode=self.inference_mode, 

                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/Ascend/atb-models/atb_llm/models/llama/flash_causal_llama.py", line 30, in __init__ 

    super().__init__(config, weights, **kwargs) 

  File "/usr/local/Ascend/atb-models/atb_llm/models/base/flash_causal_lm.py", line 98, in __init__ 

    self.placeholder = torch.zeros(1, dtype=self.dtype, device="npu") 

                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

RuntimeError: call aclnnInplaceZero failed, detail:EZ9999: Inner Error! 

EZ9999: [PID: 295] 2025-02-06-16:26:02.454.891 Parse dynamic kernel config fail. 

        TraceBack (most recent call last): 

       AclOpKernelInit failed opType 

       ZerosLike ADD_TO_LAUNCHER_LIST_AICORE failed. 

 

[ERROR] 2025-02-06-16:26:02 (PID:295, Device:2, RankID:-1) ERR01100 OPS call acl api failed