服务器使用的Atlas 800 推理服务器（型号：3000），系统是欧拉

使用的这个地址申请的如下的镜像：https://www.hiascend.com/developer/ascendhub/detail/af85b724a7e5469ebd7ea13c3439d48f   1.0.RC2-300I-Duo-arm64

本地模型用的是Qwen-7B-Chat，修改模型的配置文件bfloat 为float, 进入容器的bash docker exec -itu root mindie-dev bash 启动MindIE:./bin/mindieservice_daemon 时候报错：

Traceback (most recent call last): 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/model_wrapper/model.py", line 28, in initialize 

    return self.python_model.initialize(config) 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/model_wrapper/standard_model.py", line 28, in initialize 

    self.generator = Generator( 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 56, in __init__ 

    self.warm_up(max_prefill_tokens, max_seq_len, max_iter_times) 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/mindie_llm/text_generator/generator.py", line 133, in warm_up 

    self.generator_backend.warm_up(model_inputs) 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/mindie_llm/text_generator/adapter/generator_backend.py", line 42, in warm_up 

    _ = self.forward(model_inputs, **kwargs) 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/mindie_llm/text_generator/adapter/generator_torch.py", line 52, in forward 

    logits = self.model_wrapper.forward(model_inputs, self.cache_pool.npu_cache, **kwargs) 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 60, in forward 

    logits = self.forward_tensor( 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 86, in forward_tensor 

    logits = self.model_runner.forward( 

  File "/usr/local/Ascend/llm_model/atb_llm/runner/model_runner.py", line 100, in forward 

    return self.model.forward(**kwargs) 

  File "/usr/local/Ascend/llm_model/atb_llm/models/base/flash_causal_lm.py", line 229, in forward 

    logits = self.execute_ascend_operator(acl_inputs, acl_param, is_prefill) 

  File "/usr/local/Ascend/llm_model/atb_llm/models/base/flash_causal_lm.py", line 200, in execute_ascend_operator 

    acl_model_out = self.acl_encoder_operation.execute(acl_inputs, acl_param) 

RuntimeError: execute失败 详细信息见Ascend官方文档，请开启日志进一步定位问题。 

During handling of the above exception, another exception occurred: 

 

Traceback (most recent call last): 

  File "/usr/local/python3.10.2/lib/python3.10/logging/__init__.py", line 1103, in emit 

    stream.write(msg + self.terminator) 

UnicodeEncodeError: 'ascii' codec can't encode characters in position 75-76: ordinal not in range(128) 

Call stack: 

  File "/usr/local/python3.10.2/lib/python3.10/site-packages/model_wrapper/model.py", line 30, in initialize 

    logger.exception(f"[Model]\t>>> Exception:{e}") 

Message: '[Model]\t>>> Exception:execute失败 详细信息见Ascend官方文档，请开启日志进一步定位问题。\n' 

Arguments: () 

Fatal Python error: PyThreadState_Get: the function must be called with the GIL held, but the GIL is released (the current Python thread state is NULL) 

Python runtime state: finalizing (tstate=0x0000ffffa001d570) 

 

Daemon wait pid with 188883, status 134Daemon is killing... 

Killed 

打开详细日志：

export ASCEND_SLOG_PRINT_TO_STDOUT=1 

export ATB_LOG_TO_STDOUT=1 

export ASDOPS_LOG_TO_STDOUT=1 

export OCK_LOG_TO_STDOUT=1 

export MIES_PYTHON_LOG_TO_STDOUT=1