用MindIE部署Qwen2.5-1.5B，报错，请问该查询哪方面原因？
(pytorch_npu_231) HwHiAiUser@user-Default-string:~/Package$ python -m examples.run_fa --model_path /home/HwHiAiUser/opensource/Qwen2.5-1.5B-Instruct --input_text 'What is deep learning?' --max_output_length 20
2025-03-14 09:38:26,765 [INFO] [pid: 4367] logging.py-180: Skip binding cpu.
2025-03-14 09:38:26,993 [INFO] [pid: 4367] logging.py-180: model_runner.quantize: None
, model_runner.kv_quant_type: None
, model_runner.dytpe: torch.float16
2025-03-14 09:38:30,996 [INFO] [pid: 4367] dist.py-79: initialize_distributed has been Set
2025-03-14 09:38:30,997 [INFO] [pid: 4367] logging.py-180: init tokenizer done: Qwen2TokenizerFast(name_or_path='/home/HwHiAiUser/opensource/Qwen2.5-1.5B-Instruct', vocab_size=151643, model_max_length=131072, is_fast=True, padding_side='left', truncation_side='right', special_tokens={'eos_token': '<|im_end|>', 'pad_token': '<|endoftext|>', 'additional_special_tokens': ['<|im_start|>', '<|im_end|>', '<|object_ref_start|>', '<|object_ref_end|>', '<|box_start|>', '<|box_end|>', '<|quad_start|>', '<|quad_end|>', '<|vision_start|>', '<|vision_end|>', '<|vision_pad|>', '<|image_pad|>', '<|video_pad|>']}, clean_up_tokenization_spaces=False), added_tokens_decoder={
151643: AddedToken("<|endoftext|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151644: AddedToken("<|im_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151645: AddedToken("<|im_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151646: AddedToken("<|object_ref_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151647: AddedToken("<|object_ref_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151648: AddedToken("<|box_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151649: AddedToken("<|box_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151650: AddedToken("<|quad_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151651: AddedToken("<|quad_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151652: AddedToken("<|vision_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151653: AddedToken("<|vision_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151654: AddedToken("<|vision_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151655: AddedToken("<|image_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151656: AddedToken("<|video_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151657: AddedToken("<tool_call>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151658: AddedToken("</tool_call>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151659: AddedToken("<|fim_prefix|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151660: AddedToken("<|fim_middle|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151661: AddedToken("<|fim_suffix|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151662: AddedToken("<|fim_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151663: AddedToken("<|repo_name|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151664: AddedToken("<|file_sep|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
}
2025-03-14 09:38:30,999 [WARNING] [pid: 4367] logging.py-180: init model: Qwen2ForCausalLM.__init__() got an unexpected keyword argument 'inference_mode'
2025-03-14 09:38:31,001 [INFO] [pid: 4367] causal_lm.py-51: NPUSocInfo(soc_name='', soc_version=202, need_nz=True, matmul_nd_nz=False)
2025-03-14 09:38:31,025 [INFO] [pid: 4367] causal_qwen2.py-60: >>>> qwen1.5_flash_attention_model is called.
2025-03-14 09:38:37,475 [INFO] [pid: 4367] logging.py-180: model:
Qwen2ForCausalLM(
(rotary_embedding): PositionRotaryEmbedding()
(transformer): FlashQwenModel(
(wte): TensorParallelEmbedding()
(h): ModuleList(
(0-27): 28 x FlashQwenLayer(
(attn): FlashQwenAttention(
(rotary_emb): PositionRotaryEmbedding()
(c_attn): TensorParallelColumnLinear(
(linear): FastLinear()
)
(c_proj): TensorParallelRowLinear(
(linear): FastLinear()
)
)
(mlp): QwenMLP(
(act): SiLU()
(w2_w1): TensorParallelColumnLinear(
(linear): FastLinear()
)
(c_proj): TensorParallelRowLinear(
(linear): FastLinear()
)
)
(ln_1): QwenRMSNorm()
(ln_2): QwenRMSNorm()
)
)
(ln_f): QwenRMSNorm()
)
(lm_head): TensorParallelHead(
(linear): FastLinear()
)
)
2025-03-14 09:38:37,512 [INFO] [pid: 4367] logging.py-180: ---------------begin warm_up---------------
/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:567: UserWarning: `do_sample` is set to `False`. However, `temperature` is set to `0.7` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `temperature`.
warnings.warn(
/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:572: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `0.8` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`.
warnings.warn(
/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:589: UserWarning: `do_sample` is set to `False`. However, `top_k` is set to `20` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_k`.
warnings.warn(
The attention mask is not set and cannot be inferred from input because pad token is same as eos token.As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
2025-03-14 09:38:37,627 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,627 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,627 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,628 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,628 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,628 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,650 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,650 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,652 [INFO] [pid: 4367] logging.py-180: trans to 29
Traceback (most recent call last):
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/HwHiAiUser/Package/examples/run_fa.py", line 329, in <module>
fa_runner.warm_up()
File "/home/HwHiAiUser/Package/examples/run_fa.py", line 162, in warm_up
self.model.generate(inputs=dummy_input_ids_full, do_sample=False, max_new_tokens=10)
File "/home/HwHiAiUser/Package/atb_llm/runner/model_runner.py", line 160, in generate
return self.model.generate(**kwargs)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/utils.py", line 1989, in generate
result = self._sample(
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/utils.py", line 2932, in _sample
outputs = self(**model_inputs, return_dict=True)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
return forward_call(*args, **kwargs)
File "/home/HwHiAiUser/Package/atb_llm/models/base/causal_lm.py", line 297, in forward
self.init_ascend_weight()
File "/home/HwHiAiUser/Package/atb_llm/models/qwen2/causal_qwen2.py", line 123, in init_ascend_weight
self.acl_encoder_operation.set_param(acl_param_encoder)
RuntimeError: BuildModelGraph error,check ATB_LOG, ASDOPS_LOG
[ERROR] 2025-03-14-09:38:42 (PID:4367, Device:0, RankID:-1) ERR99999 UNKNOWN application exception
段错误 (核心已转储)
点赞
收藏
回复
分享
举报
已解决
用MindIE部署Qwen2.5-1.5B，报错，请问该查询哪方面原因？
(pytorch_npu_231) HwHiAiUser@user-Default-string:~/Package$ python -m examples.run_fa --model_path /home/HwHiAiUser/opensource/Qwen2.5-1.5B-Instruct --input_text 'What is deep learning?' --max_output_length 20
2025-03-14 09:38:26,765 [INFO] [pid: 4367] logging.py-180: Skip binding cpu.
2025-03-14 09:38:26,993 [INFO] [pid: 4367] logging.py-180: model_runner.quantize: None
, model_runner.kv_quant_type: None
, model_runner.dytpe: torch.float16
2025-03-14 09:38:30,996 [INFO] [pid: 4367] dist.py-79: initialize_distributed has been Set
2025-03-14 09:38:30,997 [INFO] [pid: 4367] logging.py-180: init tokenizer done: Qwen2TokenizerFast(name_or_path='/home/HwHiAiUser/opensource/Qwen2.5-1.5B-Instruct', vocab_size=151643, model_max_length=131072, is_fast=True, padding_side='left', truncation_side='right', special_tokens={'eos_token': '<|im_end|>', 'pad_token': '<|endoftext|>', 'additional_special_tokens': ['<|im_start|>', '<|im_end|>', '<|object_ref_start|>', '<|object_ref_end|>', '<|box_start|>', '<|box_end|>', '<|quad_start|>', '<|quad_end|>', '<|vision_start|>', '<|vision_end|>', '<|vision_pad|>', '<|image_pad|>', '<|video_pad|>']}, clean_up_tokenization_spaces=False), added_tokens_decoder={
151643: AddedToken("<|endoftext|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151644: AddedToken("<|im_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151645: AddedToken("<|im_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151646: AddedToken("<|object_ref_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151647: AddedToken("<|object_ref_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151648: AddedToken("<|box_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151649: AddedToken("<|box_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151650: AddedToken("<|quad_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151651: AddedToken("<|quad_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151652: AddedToken("<|vision_start|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151653: AddedToken("<|vision_end|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151654: AddedToken("<|vision_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151655: AddedToken("<|image_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151656: AddedToken("<|video_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=True),
151657: AddedToken("<tool_call>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151658: AddedToken("</tool_call>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151659: AddedToken("<|fim_prefix|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151660: AddedToken("<|fim_middle|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151661: AddedToken("<|fim_suffix|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151662: AddedToken("<|fim_pad|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151663: AddedToken("<|repo_name|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
151664: AddedToken("<|file_sep|>", rstrip=False, lstrip=False, single_word=False, normalized=False, special=False),
}
2025-03-14 09:38:30,999 [WARNING] [pid: 4367] logging.py-180: init model: Qwen2ForCausalLM.__init__() got an unexpected keyword argument 'inference_mode'
2025-03-14 09:38:31,001 [INFO] [pid: 4367] causal_lm.py-51: NPUSocInfo(soc_name='', soc_version=202, need_nz=True, matmul_nd_nz=False)
2025-03-14 09:38:31,025 [INFO] [pid: 4367] causal_qwen2.py-60: >>>> qwen1.5_flash_attention_model is called.
2025-03-14 09:38:37,475 [INFO] [pid: 4367] logging.py-180: model:
Qwen2ForCausalLM(
(rotary_embedding): PositionRotaryEmbedding()
(transformer): FlashQwenModel(
(wte): TensorParallelEmbedding()
(h): ModuleList(
(0-27): 28 x FlashQwenLayer(
(attn): FlashQwenAttention(
(rotary_emb): PositionRotaryEmbedding()
(c_attn): TensorParallelColumnLinear(
(linear): FastLinear()
)
(c_proj): TensorParallelRowLinear(
(linear): FastLinear()
)
)
(mlp): QwenMLP(
(act): SiLU()
(w2_w1): TensorParallelColumnLinear(
(linear): FastLinear()
)
(c_proj): TensorParallelRowLinear(
(linear): FastLinear()
)
)
(ln_1): QwenRMSNorm()
(ln_2): QwenRMSNorm()
)
)
(ln_f): QwenRMSNorm()
)
(lm_head): TensorParallelHead(
(linear): FastLinear()
)
)
2025-03-14 09:38:37,512 [INFO] [pid: 4367] logging.py-180: ---------------begin warm_up---------------
/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:567: UserWarning: `do_sample` is set to `False`. However, `temperature` is set to `0.7` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `temperature`.
warnings.warn(
/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:572: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `0.8` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`.
warnings.warn(
/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:589: UserWarning: `do_sample` is set to `False`. However, `top_k` is set to `20` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_k`.
warnings.warn(
The attention mask is not set and cannot be inferred from input because pad token is same as eos token.As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
2025-03-14 09:38:37,627 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,627 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,627 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,628 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,628 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,628 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,629 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,630 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,631 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,632 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,633 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,634 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,635 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,636 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,637 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,638 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,639 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,640 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,641 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,642 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,643 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,644 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,645 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,646 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,647 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,648 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,649 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,650 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,650 [INFO] [pid: 4367] logging.py-180: trans to 29
2025-03-14 09:38:37,652 [INFO] [pid: 4367] logging.py-180: trans to 29
Traceback (most recent call last):
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/HwHiAiUser/Package/examples/run_fa.py", line 329, in <module>
fa_runner.warm_up()
File "/home/HwHiAiUser/Package/examples/run_fa.py", line 162, in warm_up
self.model.generate(inputs=dummy_input_ids_full, do_sample=False, max_new_tokens=10)
File "/home/HwHiAiUser/Package/atb_llm/runner/model_runner.py", line 160, in generate
return self.model.generate(**kwargs)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/utils.py", line 1989, in generate
result = self._sample(
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/transformers/generation/utils.py", line 2932, in _sample
outputs = self(**model_inputs, return_dict=True)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/HwHiAiUser/miniconda3/envs/pytorch_npu_231/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
return forward_call(*args, **kwargs)
File "/home/HwHiAiUser/Package/atb_llm/models/base/causal_lm.py", line 297, in forward
self.init_ascend_weight()
File "/home/HwHiAiUser/Package/atb_llm/models/qwen2/causal_qwen2.py", line 123, in init_ascend_weight
self.acl_encoder_operation.set_param(acl_param_encoder)
RuntimeError: BuildModelGraph error,check ATB_LOG, ASDOPS_LOG
[ERROR] 2025-03-14-09:38:42 (PID:4367, Device:0, RankID:-1) ERR99999 UNKNOWN application exception
段错误 (核心已转储)