双机部署deepseek w8a8 671b 报错
收藏回复举报
双机部署deepseek w8a8 671b 报错
t('forum.solved') 已解决
发表于2025-02-26 16:52:03
0 查看

双机部署deepseek w8a8 671b 时报错,显示ConnectionRefusedError: [Errno 111] Connection refused 

部分日志如下:

[2025-02-25 15:54:27.025+0800] [7725] [281473053552992] [mindie-server] [ERROR] [model.py:40] : [Model]    >>> Exception:Error while deserializing header: HeaderTooLarge 

Traceback (most recent call last): 

  File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 38, in initialize 

    return self.python_model.initialize(config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 93, in initialize 

    self.generator = Generator( 

                     ^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py", line 85, in __init__ 

    self.generator_backend = get_generator_backend(model_config) 

                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/__init__.py", line 26, in get_generator_backend 

    return generator_cls(model_config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_torch.py", line 97, in __init__ 

    super().__init__(model_config) 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_backend.py", line 113, in __init__ 

    self.model_wrapper = get_model_wrapper(model_config, backend_type) 

                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 15, in get_model_wrapper 

    return wrapper_cls(**model_config) 

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 52, in __init__ 

    self.model_runner.load_weights() 

  File "/usr/local/Ascend/atb-models/atb_llm/runner/model_runner.py", line 149, in load_weights 

    weights = Weights( 

              ^^^^^^^^ 

  File "/usr/local/Ascend/atb-models/atb_llm/utils/weights.py", line 49, in __init__ 

    routing = self.load_routing(process_group) 

              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

  File "/usr/local/Ascend/atb-models/atb_llm/utils/weights.py", line 77, in load_routing 

    with safe_open(filename, framework="pytorch") as f: 

         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge 

[2025-02-25 15:54:27.025+0800] [7725] [281473053552992] [mindie-server] [ERROR] [model.py:43] : [MIE04E13030A] [Model]    >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}

我要发帖子