DeepSeek-V3-0324在权重W8A8量化时报错
收藏回复举报
DeepSeek-V3-0324在权重W8A8量化时报错
t('forum.solved') 已解决
发表于2025-03-29 22:49:15
0 查看

cke_193.png

 

AntiOutlier Process:   0%|                                                                                                                                                               | 0/244 [00:00<?, ?it/s] 

Traceback (most recent call last):                                                                                                                                                       | 0/244 [00:00<?, ?it/s] 

  File "/root/anaconda3/envs/DeepSeek-V3-0324/lib/python3.9/site-packages/msmodelslim/pytorch/llm_ptq/anti_outlier/anti_outlier.py", line 501, in process 

    self._process() 

  File "/root/anaconda3/envs/DeepSeek-V3-0324/lib/python3.9/site-packages/msmodelslim/pytorch/llm_ptq/anti_outlier/anti_outlier.py", line 666, in _process 

    iter_smooth( 

  File "/root/anaconda3/envs/DeepSeek-V3-0324/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context 

    return func(*args, **kwargs) 

  File "anti_utils.py", line 36, in anti_utils.iter_smooth 

TypeError: iter_smooth() got an unexpected keyword argument 'is_shift' 

 

The above exception was the direct cause of the following exception: 

 

Traceback (most recent call last): 

  File "/data/msit/msmodelslim/example/DeepSeek/quant_deepseek_w8a8.py", line 139, in <module> 

    anti_outlier.process() 

  File "/root/anaconda3/envs/DeepSeek-V3-0324/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context 

    return func(*args, **kwargs) 

  File "/root/anaconda3/envs/DeepSeek-V3-0324/lib/python3.9/site-packages/msmodelslim/pytorch/llm_ptq/anti_outlier/anti_outlier.py", line 503, in process 

    raise Exception("Please check your config, model and input!", e) from e 

Exception: ('Please check your config, model and input!', TypeError("iter_smooth() got an unexpected keyword argument 'is_shift'")) 

[ERROR] 2025-03-29-14:31:39 (PID:378208, Device:0, RankID:-1) ERR99999 UNKNOWN applicaiton exception 

本帖最后由 匿名用户2025/10/14 19:40:57 编辑

我要发帖子