1、CANN版本8.1.RC1

2、msmodelslim安装步骤：

git clone https://gitee.com/ascend/msit -b modelslim-VLLM-8.1.RC1.b020_001
cd msit/msmodelslim
bash install.sh
pip install accelerate

3、量化命令如下：

colin@colin-P16:~/msit/msmodelslim/example/Qwen$python3.9 quant_qwen.py --model_path /home/colin/Qwen2.5-Coder-14B-Instruct --save_directory /home/colin/Qwen2.5-Coder-14B-Instruct-W8A8 --calib_file ./calib_data/calib_prompt.jsonl --w_bit 8 --a_bit 8 --device_type npu --trust_remote_code True

4、出错信息：

Traceback (most recent call last):

  File "/home/colin/msit/msmodelslim/example/Qwen/quant_qwen.py", line 15, in <module>

    from msmodelslim.pytorch.llm_ptq.anti_outlier import AntiOutlier, AntiOutlierConfig

  File "/home/colin/.local/lib/python3.9/site-packages/msmodelslim/pytorch/llm_ptq/anti_outlier/__init__.py", line 5, in <module>

    from .anti_outlier import AntiOutlier

  File "/home/colin/.local/lib/python3.9/site-packages/msmodelslim/pytorch/llm_ptq/anti_outlier/anti_outlier.py", line 41, in <module>

    from msmodelslim.pytorch.llm_ptq.anti_outlier.anti_utils import (

ModuleNotFoundError: No module named 'msmodelslim.pytorch.llm_ptq.anti_outlier.anti_utils'

安装包里找不到，整个硬盘都找不到这个anti_utils.py。

试过最新的CANN 8.5.0和最新版本的msmodelslim也不行。

卡住很久了，求助。