Altas800(9000)运行Modellink的1.0.RC1分支的llama2权重转换脚本出现No module named 'megatron'报错
收藏回复举报
Altas800(9000)运行Modellink的1.0.RC1分支的llama2权重转换脚本出现No module named 'megatron'报错
t('forum.solved') 已解决
发表于2024-10-17 16:36:08
0 查看

一、问题现象(附报错日志上下文):
Traceback (most recent call last):
File "tools/checkpoint/util.py", line 23, in
from ascendspeed import megatron_adaptor
File "/home/ma-user/work/sp/fbig/MindSpeed/ascendspeed/megatron_adaptor.py", line 255, in
exe_adaptation()
File "/home/ma-user/work/sp/fbig/MindSpeed/ascendspeed/megatron_adaptor.py", line 93, in exe_adaptation
import megatron.core.tensor_parallel
ModuleNotFoundError: No module named 'megatron'

二、软件版本:
-- CANN 版本 (e.g., CANN 3.0.x,5.x.x): 8.0.RC1
--Tensorflow/Pytorch/MindSpore 版本:torch=2.1.0
--Python 版本 (e.g., Python 3.7.5):3.8.20
-- MindStudio版本 (e.g., MindStudio 2.0.0 (beta3))
--操作系统版本 (e.g., Ubuntu 18.04):EulerOS 2.0 (SP8)

三、测试步骤:
(1)在权重转换/home/ma-user/work/sp/fbig/ModelLink/tools/checkpoint/util.py脚本中添加路径sys.path.insert(0,"/home/ma-user/work/sp/fbig/ModelLink/megatron")后重新运行,仍旧报错No module named 'megatron'
(2)在python环境中尝试导入,报错:ModuleNotFoundError: No module named 'transformer_engine'
(test) [ma-user ModelLink]$python
Python 3.8.20 (default, Oct 3 2024, 15:18:56)
[GCC 11.2.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.

import megatron.core.tensor_parallel
Zarr-based strategies will not be registered because of missing packages
/home/ma-user/anaconda3/envs/test/lib/python3.8/site-packages/torch_npu/dynamo/init.py:18: UserWarning: Register eager implementation for the 'npu' backend of dynamo, as torch_npu was not compiled with torchair.
warnings.warn(
Traceback (most recent call last):
File "", line 1, in
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/init.py", line 15, in
from .initialize import initialize_megatron
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/initialize.py", line 18, in
from megatron.arguments import parse_args, validate_args
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/arguments.py", line 16, in
from megatron.core.models.retro import RetroConfig
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/core/models/retro/init.py", line 4, in
from .decoder_spec import get_retro_decoder_block_spec
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/core/models/retro/decoder_spec.py", line 5, in
from megatron.core.models.gpt.gpt_layer_specs import (
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/core/models/gpt/init.py", line 1, in
from .gpt_model import GPTModel
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/core/models/gpt/gpt_model.py", line 15, in
from megatron.core.transformer.transformer_block import TransformerBlock
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/core/transformer/transformer_block.py", line 13, in
from megatron.core.transformer.custom_layers.transformer_engine import TENorm
File "/home/ma-user/work/sp/fbig/ModelLink/megatron/core/transformer/custom_layers/transformer_engine.py", line 6, in
import transformer_engine as te
ModuleNotFoundError: No module named 'transformer_engine'

请问还有其他有效解决方法吗

我要发帖子