使用Ascend 910 ModelArts执行ModelZoo社区的Llama 13B大模型的参数微调时出现错误。
收藏回复举报
使用Ascend 910 ModelArts执行ModelZoo社区的Llama 13B大模型的参数微调时出现错误。
t('forum.solved') 已解决
新人帖
发表于2024-01-25 14:59:12
0 查看

错误日志的核心内容如下。

Traceback (most recent call last):
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpr6g72pedwandb'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp5d19eie3wandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpo3axge05wandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpu3q31cx8wandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
Traceback (most recent call last):
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpo2ewq4e7wandb'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpqz8j0sywwandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpytecff_zwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp7np3htbhwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
Traceback (most recent call last):
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)
Traceback (most recent call last):
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpwvibbt_jwandb'>
  _warnings.warn(warn_message, ResourceWarning)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpcvrcy7rgwandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpm9yndpimwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp_g6x_nt2wandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpc_51cjgtwandb'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmprsw0xuq_wandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmph7jdlys1wandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp_1qpmb1jwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
Traceback (most recent call last):
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmphcenrr0mwandb'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpb4xwdy_lwandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpblhi1dpswandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpvlo9wvf9wandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
Traceback (most recent call last):
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
Traceback (most recent call last):
      File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    ) from e
RuntimeError:     Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402

  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp09hh8lcewandb'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpaiceaueewandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp9u9oflxiwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpm9nknzjwwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp0o41x_4rwandb'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmp4j1z__ikwandb-artifacts'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpc0yl_so1wandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/tempfile.py:798: ResourceWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpoa2al90bwandb-media'>
  _warnings.warn(warn_message, ResourceWarning)
Traceback (most recent call last):
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1146, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer.py", line 40, in <module>
    from .integrations import (
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/integrations.py", line 71, in <module>
    from .trainer_callback import ProgressCallback, TrainerCallback  # noqa: E402
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/trainer_callback.py", line 27, in <module>
    from .training_args import TrainingArguments
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/training_args.py", line 39, in <module>
    from .utils import (
ImportError: cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "fastchat/train/train_lora.py", line 28, in <module>
    from transformers import Trainer, BitsAndBytesConfig, deepspeed
  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1136, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/import_utils.py", line 1151, in _get_module
    ) from e
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
cannot import name 'is_torch_npu_available' from 'transformers.utils' (/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages/transformers/utils/__init__.py)

参考下面的文档所执行的操作。

迁移前准备-基于DeepSpeed的大模型迁移-PyTorch大模型训练适配-...-文档首页-昇腾社区 (hiascend.com)

个人初步分析是transformers的问题,但是不知如何解决,在此寻求各位的帮助,多谢了!

我要发帖子