在windows10环境中,仅使用CPU,python 3.12.10,MindSpore 2.8.0已经安装完成环境下,VSCode编程环境:
按照官方要求
pip install MindNLP
安装了MindNLP提示安装成功。
在运行以下程序
import mindnlp # 就这么简单!HuggingFace 现在运行在 MindSpore 上
from transformers import pipeline
pipe = pipeline(“text-generation”, model=“Qwen/Qwen2-0.5B”)
print(pipe(“你好,我是”)[0][“generated_text”])
报错:
Traceback (most recent call last):
File “j:\Jupyter\AIMS_MS环境检测.py”, line 11, in
import mindnlp # 就这么简单!HuggingFace 现在运行在 MindSpore 上
^^^^^^^^^^^^^^
File “C:\Users\lee\AppData\Local\Programs\Python\Python312\Lib\site-packages\mindnlp_init_.py”, line 26, in
import mindtorch
File “C:\Users\lee\AppData\Local\Programs\Python\Python312\Lib\site-packages\mindtorch_init_.py”, line 74, in
from . import C
File "C:\Users\lee\AppData\Local\Programs\Python\Python312\Lib\site-packages\mindtorch_C_init.py", line 208, in
default_generator = Generator()
^^^^^^^^^^^
File “C:\Users\lee\AppData\Local\Programs\Python\Python312\Lib\site-packages\mindtorch_C_init_.py”, line 125, in init
self.generator = GeneratorOp().set_device(“CPU”)
^^^^^^^^^^^^^
TypeError: Generator.init() missing 2 required positional arguments: ‘seed’ and ‘offset’
经过多次尝试,哪怕程序仅
import mindnlp*
也依然报此错误。
我进行了以下尝试:
1、更换python版本,从3.10-3.11-3.12都进行过尝试,在Python3.10上,也会报错,不过报错内容不同:
Traceback (most recent call last):
File “j:\Jupyter\AIMS_MS环境检测.py”, line 11, in
import mindnlp # 就这么简单!HuggingFace 现在运行在 MindSpore 上
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\mindnlp_init*.py”, line 30, in
from . import transformers
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\mindnlp\transformers_init_.py”, line 4, in
import transformers
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers_init_.py”, line 30, in
from . import dependency_versions_check
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\dependency_versions_check.py”, line 16, in
from .utils.versions import require_version, require_version_core
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils_init_.py”, line 22, in
from .auto_docstring import (
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\auto_docstring.py”, line 32, in
from .generic import ModelOutput
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\generic.py”, line 36, in
from .import_utils import is_mlx_available, is_torch_available, is_torch_fx_proxy
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py”, line 47, in
PACKAGE_DISTRIBUTION_MAPPING = importlib.metadata.packages_distributions()
File “C:\Users\lee\AppData\Local\Programs\Python\Python310\lib\importlib\metadata_init_.py”, line 1055, in packages_distributions
for pkg in (dist.read_text(‘top_level.txt’) or ‘’).split():
AttributeError: ‘types.SimpleNamespace’ object has no attribute ‘read_text’
2、更换多台电脑,问题依旧;
说明:
我的所有尝试都是基于windows系统的python环境,由于没有能够适配的GPU先看,所以没有CANN技术栈。我看官方文档说能够支持仅CPU运行,而自己条件有限,所以想先在现有电脑上进行进行和了解。我已经尝试运行mindspore的相关功能,并利用完成了几个demo训练,大多是demo都能够在没有GPU或NPU的环境下正常工作,最多也只是爆内存。这说明mindspore也能够在普通电脑配置下实现功能。
请问:
1、这个问题因为MindNLP需要使用大模型导致无法再仅cpu环境运行么?
2、mindnlp与python3.12不兼容么?官方好像说仅支持到3.11?
3、在3.10上运行的报错,是不是说明mindnlp安装的transformers与cpu版本有不兼容问题?