910部署deepseek推理模型
收藏回复举报
910部署deepseek推理模型
t('forum.solved') 已解决
发表于2025-09-12 17:39:56
0 查看

在官方提供的基于mindspore部署deepseek文档里  (https://www.hiascend.com/software/modelzoo/models/detail/865ba4b5c8044873800b70dace2dd136)

我通过容器构建了推理模型
cke_2002.png
我现在准备进行推理
cke_3874.png
这个推理失败是为什么?
而且我的目录结构也与官网提到的不一样

root@ema:/data/model_path# tree 

├── README.md 

├── examples 

│   ├── aclinit.json 

│   ├── config.json 

│   ├── deepseek3_config.py 

│   ├── deepseek3_model.py 

│   ├── fusion_result.json 

│   ├── msrun_launcher.sh 

│   ├── output 

│   │   ├── log 

│   │   │   ├── rank_0 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   ├── rank_1 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   ├── rank_2 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   ├── rank_3 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   ├── rank_4 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   ├── rank_5 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   ├── rank_6 

│   │   │   │   ├── error.log 

│   │   │   │   └── info.log 

│   │   │   └── rank_7 

│   │   │       ├── error.log 

│   │   │       └── info.log 

│   │   ├── msrun_log 

│   │   │   ├── scheduler.log 

│   │   │   ├── worker_0.log 

│   │   │   ├── worker_1.log 

│   │   │   ├── worker_2.log 

│   │   │   ├── worker_3.log 

│   │   │   ├── worker_4.log 

│   │   │   ├── worker_5.log 

│   │   │   ├── worker_6.log 

│   │   │   └── worker_7.log 

│   │   └── strategy 

│   ├── predict_deepseek3_671B.yaml 

│   ├── run_deepseekv3_predict.py 

│   ├── scheduler.log 

│   ├── worker_0.log 

│   ├── worker_1.log 

│   ├── worker_2.log 

│   ├── worker_3.log 

│   ├── worker_4.log 

│   ├── worker_5.log 

│   ├── worker_6.log 

│   └── worker_7.log 

├── model.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/215d04b24b07fa2555af935d97e6a833284d11388f58a8e5a2da4838a1e56768 

├── model_layer_0.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/4f8b3a109b4dff3f6c0fcaec1c409cc521954224201bb35f1f00059108974649 

├── model_layer_1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/fe7ea027ae1c973b32fe73406e779b4a4d5f0a092544fcd0a0995ddb1a0ac338 

├── model_layer_10.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/a70f974dee6ef124294c896f077643e53fae26b0c05ea3c46f9cf5ee87bbecb7 

├── model_layer_10_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/537f53cb431c3e6063d2e9e8603919c9803536ed9b274f2b60d33b193c694a34 

├── model_layer_10_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/53b550a98f0856b3b7fd5f5d01af66a47d0a8762cb4fb455e3a699836ad93e15 

├── model_layer_10_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/640bc4d21094b12f13553711c5fe40180d4c6957c7a5ecc6ed8d30708f0195c4 

├── model_layer_11.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/76332c7802e87d34135e9cc4ea5ad20cd4ef1728f96b5fb222d599f02751a823 

├── model_layer_11_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/5038e11d1dc251abfc1159855098126fe16833a68fbb4a546e07a691947818c7 

├── model_layer_11_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/bf89415ee337a2481ddb0113688310993e0641dbdceca85670b7cccf20529a5b 

├── model_layer_11_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/39d7486738ea8f624fdea9075fcea6885b896568db95fbcbedc1fcca32426f74 

├── model_layer_12.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/82cff1fd520a39191eb0e25eaaf40fd67d243dc2a1cd2e0b59f1cef95dd486a3 

├── model_layer_12_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/4608ee52db74a799a00cea8dd0dca26e425c0e23116ed3c2bb00b62697dbf11c 

├── model_layer_12_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/04ebac70b41d0ea4958bf1d6cc1debd11cd45ab481cac7d0b82a60c8ef60d6be 

├── model_layer_12_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/dd1ef677ae3ebb3c5c4c2bc2f75b2b4ea4baf4a283a55106499824b4e1b7312e 

├── model_layer_13.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/1686e89f0affe77b152b85284a9aebab4dda3b45a80d3e330df9b1ffaea9fbb5 

├── model_layer_13_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/d455e91a7b51f38662b61256175f7a9c0f1d33dcf02dcf4b3b04f61af7956353 

├── model_layer_13_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/558fb115f2824b8f6b1b7c0e6b815eedf3914c98180ee8ffa477c212007b1a3c 

├── model_layer_13_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/5a2b02141be19aec0caa4d8e2b18e42743ea46e7536b4ea8999b83e8cdc2c297 

├── model_layer_14.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/ee3545ff470c656742995062d730f3ed4a1948c444aec110b452f2cd8672b9ba 

├── model_layer_14_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/d75ca0e26e3f3e4152846a79f157e0d9d4d2ccce2b6236ab774ebeba29c78b33 

├── model_layer_14_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/2164cd388742587ec943b6da7fc88819cd9b907188bb5a1f2c1158a34a90bc52 

├── model_layer_14_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/31b0978fd418b11dcd777af783c41ef9227ff9bb654d6da729f119f30a9a16a6 

├── model_layer_15.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/5eed5f351bd838c08c9bd81c180c5b9db7f3636fa089675a63f81b05259a7756 

├── model_layer_15_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/5a75cb75b820a82678ee2d9eb46341e397a9cdc12a304637799c8f716a85e8f0 

├── model_layer_15_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/cc18d01e3458ea409e36ae93959ffb8caaf968cb1e6cc87302c319e4457b369a 

├── model_layer_15_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/393ed3783f0e2cf297c57dcbd8159c18322ddaa816bfab0e9b3a558e73f98ff2 

├── model_layer_16.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/58ec21d0c82ee8531cf193db560581aed585575841eec55d3669c4d8d2e78c41 

├── model_layer_16_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/3fe80041eb383dcac07b2d7bc5d42347dcc7a4b4c71e75f122d9e390fb347c21 

├── model_layer_6_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/6c242e5c70cf3974232b20403fb4b5fcf66ed20eeb90eccb8b986e2980c6124b 

├── model_layer_7.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/59ce425dd3d70ec77b167745921b620ed13c03bccd0f09cec0a2371473ffa198 

├── model_layer_7_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/5d15d477d0c036490b5a1a5f2c496db516653e1ba3c90d032318c3987ec5e1b8 

├── model_layer_7_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/c5298682f1e302e403dcb685327c6f0a34aaf224c4d9d83564259edf1c20d1a9 

├── model_layer_7_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/9521aed2eb0ca84a435e0a7bb7a241e580a1764786b228aa8019e8db24c44c21 

├── model_layer_8.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/3f110717cc09265e223fd05b1ca97eff413ee01860f517aabafdeb4af3133f75 

├── model_layer_8_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/a64458a80418858e7050064a14a676c34f9f5b9933a461b59ad9a1be4dbdd84f 

├── model_layer_8_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/6c760ee53bca7d1b1a20bb006eeb46941acaeb357ee0207111cdbb007359c56c 

├── model_layer_8_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/4e77cae10d8aca1a674e7334025690c46117f7d0ec481d4dec572c301148435f 

├── model_layer_9.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/30d7883e488eb728b3e0cba479b586cd26a861eff309ea841e0f7edc468cbd42 

├── model_layer_9_w1.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/a2f256bc77577f059db14370cc2746436d786869a9188c362346fea04aee0896 

├── model_layer_9_w2.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/e095fd116e908eee0d1d8b74fe959fd5b8b06e5ef282dd9d540fe74c00fc386f 

├── model_layer_9_w3.safetensors -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/ebeae8c7d874ad50488718ab128e6ddb0990c20233e3af139e7e699c5336d995 

├── param_name_map.json 

└── tokenizer.json -> ../../root/.cache/openmind/hub/models--MindSpore-Lab--DeepSeek-V3/blobs/51083c600ec00c7f57ae1af7fef7108c52ce7376 

13 directories, 285 files 

本帖最后由 匿名用户2025/09/15 09:31:35 编辑

我要发帖子