MindIE3.0.0 我有两张卡,希望每张卡运行一个模型实例
收藏回复举报
MindIE3.0.0 我有两张卡,希望每张卡运行一个模型实例
t('forum.solved') 已解决
新人帖
发表于2026-08-11 15:39:05
0 查看

/usr/local/Ascend/mindie/3.0.0/mindie-service/conf/config.json

"BackendConfig" : {

...

"modelInstanceNumber" : 2,

"npuDeviceIds": [[0],[1]],

"ModelDeployConfig" :

{

"ModelConfig" : [

{

"modelInstanceType":"Standard",

"modelName" : "模型A",

"modelWeightPath" : "/home/models/模型A",

"worldSize" : 1,

...

},

{

"modelInstanceType":"Standard",

"modelName" : "模型B",

"modelWeightPath" : "/home/models/模型B",

"worldSize" : 1,

....

}

]

},

...

启动后报配置初始化错误

./bin/mindieservice_daemon

g_mainPid = 41573

LogLevelDynamicHandler start

ConfigManager: Load Config from /usr/local/Ascend/mindie/3.0.0/mindie-service/conf/config.json.

The configName speculationGamma is not found, use default value.

ConfigManager init exception: Failed to initialize ModelDeployConfig from JSON.

Killed

请教一下ModelConfig的配置这样写对吗?

另外我随便删除一个模型A或者模型B,都是能正常启动的

我要发帖子