/usr/local/Ascend/mindie/3.0.0/mindie-service/conf/config.json
"BackendConfig" : {
...
"modelInstanceNumber" : 2,
"npuDeviceIds": [[0],[1]],
"ModelDeployConfig" :
{
"ModelConfig" : [
{
"modelInstanceType":"Standard",
"modelName" : "模型A",
"modelWeightPath" : "/home/models/模型A",
"worldSize" : 1,
...
},
{
"modelInstanceType":"Standard",
"modelName" : "模型B",
"modelWeightPath" : "/home/models/模型B",
"worldSize" : 1,
....
}
]
},
...
启动后报配置初始化错误
./bin/mindieservice_daemon
g_mainPid = 41573
LogLevelDynamicHandler start
ConfigManager: Load Config from /usr/local/Ascend/mindie/3.0.0/mindie-service/conf/config.json.
The configName speculationGamma is not found, use default value.
ConfigManager init exception: Failed to initialize ModelDeployConfig from JSON.
Killed
请教一下ModelConfig的配置这样写对吗?
另外我随便删除一个模型A或者模型B,都是能正常启动的
/usr/local/Ascend/mindie/3.0.0/mindie-service/conf/config.json
"BackendConfig" : {
...
"modelInstanceNumber" : 2,
"npuDeviceIds": [[0],[1]],
"ModelDeployConfig" :
{
"ModelConfig" : [
{
"modelInstanceType":"Standard",
"modelName" : "模型A",
"modelWeightPath" : "/home/models/模型A",
"worldSize" : 1,
...
},
{
"modelInstanceType":"Standard",
"modelName" : "模型B",
"modelWeightPath" : "/home/models/模型B",
"worldSize" : 1,
....
}
]
},
...
启动后报配置初始化错误
./bin/mindieservice_daemon
g_mainPid = 41573
LogLevelDynamicHandler start
ConfigManager: Load Config from /usr/local/Ascend/mindie/3.0.0/mindie-service/conf/config.json.
The configName speculationGamma is not found, use default value.
ConfigManager init exception: Failed to initialize ModelDeployConfig from JSON.
Killed
请教一下ModelConfig的配置这样写对吗?
另外我随便删除一个模型A或者模型B,都是能正常启动的