我将自己训练好的模型转换成.om格式的模型,能推理,但是很慢,不论加载模型还是推理模型一帧都要好几分钟,求求各位帮我看看
收藏回复举报
我将自己训练好的模型转换成.om格式的模型,能推理,但是很慢,不论加载模型还是推理模型一帧都要好几分钟,求求各位帮我看看
t('forum.solved') 已解决
发表于2024-07-14 13:20:53
0 查看

我查看了下npu的调用,发现npu占用一直为0,是我接口用错了吗? 下面是我的测试代码:

import torch 

import numpy as np 

import time 

import imageio.v2 as imageio 

from ais_bench.infer.interface import InferSession 

 

model_path = 'outsuccess.om' 

model = InferSession(0, model_path) 

 

#预处理图片 

ref_image = imageio.imread("image/im001.png").transpose(2, 0, 1).astype(np.float32) / 255.0 

h = (ref_image.shape[1] // 64) * 64 

w = (ref_image.shape[2] // 64) * 64 

ref_image = np.array(ref_image[:, :h, :w]) 

 

input_image = (imageio.imread("image/im003.png").transpose(2, 0, 1)[:, :h, :w]).astype(np.float32) / 255.0\ 

 

ref_image = torch.from_numpy(ref_image.reshape(1, *ref_image.shape)) 

 

input_image = torch.from_numpy(input_image.reshape(1, *input_image.shape)) 

 

time1 = time.time() 

output = model.infer([ref_image,input_image]) 

print(time.time()-time1) 

 

np.save('tensor.npy', output[0]) 

recon_image = (output[0] * 255.0).astype(np.uint8) 

recon_image = np.squeeze(recon_image, axis=0) 

recon_image = np.transpose(recon_image, (1, 2, 0)) 

 

imageio.imwrite("recon.png", recon_image) 

我要发帖子