对接Torch使用MindIO SDK,加速Torch训练CheckPoint save和load操作。
容器的镜像制作、镜像部署、镜像安全加固等由使用者完成,环境中以Python 3.7为例。
tar -xvf Ascend-mindxdl-mindio_{version}_linux-{arch}.tar
文件名 |
说明 |
---|---|
libbdm.so |
MindIO服务依赖动态库 |
libhse_authorization.so |
|
libhse_cryption.so |
|
libsecurec.so |
|
memfs.conf |
MindIO配置文件 |
ockiod |
MindIO二进制文件 |
scripts |
安装相关脚本目录 |
seceasy_encrypt |
安全加密工具 |
torch_mindio-1.0.0-cp37-cp37m-linux_{arch}.whl |
MindIO SDK |
torch_mindio-1.0.0-cp38-cp38m-linux_{arch}.whl |
|
torch_mindio-1.0.0-cp39-cp39m-linux_{arch}.whl |
|
torch_mindio-1.0.0-cp310-cp310m-linux_{arch}.whl |
rm -f mindio/*.so rm -f mindio/memfs.conf rm -f mindio/ockiod rm -f mindio/seceasy_encrypt rm -rf mindio/scripts
chmod 0500 mindio chmod 0400 mindio/*.whl
cd mindio
pip3 install torch_mindio-1.0.0-cp37-cp37m-linux_{arch}.whl --force-reinstall
Processing ./torch_mindio-1.0.0-cp37-cp37m-linux_{arch}.whl Installing collected packages: torch-mindio Successfully installed torch-mindio-1.0.0
Processing ./torch_mindio-1.0.0-cp37-cp37m-linux_{arch}.whl Installing collected packages: torch-mindio Found existing installation: torch-mindio 1.0.0 Uninstalling torch-mindio-1.0.0: Successfully uninstalled torch-mindio-1.0.0 Successfully installed torch-mindio-1.0.0