MindIE
Mind Inference Engine (MindIE) is a high-performance AI inference engine based on Ascend hardware that provides runtime acceleration, debugging and tuning, and rapid migration and deployment.
Key Inference Scenarios
- LLM inference scenario: MindIE's text generation inference scenario, which connects to vLLM-Ascend through MindIE Motor to implement serving deployment of text generation inference and end-to-end acceleration of the entire inference process.
- Multimodal model inference scenario: MindIE's view generation inference scenario, which performs high-performance view generation inference through MindIE SD.
MindIE Documentation
Release and Installation |
|---|
MindIE Text Generation |
|---|
MindIE Image/Video Generation |
|---|