Application Scenarios

Models and scheduling capabilities are provided for self-developed MindIE Motor and third-party Triton, and supports continuous batching.

Parent topic: LLM Manager API Reference (C++)