Introduction
StreamServer is an inference server developed based on Vision SDK and provides visual inference services through RESTful APIs.
StreamServer depends on the Flask framework. Before starting StreamServer, you need to manually install Flask.
StreamServer is not a complete system, which cannot be directly deployed. It needs to be integrated into your system as a component and used together with other systems to form a complete inference service system. You need to consider the security, reliability, and availability of the deployment environment. You are advised to integrate and deploy the StreamServer inference service by referring to the mainstream Web deployment solutions and not to use the inference service independently. In addition, you are advised to deploy Nginx before configuring the HTTPS server, to enhance traffic control and defend against flood attacks.
- The StreamServer inference service will exit in December, 2025 and stop evolution.
- If the KMC initialization random number is blocked when the server receives requests or executes the certificate import script, install haveged by referring to Installing Dependencies.
- Flask 2.2.5 is recommended. You are advised to use pip3 to install the package management tool, for example, pip3 install Flask==2.2.5.
- After Nginx is configured, StreamServer records only network service information related to the Nginx reverse proxy port. Therefore, you need to analyze service problems based on StreamServer and Nginx logs.
Version Features
- Supports the pipeline inference service.
- Supports single-model inference services and automatic batch grouping.
- Supports the HTTPS bidirectional encryption and authentication.
- Supports request stream control.
- Allows Huawei's key management CBB (KMC) to manage the CA key.