Reading Guide
If you are not familiar with the unilateral communication library or are reading this document for the first time, you are advised to read Table 1 first to quickly learn the manual content and access the sections as needed.
Scenario |
Section |
Content |
|---|---|---|
Understanding unilateral communication library |
This section describes the basic concepts, functions, and advantages of the unilateral communication library, and introduces its application scenarios. |
|
Building a disaggregated LLM inference framework based on the unilateral communication library |
This section describes the overall development process and environment preparation for building a disaggregated LLM inference framework using the unilateral communication library, and provides reference samples. |
|
Learning about API capabilities of the unilateral communication library |
This chapter describes the functions of unilateral communication library APIs and how to implement them. |
|
Exploring advanced features of the unilateral communication library |
This section describes advanced features for building a disaggregated LLM inference framework based on the unilateral communication library, such as role switchover. |
|
Acquiring extended knowledge |
This section describes extended knowledge mentioned in this document, including basic concepts and LLM inference process. |
|
Troubleshooting |
This section describes API error codes, along with cause analysis and solutions. |