Reading Guide

If you are not familiar with the unilateral communication library or are reading this document for the first time, you are advised to read Table 1 first to quickly learn the manual content and access the sections as needed.

Table 1 Reading guide

Scenario

Section

Content

Understanding unilateral communication library

Introduction

This section describes the basic concepts, functions, and advantages of the unilateral communication library, and introduces its application scenarios.

Building a disaggregated LLM inference framework based on the unilateral communication library

Quick Start

This section describes the overall development process and environment preparation for building a disaggregated LLM inference framework using the unilateral communication library, and provides reference samples.

Learning about API capabilities of the unilateral communication library

Function Description

This chapter describes the functions of unilateral communication library APIs and how to implement them.

Exploring advanced features of the unilateral communication library

Special Topics

This section describes advanced features for building a disaggregated LLM inference framework based on the unilateral communication library, such as role switchover.

Acquiring extended knowledge

Appendix

This section describes extended knowledge mentioned in this document, including basic concepts and LLM inference process.

Troubleshooting

Error Codes

This section describes API error codes, along with cause analysis and solutions.