LLMDataDist
LLMDataDist构造函数
init
finalize
add_model
link_clusters
unlink_clusters
complete_request
kv_cache_manager
switch_role
check_capacity
link
unlink
query_register_mem_status
cache_manager