Terms, Acronyms, and Abbreviations

ACP

Async Checkpoint Persistence

ASLR

Address Space Layout Randomization

ARF

Air Refuelling

LLM

Large Language Model

MoE

Mixture of Experts

NPU

Neural Processing Unit

OS

Optimizer State

OOM

Out Of Memory

SDK

Software Development Kit

TFT

Training Fault Tolerance

TCP

Transmission Control Protocol

TLS

Transport Layer Security

TTP

Try To Persist

UCE

Uncorrectable Memory Error

DP

Data Parallelism

ZeRO

Zero Redundancy Optimizer