Why Am I Seeing the "killed" Message During Calibration?
Symptom
The "killed" message displays in the calibration.
Possible Cause
The data volume involved in quantization is too large for the CPU or GPU storage in the environment, leading to a memory error.
Solution
- Decrease the value of batch_size or batch_num to use a smaller calibration dataset. Alternatively, try again with the minimum result of batch_size times batch_num.
- If only the feature map of a specific layer is memory-consuming, which causes the memory error, skip quantizing this layer.
Parent topic: FAQ