Diagnosis Fails and "[Errno 24] Too many open files" Is Displayed

Symptom

When the diagnosis function is enabled in a large cluster and the input directory contains a large number of log files, diagnosis may fail, and the log "Too many open files." is reported.

Solution

  1. Run the ulimit -n command to check the maximum number of file descriptors that can be opened at the same time.

  2. Run the ulimit -n num command to adjust the upper limit of file descriptors, for example, ulimit -n 2048.