[LU-2719] Lustre slowdown, errors with IOR: INFO: task IOR: blocked for more than 120 seconds.

Thu, 9 Jan 2020 06:28:28 +0000

Observed slow-down in performance in test environment that they are using to benchmark HD video streaming. After an initial PoC before Christmas, they have restarted their evaluation and are trying to re-establish the baseline performance and meeting with poor results compared with their original testing.

The system was completely rebooted earlier in the week and is, so far, much improved. Still waiting on confirmation that the numbers are in line with expectations but I would like to try and make sure that we haven't missed anything.

There is a possibility that the problems experienced were environment or configuration related (e.g. network instability or a configuration error). Since rebooting the servers, the system appears to be more stable.

Ideally, looking for consensus or confirmation that issue is not systemic.

Syslogs attached. They have been scrubbed a bit to remove some very verbose and extraneous informational entries from unrelated software.

Whamcloud Community JIRA

[LU-2719] Lustre slowdown, errors with IOR: INFO: task IOR: blocked for more than 120 seconds.