[LU-9340] PFL fails performance testsSpirit

• Type: Bug
• Resolution: Fixed
• Priority: Blocker
• Fix Version/s: Lustre 2.10.0
• Affects Version/s: Lustre 2.10.0
• Labels: pfl
• Environment: Spirit performance cluster
• Severity: 3
• Assignee: Jinshan Xiong (Inactive)
• Reporter: Cliff White (Inactive)

Description

Attempting to run P02 and P03 performance tests, with striping set as:
$LFS setstripe $testdir --pool $ior_ostPool -E 64M -c 1 -E 4G -c 4 -E -1 -c -1I

Immediate MPI failures with IOR

 Commencing write performance test: Thu Apr 13 21:04:16 2017
024: ior ERROR: write() failed, errno 61, No data available (aiori-POSIX.c:335)
024: --------------------------------------------------------------------------
024: MPI_ABORT was invoked on rank 24 in communicator MPI_COMM_WORLD
--
..........
231: ior ERROR: write() failed, errno 61, No data available (aiori-POSIX.c:335)
088: In: PMI_Abort(-1, N/A)
287: ior ERROR: write() failed, errno 61, No data available (aiori-POSIX.c:335)
134: In: PMI_Abort(-1, N/A)
057: --------------------------------------------------------------------------
057: MPI_ABORT was invoked on rank 57 in communicator MPI_COMM_WORLD 
--
057: 
057: NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
057: You may or may not see output from other processes, depending on
057: exactly when Open MPI kills them.
057: -------------------------------------------

Lustre Errors on all nodes attached.

Issue Links

• is related to: LU-8494 IOR Aborts with EINTR in 2.7 but not 2.5
• is related to: LU-8998 Progressive File Layout (PFL)
• is related to: LU-9349 PFL known issues tracking ticket