[LU-9437] sanity-lfsck test_33: only 0 of 4 MDTs are in completed

• Type: Bug
• Resolution: Fixed
• Priority: Critical
• Fix Version/s: Lustre 2.11.0, Lustre 2.10.4
• Affects Version/s: Lustre 2.10.0, Lustre 2.10.1, Lustre 2.11.0, Lustre 2.10.2, Lustre 2.10.3
• Labels: dne zfs
• Environment: trevis-50, full, DNE+ZFS; EL7, master branch, v2.9.56.11, b3565
• Severity: 3
• Assignee: nasf (Inactive)
• Reporter: James Casper

Description

https://testing.hpdd.intel.com/test_sessions/30cc75b6-594f-4255-accf-24fe11bdd565

Just before the failure occured:

From test_log:

Started LFSCK on the device lustre-MDT0000: scrub namespace
CMD: trevis-50vm7 /usr/sbin/lctl lfsck_query -t namespace -M lustre-MDT0000 -w |
		      awk '/^namespace_mdts_completed/ { print \$2 }'
CMD: trevis-50vm7 /usr/sbin/lctl lfsck_query -t namespace -M lustre-MDT0000
namespace_mdts_init: 0
namespace_mdts_scanning-phase1: 0
namespace_mdts_scanning-phase2: 0
namespace_mdts_completed: 0
namespace_mdts_failed: 3
namespace_mdts_stopped: 0
namespace_mdts_paused: 0
namespace_mdts_crashed: 0
namespace_mdts_partial: 0
namespace_mdts_co-failed: 1
namespace_mdts_co-stopped: 0
namespace_mdts_co-paused: 0
namespace_mdts_unknown: 0

And then the same output for namespace_osts, but all are 0. Then the failure was seen:

 sanity-lfsck test_33: @@@@@@ FAIL: (5) only 0 of 4 MDTs are in completed 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:4931:error()
  = /usr/lib64/lustre/tests/sanity-lfsck.sh:142:wait_all_targets_blocked()
  = /usr/lib64/lustre/tests/sanity-lfsck.sh:5046:test_33()
  = /usr/lib64/lustre/tests/test-framework.sh:5207:run_one()
  = /usr/lib64/lustre/tests/test-framework.sh:5246:run_one_logged()
  = /usr/lib64/lustre/tests/test-framework.sh:5093:run_test()
  = /usr/lib64/lustre/tests/sanity-lfsck.sh:5052:main()

Issue Links

• is related to: LU-11151 sanity-lfsck test_33: (5) only 0 of 4 MDTs are in completed