[LU-11388] replay-single test_131b: test timeout

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.16.0, Lustre 2.15.4
• Affects Version/s: Lustre 2.12.4, Lustre 2.12.5, Lustre 2.12.7, Lustre 2.15.0, Lustre 2.15.3
• Labels: failing_tests
• Severity: 3
• Assignee: Mikhail Pershin
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/41a16040-b988-11e8-9df3-52540065bddc

test_131b failed with the following error:

Timeout occurred after 969 mins, last suite running was replay-single, restarting cluster to continue tests

This test starts to fail from tag-2.11.55
test log

== replay-single test 131b: DoM file write replay ==================================================== 11:35:59 (1537011359)
CMD: trevis-33vm4 /usr/sbin/lctl get_param -n version 2>/dev/null ||
				/usr/sbin/lctl lustre_build_version 2>/dev/null ||
				/usr/sbin/lctl --version 2>/dev/null | cut -d' ' -f2
CMD: trevis-33vm4 sync; sync; sync
UUID                   1K-blocks        Used   Available Use% Mounted on
lustre-MDT0000_UUID      1165900        8732     1053972   1% /mnt/lustre[MDT:0]
lustre-OST0000_UUID      1933276       79708     1731404   4% /mnt/lustre[OST:0]
lustre-OST0001_UUID      1933276       25880     1786156   1% /mnt/lustre[OST:1]
lustre-OST0002_UUID      1933276       25808     1786228   1% /mnt/lustre[OST:2]
lustre-OST0003_UUID      1933276       31488     1780548   2% /mnt/lustre[OST:3]
lustre-OST0004_UUID      1933276       41772     1770264   2% /mnt/lustre[OST:4]
lustre-OST0005_UUID      1933276       25888     1786148   1% /mnt/lustre[OST:5]
lustre-OST0006_UUID      1933276       25840     1786196   1% /mnt/lustre[OST:6]

filesystem_summary:     13532932      256384    12426944   2% /mnt/lustre

CMD: trevis-33vm1.trevis.whamcloud.com,trevis-33vm2 mcreate /mnt/lustre/fsa-\$(hostname); rm /mnt/lustre/fsa-\$(hostname)
CMD: trevis-33vm1.trevis.whamcloud.com,trevis-33vm2 if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-\$(hostname); rm /mnt/lustre2/fsa-\$(hostname); fi
CMD: trevis-33vm4 /usr/sbin/lctl --device lustre-MDT0000 notransno
CMD: trevis-33vm4 dmsetup table /dev/mapper/mds1_flakey
CMD: trevis-33vm4 dmsetup suspend --nolockfs --noflush /dev/mapper/mds1_flakey
CMD: trevis-33vm4 dmsetup load /dev/mapper/mds1_flakey --table \"0 4194304 flakey 252:0 0 0 1800 1 drop_writes\"
CMD: trevis-33vm4 dmsetup resume /dev/mapper/mds1_flakey
CMD: trevis-33vm4 /usr/sbin/lctl mark mds1 REPLAY BARRIER on lustre-MDT0000

VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
replay-single test_131b - Timeout occurred after 969 mins, last suite running was replay-single, restarting cluster to continue tests

Issue Links

• is related to: LU-16478 faulty MDT connection can leak a reference to export

Comments

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51289/
Subject: LU-11388 tests: replay-single/131b to refresh grants
Project: fs/lustre-release
Branch: b2_15
Current Patch Set:
Commit: 653ae754fa93ecf8b9d290675122956eaf63b6af

[Gerrit Updater]

"Andreas Dilger <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51289
Subject: LU-11388 tests: replay-single/131b to refresh grants
Project: fs/lustre-release
Branch: b2_15
Current Patch Set: 1
Commit: 119867a8add693b8dd7165456fefb7327dd4ed02

[Peter Jones]

Landed for 2.16

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/50661/
Subject: LU-11388 tests: replay-single/131b to refresh grants
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 384e1e858eef826677bfa6913074a83c4fab37d3

[Gerrit Updater]

"Alex Zhuravlev <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50661
Subject: LU-11388 tests: replay-single/131b to refresh grants
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 6dc4285f738158a90c2ff6b6bd3cbc430b580654

[Alex Zhuravlev]

probably this is LU-16478

[Etienne Aujames]

+1 on master (ZFS): https://testing.whamcloud.com/test_sets/4c0e7862-d495-4f2e-ab4f-8c30e3a3dc59

[Patrick Farrell]

+1 on master: https://testing.whamcloud.com/test_sets/b0074d9c-d7fd-45c1-a5b9-79c61aad0f20

[Sergey Cheremencev]

+1 on master: https://testing.whamcloud.com/test_sets/a0db5427-6afe-4709-91e7-ed111a3ce01f

It failed even with "LU-11388 test: enable replay-single test_131b".

[Peter Jones]

Does this landing mean that this ticket can be closed or does further work remain?