[LU-10754] sanityn test 47b fails with 'create must fail'

• Type: Bug
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.13.0
• Affects Version/s: Lustre 2.11.0, Lustre 2.12.2
• Labels: dne zfs
• Severity: 3
• Assignee: Patrick Farrell (Inactive)
• Reporter: James Nunez (Inactive)

Description

sanityn test_47b fails for DNE/ZFS testing. From the client test_log, we see

== sanityn test 47b: pdirops: remote mkdir vs create ================================================= 09:50:51 (1519725051)
CMD: onyx-32vm9 lctl set_param fail_loc=0x80000145
fail_loc=0x80000145
 sanityn test_47b: @@@@@@ FAIL: create must fail 
lfs mkdir: error on LL_IOC_LMV_SETSTRIPE '/mnt/lustre/f47b.sanityn' (3): stripe already set
lfs setdirstripe: cannot create stripe dir '/mnt/lustre/f47b.sanityn': File exists

This test started failing on 2018-01-19.

The console and dmesg logs don’t have any more information in them for this failure than what is in the suite_log.

Logs for test sessions with this failure are at
https://testing.hpdd.intel.com/test_sets/b9932fbe-fd24-11e7-bd00-52540065bddc
https://testing.hpdd.intel.com/test_sets/316d208c-1bb4-11e8-a7cd-52540065bddc
https://testing.hpdd.intel.com/test_sets/5ce20dce-1905-11e8-a6ad-52540065bddc

Issue Links

• is duplicated by: LU-13097 sanityn test_47b: create must fail
• is related to: LU-12470 sanityn test_47b: create isn't blocked
• is related to: LU-2233 sanityn/40-46 takes ~800-900s

Comments

[Jian Yu]

Thank you, Patrick.

[Patrick Farrell (Inactive)]

yujian,

There are a number of bugs for this, unfortunately.  Here's the one we're using now, which has an unlanded fix: LU-12470

[Jian Yu]

The failure still occurred on master branch:
https://testing.whamcloud.com/test_sets/c376ce50-b86c-11e9-b753-52540065bddc
https://testing.whamcloud.com/test_sets/3e5c96d8-b7c6-11e9-b88c-52540065bddc
https://testing.whamcloud.com/test_sets/29aab538-b66a-11e9-b88c-52540065bddc

[Andreas Dilger]

Wondering if we can just land it to b2_12?

If this patch is landed to b2_12, will it then cause interop testing problems for 2.12 vs. 2.10? Not that I'm totally against this, since we run far more testing on master than b2_12, but ideally we should just add a version interop check, or just skip this test for interop testing on b2_12 so that there aren't gratuitous errors that need to be looked at.

[Patrick Farrell (Inactive)]

OK, figured it out:
https://review.whamcloud.com/#/c/4392/
breaks interop.

Wondering if we can just land it to b2_12?

[Gerrit Updater]

Patrick Farrell ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35399
Subject: LU-10754 tests: Debug full testing failure
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c6779689cbcd658b600933425db1d5365b3a3337

[Gerrit Updater]

Andreas Dilger ([e-mail]) merged in patch https://review.whamcloud.com/34853/
Subject: LU-10754 tests: sanityn/47b to sleep for 1s
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 85ac0da36748311528aa7b89f62679f087b7445c

[James A Simmons]

This is causing about 1/3 of each test suite runs to fail.

[Gerrit Updater]

Alex Zhuravlev ([e-mail]) uploaded a new patch: https://review.whamcloud.com/34853
Subject: LU-10754 debug: try to sleep for 1s
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 24860d1c1948a2a7ccec0be8eb1ea8ee78e63cb6

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/34848/
Subject: LU-10754 tests: Clear mdc locks before tests
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 26a7abe812834663a6d42ba0d04606650c71cb9f