[LU-3878] sanity-benchmark test fsx: Bus error

• Type: Bug
• Resolution: Not a Bug
• Priority: Major
• Affects Version/s: Lustre 2.4.1, Lustre 2.5.0, Lustre 2.6.0
• Environment: Lustre build: http://build.whamcloud.com/job/lustre-b2_4/44/ (2.4.1 RC1); Distro/Arch: RHEL6.4/x86_64 + FC18/x86_64 (Server + Client)
• Severity: 3
• Assignee: Oleg Drokin
• Reporter: Jian Yu

Description

sanity-benchmark test fsx failed as follows:

== sanity-benchmark test fsx: fsx ==================================================================== 22:15:58 (1378185358)
debug=0
Using: fsx -c 50 -p 1000 -S 29278 -P /tmp -l 206139         -N 100000  /mnt/lustre/f0.fsxfile
Chance of close/open is 1 in 50
Seed set to 29278
truncating to largest ever: 0xd3af
/usr/lib64/lustre/tests/sanity-benchmark.sh: line 186: 12471 Bus error               $CMD
 sanity-benchmark test_fsx: @@@@@@ FAIL: fsx failed 

Maloo report: https://maloo.whamcloud.com/test_sets/becb9218-14ef-11e3-ac48-52540035b04c

This is a regression on Lustre b2_4 branch.

Issue Links

• duplicates: LU-2909 Failure on test suite sanity-benchmark test_fsx: fsx bus error, core dumped
• is related to: LU-6729 sanity-benchmark test_fsx: Bus error

Comments

[Jian Yu]

Here is the search result on Maloo:
http://tinyurl.com/ozo5c7a

The failure occurred not only on zfs and b2_4, but also on ldiskfs and master/b2_5:
https://maloo.whamcloud.com/test_sets/87757614-44d1-11e3-8c03-52540035b04c
https://maloo.whamcloud.com/test_sets/6f3d0b5e-4cc7-11e3-826a-52540035b04c
https://maloo.whamcloud.com/test_sets/2582fa8c-3bbf-11e3-b062-52540035b04c

[Oleg Drokin]

Is this only happening on zfs?

Only on b2_4, but not on master?

[Jian Yu]

Lustre build: http://build.whamcloud.com/job/lustre-b2_4/47/
Distro/Arch: RHEL6.4/x86_64
FSTYPE=zfs

sanity-benchmark test fsx hit the same failure again:
https://maloo.whamcloud.com/test_sets/5d2a22d4-43a9-11e3-942a-52540035b04c

[Jian Yu]

After patch http://review.whamcloud.com/7481 was reverted from Lustre b2_4 branch, the failure did not occur on Lustre 2.4.1 RC2.

[Jian Yu]

By searching on Maloo, I found that test fsx passed on FC18 on Lustre b2_4 build #40 and previous builds. Builds #41, #42, #43 were not tested on FC18. It seems that the culprit is in build #42.

[Jian Yu]

Lustre build: http://build.whamcloud.com/job/lustre-b2_4/44/ (2.4.1 RC1)
Distro/Arch: RHEL6.4/x86_64
FSTYPE=zfs

sanity-benchmark test fsx also hit the same failure:
https://maloo.whamcloud.com/test_sets/e004601a-1556-11e3-8938-52540035b04c

FYI, here is the query result of sanity-benchmark test_fsx with "FAIL" status on Lustre b2_4 branch:
http://tinyurl.com/kxheu43

[Andreas Dilger]

Sorry, it seems LU-2909 is closed, so presumably this is a new issue.

[Keith Mannthey (Inactive)]

This looks related to https://jira.hpdd.intel.com/browse/LU-2909 an earlier 2.4 blocker.