[LU-4763] sanity-scrub test 11: FAIL: (8) Expect 0 objects skipped on mds1, but got 14

• Type: Technical task
• Resolution: Fixed
• Priority: Blocker
• Fix Version/s: Lustre 2.6.0
• Affects Version/s: Lustre 2.5.1, Lustre 2.4.3
• Labels: mn4
• Environment: Lustre Build: http://build.whamcloud.com/job/lustre-b2_5/41/ (2.5.1 RC3); Distro/Arch: RHEL6.5/x86_64(server), SLES11SP3/x86_64(client)
• Assignee: nasf (Inactive)
• Reporter: Jian Yu

Description

sanity-scrub test 11 failed as follows:

CMD: client-12vm3 /usr/sbin/lctl lfsck_start -M lustre-MDT0000 3 -r
Started LFSCK on the device lustre-MDT0000.
CMD: client-12vm3 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
CMD: client-12vm3 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
CMD: client-12vm3 /usr/sbin/lctl lfsck_start -M lustre-MDT0000 -r
Started LFSCK on the device lustre-MDT0000.
CMD: client-12vm3 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
CMD: client-12vm3 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
 sanity-scrub test_11: @@@@@@ FAIL: (8) Expect 0 objects skipped on mds1, but got 14 

Maloo report: https://maloo.whamcloud.com/test_sets/764fa658-aa3d-11e3-b4b1-52540035b04c

Issue Links

• is related to: LU-4556 speed up sanity-lfsck and sanity-scrub tests

Comments

[Jian Yu]

Lustre client build: https://build.hpdd.intel.com/job/lustre-b2_4/73 (2.4.3)
Lustre server build: https://build.hpdd.intel.com/job/lustre-b2_5/86 (2.5.3 RC1)

The similar failure occurred:

CMD: shadow-13vm12 /usr/sbin/lctl lfsck_start -M lustre-MDT0000 -r
Started LFSCK on the device lustre-MDT0000.
CMD: shadow-13vm12 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
CMD: shadow-13vm12 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
CMD: shadow-13vm12 /usr/sbin/lctl lfsck_start -M lustre-MDT0000 -r
Started LFSCK on the device lustre-MDT0000.
CMD: shadow-13vm12 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
CMD: shadow-13vm12 /usr/sbin/lctl get_param -n osd-ldiskfs.lustre-MDT0000.oi_scrub
 sanity-scrub test_11: @@@@@@ FAIL: (8) Expect 0 objects skipped, but got 14 

Maloo report: https://testing.hpdd.intel.com/test_sets/1a2c41ce-31dd-11e4-bd90-5254006e85c2

[Andreas Dilger]

Fix was landed as part of LU-4556.

[nasf (Inactive)]

The patch has been landed to master.

[nasf (Inactive)]

The fixing is contained in the patch:
http://review.whamcloud.com/#/c/9704/

[nasf (Inactive)]

I will enhance the test scripts in the task of optimising the sanity-lfsck/sanity-scrub.

[nasf (Inactive)]

I suspect that there are some new files created during test_14 repeat the scrub, so the test scripts should be improved to check the total checked the objects (files) to guarantee the compare "noscrub" between two cycle OI scrub are the same.

[Jian Yu]

Here is a patch trying to reproduce the failure on Lustre b2_5 build #41: http://review.whamcloud.com/9645