[LU-7631] conf-sanity test_82a: getstripe -c wrong: found 2, expected 3

• Type: Bug
• Resolution: Fixed
• Priority: Critical
• Fix Version/s: Lustre 2.13.0, Lustre 2.10.7, Lustre 2.12.1
• Affects Version/s: Lustre 2.8.0, Lustre 2.9.0, Lustre 2.10.0, Lustre 2.11.0, Lustre 2.10.5
• Severity: 3
• Assignee: James Nunez (Inactive)
• Reporter: Maloo

Description

This issue was created by maloo for Andreas Dilger <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/9313c1e0-b06f-11e5-bf32-5254006e85c2.

The sub-test test_82a failed with the following error:

/usr/bin/lfs getstripe -c /mnt/lustre/d82a.conf-sanity/f82a.conf-sanity-1 wrong: found 2, expected 3

Looks like this might be related to running short of precreated OST objects on one of the OSTs and it is skipped rather than blocking the create. The MDS should allow at most 1/4 of requested stripes to be skipped if they have no objects rather than blocking the create indefinitely. However, it appears that this functionality was broken with the change from LOV to LOD, and in this case all 3 OST objects are required since (3 * 1/4 < 1) so no whole stripe could be skipped yet.

In lod_qos_prep_create() it does not set the flags = LOV_USES_DEFAULT_STRIPE for the cases when a filesystem-wide default striping is used as was done in the original qos_prep_create(), and as such lod_alloc_qos() requires that all requested stripes to be allocated. The lod_alloc_qos() code will fall back to lod_alloc_rr() with -EAGAIN if these cannot be allocated. In lod_alloc_rr() it will return success if at least one OST object was allocated, which doesn't seem correct if a large number of stripes was requested, though it isn't clear why lod_alloc_rr() doesn't wait for the OSTs to come online and allocate the requested number of objects.

Also, it looks like the check for lod_qos_is_usable() could be moved to the start of lod_alloc_qos() instead of after the pools are checked, since it doesn't use any of the pool information anyway.

Info required for matching: conf-sanity 82a

Issue Links

• duplicates: LU-5887 conf-sanity test_82a failed: '/usr/bin/lfs getstripe -c /mnt/lustre/d82a.conf-sanity/f82a.conf-sanity-1 wrong: found 2, expected 3'

Comments

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/34294/
Subject: LU-7631 tests: add debug info to conf-sanity 82a
Project: fs/lustre-release
Branch: b2_12
Current Patch Set:
Commit: 3fc307a9e2453c4fa13cf329bd129e24f98548c7

[Gerrit Updater]

Minh Diep ([e-mail]) uploaded a new patch: https://review.whamcloud.com/34294
Subject: LU-7631 tests: add debug info to conf-sanity 82a
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 973f05acfb0986eb6f152df0130ac0d670e4ae0e

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/34121/
Subject: LU-7631 tests: add debug info to conf-sanity 82a
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: 4ae14186ce1958373c506e3abb12b891d46e70dc

[Gerrit Updater]

Minh Diep ([e-mail]) uploaded a new patch: https://review.whamcloud.com/34121
Subject: LU-7631 tests: add debug info to conf-sanity 82a
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 32b27b2ba4feb7e4a064345e89ddfd4f07b4a381

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/33689/
Subject: LU-7631 tests: add debug info to conf-sanity 82a
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: e76683a5bd540cacd2271a969aa9acd9bf790ccf

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/33690/
Subject: LU-7631 tests: wait_osts_up waits for MDS precreates
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: 17065139073a070d987235db7794805d264af2b3

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: https://review.whamcloud.com/33690
Subject: LU-7631 tests: wait_osts_up waits for MDS precreates
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 64ed3b90af4f2b53b4f78f27355148ab42a9ef19

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: https://review.whamcloud.com/33689
Subject: LU-7631 tests: add debug info to conf-sanity 82a
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5a48d247a6e1851595df0203f597a6aee52c38e4

[James Nunez (Inactive)]

I took a look at all the conf-sanity test 82a failures from the past almost five months, July 1 to November 19, and this test is only failing for 2.10.5 and 2.10.6 testing. I will upload a patch with Andreas suggestions to help with debugging in case we see this test fail again.

[Minh Diep]

+1 on b2_10
https://testing.hpdd.intel.com/test_sets/b685aeb4-2033-11e8-b046-52540065bddc