[LU-6319] Re-enable tests on ALWAYS_EXCEPT list from Bugzilla

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.12.0
• Type: Improvement
• Priority: Minor
• Reporter: James Nunez (Inactive)
• Assignee: James Nunez (Inactive)
• Resolution: Fixed

Description

Several tests in the Lustre test suites are skipped due to problems in the Lustre code, issues with a specific Linux kernel or due to the OSTs or MDTs file system. For example, in sanity.sh

# bug number for skipped test: 13297 2108 9789 3637 9789 3561 12622 5188
ALWAYS_EXCEPT="                42a  42b  42c  42d  45   51d   68b   $SANITY_EXCEPT"

or in replay-single.sh

# Skip these tests
# bug number:  17466 18857      LU-1473
ALWAYS_EXCEPT="61d   33a 33b    62	$REPLAY_SINGLE_EXCEPT"

In most cases, the goal is to fix the underlying problem that prompted the test to be added to the ALWAYS_EXCEPT list and to remove the test from the list so it is run in regular testing. If the test is skipped due to a JIRA ticket (LU-XXXX), then the appropriate place to land a patch against is that JIRA ticket number. If the test is being skipped due to a Bugzilla number, there isn’t a good ticket to land a patch against.

The tests that are currently skipped should be tested and, if they pass testing, should be re-enabled. This ticket is to track removing (re-enabling) tests that are on the ALWAYS_EXCEPT list due to Bugzilla tickets and for minor clean-up or correction of the tests on the ALWAYS_EXCEPT list.

conf-sanity 24a Bugzilla 23573

conf-sanity 24b Bugzilla 23954

obdfilter-survey 1b Bugzilla 23791

obdfilter-survey 2b Bugzilla 23791

performance-sanity 1 Bugzilla 15266 / Patch 16628

performance-sanity 2 Bugzilla 15266 / Patch 16628

recovery-small 52 Bugzilla 5493

replay-dual 15c Bugzilla 10124

replay-single 33a Bugzilla 18857

replay-single 33b Bugzilla 18857

replay-single 61d Bugzilla 17466

replay-vbr 12a Bugzilla 16356 / Bugzilla 18143

sanityn 11 Bugzilla 12652 / Patch 14860

sanityn 14 Bugzilla 12652 / Patch 14860

sanityn 14b Bugzilla 3192

sanityn 19 Bugzilla 14773 / Patch 16963

sanityn 22 Bugzilla 16929 / Patch 19320

sanityn 28 Bugzilla 9977

sanityn 29 Bugzilla 14773 / Patch 16963

sanityn 35 Bugzilla 18080 / Patch 22786

sanity-sec 2 Bugzilla 19967 / Bugzilla 19430

sanity-sec 5 Bugzilla 19967 / Patch 24534

sanity-sec 6 Bugzilla 19967 / Patch 24534

sanity 42a Bugzilla 2108

sanity 42b Bugzilla 9789

sanity 42c Bugzilla 3637

sanity 42d Bugzilla 9789

sanity 45 Bugzilla 3561

sanity 51d Bugzilla 12622

sanity 68b Bugzilla 5188

Issue Links

• is related to: LU-1473 Test failure on test suite replay-sin...
• is related to: LU-9044 conf-sanity test cases 24b remove fro...
• is related to: LU-9581 recovery-small tests 52 60 remove fro...
• is related to: LU-6493 sanity test 42b failure on sync
• is related to: LU-9693 sanity test_42c: FAIL: beforewrites 2...
• is related to: LU-2034 Modify Changelogs to work with New OS...

Comments

[Andreas Dilger]

Please use b=12345 when referencing Bugzilla bugs, so that Gerrit can link to them automatically.

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: http://review.whamcloud.com/13953
Subject: LU-6319 tests: Clean up sanityn ALWAYS_EXCEPT list
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: a56cd92905c1d8779477c9c8f695a480ac27bf62

[James Nunez (Inactive)]

Patch http://review.whamcloud.com/13953 removes test 22 from the ALWAYS_EXCEPT and EXCEPT list since there is no test 22 in sanityn.sh. Also, clean up code to exclude tests if client is running SLES10.

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: http://review.whamcloud.com/13967
Subject: LU-6319 tests: Check if ALWAYS_EXCEPT tests pass
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 0d5a7da132ae5cab3afbbf7d7e55f7485594bdd2

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: http://review.whamcloud.com/14149
Subject: LU-6319 tests: Clean up replay-single ALWAYS_EXCEPT list
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 7758042a921922a4eb6e0d95f41f50342b3716b3

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/13953/
Subject: LU-6319 tests: Clean up sanityn ALWAYS_EXCEPT list
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 060dcd91cd26815edf9fb1f5b1d7fc8d9bf24bbe

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/14149/
Subject: LU-6319 tests: Clean up replay-single ALWAYS_EXCEPT list
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 43af9a3481e980e267a94c9f466ff2b300f619d9

[James Nunez (Inactive)]

Remove parallel-grouplock from parallel-scale.sh ALWAYS_EXCEPT list: https://review.whamcloud.com/#/c/19107/

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/19107/
Subject: LU-6319 tests: Resume parallel-grouplock testing
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 3ef62a1484e8593109eaf2e41e12f139179a8123

[James Nunez (Inactive)]

Status: There are only two test suites that still have reference to Bugzilla tickets number in the ALWAYS_EXCEPT list; obdfilter-survey and recovery-small.

Removing the recovery-small tests from the ALWAYS_EXCEPT list is being tracked under LU-9581 and patch https://review.whamcloud.com/#/c/27382/

Thus, this ticket is only tracking obdfilter-survey tests 1b and 2b on the ALWAYS_EXCEPT list due to Bugzilla number 23791.

[James Nunez (Inactive)]

The last tests on the ALWAYS_EXCEPT list due to bugzilla tickets are tracked on other tickets; LU-11166 for the obdfilter-survey tests and LU-9581 for the recovery-small tests. Thus, this ticket can be closed.

[Andreas Dilger]

Reopen to remove always_except label, which should only be used on tickets that are open and actually being skipped.