[LU-13169] Allow test-framework to repeat subtests

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.14.0, Lustre 2.12.5
• Labels: easy
• Assignee: Andreas Dilger
• Reporter: Andreas Dilger

Description

When running with ONLY=X it would be useful to allow the subtest(s) to be run multiple times in order to more efficiently reproduce intermittent test failures, or ensure that they are fixed.

I think something like ONLY_REPEAT=N to cause tests specified with ONLY= to be run N times would be useful. This is not as useful for cases when the whole test script is run, since that can just be run multiple times in a row (possibly in parallel) as each run would take a long time to complete anyway.

It looks like the right place to add this logic would be in run_test() or run_one_logged() (which would need to log the output from each repetition separately).

Issue Links

• is related to: LU-13352 Test duration not reset when using ONLY_REPEAT test parameter