[LU-13169] Allow test-framework to repeat subtests Created: 24/Jan/20 Updated: 05/Jun/20 Resolved: 14/Feb/20 |
|
| Status: | Resolved |
| Project: | Lustre |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | Lustre 2.14.0, Lustre 2.12.5 |
| Type: | Improvement | Priority: | Minor |
| Reporter: | Andreas Dilger | Assignee: | Andreas Dilger |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | easy | ||
| Issue Links: |
|
||||||||
| Rank (Obsolete): | 9223372036854775807 | ||||||||
| Description |
|
When running with ONLY=X it would be useful to allow the subtest(s) to be run multiple times in order to more efficiently reproduce intermittent test failures, or ensure that they are fixed. I think something like ONLY_REPEAT=N to cause tests specified with ONLY= to be run N times would be useful. This is not as useful for cases when the whole test script is run, since that can just be run multiple times in a row (possibly in parallel) as each run would take a long time to complete anyway. It looks like the right place to add this logic would be in run_test() or run_one_logged() (which would need to log the output from each repetition separately). |
| Comments |
| Comment by Gerrit Updater [ 24/Jan/20 ] |
|
Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/37321 |
| Comment by Gerrit Updater [ 28/Jan/20 ] |
|
Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/37338 |
| Comment by Gerrit Updater [ 14/Feb/20 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/37321/ |
| Comment by Peter Jones [ 14/Feb/20 ] |
|
Landed for 2.14 |
| Comment by Gerrit Updater [ 14/Feb/20 ] |
|
Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/37586 |
| Comment by Gerrit Updater [ 25/Mar/20 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/37586/ |
| Comment by Gerrit Updater [ 14/Apr/20 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/37338/ |