https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8899 Lustre <p>As an engineer, when autotest starts over from hanging on a particular test, it should start from the next test rather than starting over completely, so that the time to get through the entire test suite is not as long.</p> <p>QUESTION: IN TT-926, WE ASK THAT WHEN A TEST FAILS WE STOP TESTING AND NOT CONTINUE TO NEXT TEST. IS THIS CONTRADICTING THAT REQUEST?</p> LU-8899

Restart test-group from next test when a test hangs

Improvement Major Resolved Low Priority Charlie Olmstead Chris Gearing groomed-lustre-test triaged Mon, 29 Oct 2012 16:04:00 +0000 Tue, 6 Jul 2021 18:55:17 +0000 Tue, 6 Jul 2021 18:55:17 +0000 3 7 <blockquote><p>QUESTION: IN TT-926, WE ASK THAT WHEN A TEST FAILS WE STOP TESTING AND NOT CONTINUE TO NEXT TEST. IS THIS CONTRADICTING THAT REQUEST?</p></blockquote> <p>No contradiction. This ticket is typically required for build/release testing sessions, which need cover as many tests as possible.</p> <p>E.g., in the following "full" test group session, test 23b hung. The requirement is that after the nodes are rebooted, autotest can start testing test 24,25,26, etc. instead of skipping them. <br/> <a href="https://maloo.whamcloud.com/test_sets/9b37618e-41db-11e2-adcf-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/9b37618e-41db-11e2-adcf-52540035b04c</a></p> <p>Confirmed with Yu Jian that this change could save quite a lot of time in testing. Depending on when the test hangs and how many subtests are remaining. The remaining subtests must be run manually in order to be tested at all. So if the person testing does not run the tests, then that coverage is lost.</p> <p>wIll be part of upgrade</p> <p>this is related to the modularization effort</p> <p>Reopening into TEI backlog</p> <p>This should be an option in the Lustre test-framework, not the responsibility of Autotest.</p> <p>Hi Charlie,<br/> After a subtest hangs, the test nodes usually need to be rebooted or re-provisioned by autotest system, which could not be done by Lustre test framework. Autotest knows which subtest hangs, and can just start running the next subtest by performing auster with "--start-at" option.</p> <p>I understand the Lustre test-framework isn't responsible for rebooting/re-provisioning the nodes. Once a test hangs, Autotest would re-provision the group of nodes and then call auster with a flag to restart the tests from where it left off. The Lustre TF is responsible for writing the results.yml file it should also be responsible for knowing where it should resume from when this flag is given.</p> <blockquote> <p>The Lustre TF is responsible for writing the results.yml file it should also be responsible for knowing where it should resume from when this flag is given.</p></blockquote> <p>For writing the results.yml file, init_logging() called by each test suite (e.g., sanity.sh, sanityn.sh, etc.) does that.<br/> For knowing where it should resume, "--start-at" option for auster does that.</p> <p>The --start-at option only applies to test suites listed in the command and does not apply to the "-g GROUP Test group file (Overrides tests listed on command line)" option which Autotest uses. Can this be changed to apply when -g is used? It would need to factor in the value of the -S option as well.</p> Related Business Value 7.0 Development Project Rank 1|hzub3r: Rank (Obsolete) 5338 Sprint DCO-2016_Jun20_Jul10 Story Points 5.0