https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-17322 Lustre <p>Scripts like auster and llmount.sh, while useful, are limited in their capabilities. It would be useful a tool which could automatically setup test VMs (via QEMU or otherwise) with various kernel and Lustre versions (or native Linux Lustre client).</p> <p>Other possible features could include environment validation, automatically installing Lustre on remote nodes, better LUTF integration, better xfstest integration, run sanity suites in parallel.</p> <p>This ticket tracks various patches contributing towards such a tool.</p> LU-17322

Alternative testing wrappers/tools

Improvement Minor Open Unresolved Tim Day Tim Day Tue, 28 Nov 2023 18:16:48 +0000 Wed, 13 Dec 2023 12:19:37 +0000 0 3 <p>"Timothy Day &lt;timday@amazon.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/53271" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/53271</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-17322" title="Alternative testing wrappers/tools" class="issue-link" data-issue-key="LU-17322">LU-17322</a> auster: move functions to test-framework.sh<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: af899aaeb09524ce9b8feca4bfc79590aec0c10c</p> <p>Tim,</p> <p>This sounds like a great idea, but my past experience with a similar effort (never made public) was it ended up with a very large degree of environment and tool dependency/specificity, too much so to be very useful in to most people and hard to maintain except for one environment.  So this ends up being something each group testing Lustre tends to roll for themselves.  Any thoughts on how you'd avoid some of those pitfalls here?  (There may be benefits to working toward this even if the whole thing isn't useful outside of a specific environment.)</p> <p>I think there's two big goals that testing tools aim to achieve:</p> <ul> <li>Setting up test infrastructure</li> <li>Running tests</li> </ul> <p>I think the test running code for Lustre is fine. The wrapper I'm writing mimics the auster pretty closely. I think that can largely stay the same (although it could be made easier to use).</p> <p> </p> <p>The current tooling doesn't really help with setting up a test environment. Running everything on a single node isn't always helpful for testing. My main goal is to have a way to provision nodes automatically - and to deploy software to those nodes automatically. I'm going to write it in such a way that people could write their own node deployment plugins.</p> <p> </p> <p>I'm going to start with QEMU. The only additional dependency for that should be QEMU itself, so I think that should work on all of the major distros. I'll have to test it out, though.</p> <p> </p> <p>One major goal of this work is to make it easier to test the upstream client. I want to be able to run a sanity test against the upstream client in QEMU by running one command. Other projects have done something similar:</p> <ul> <li>Used by main bcachefs developer for regression testing: <a href="https://github.com/koverstreet/ktest" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/koverstreet/ktest</a></li> <li>Linux user-space testing using QEMU: <a href="https://elinux.org/Ktest" class="external-link" target="_blank" rel="nofollow noopener">https://elinux.org/Ktest</a></li> <li>Linux kernel-space unit testing using UML or QEMU: <a href="https://docs.kernel.org/dev-tools/kunit/run_wrapper.html#running-tests-on-qemu" class="external-link" target="_blank" rel="nofollow noopener">https://docs.kernel.org/dev-tools/kunit/run_wrapper.html#running-tests-on-qemu</a></li> </ul> <p> </p> <p>"Timothy Day &lt;timday@amazon.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/53415" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/53415</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-17322" title="Alternative testing wrappers/tools" class="issue-link" data-issue-key="LU-17322">LU-17322</a> yalt: Yet Another Lustre Tester<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 8a1cfec1d6518382ab0cfdabc327afc2277101aa</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/53271/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/53271/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-17322" title="Alternative testing wrappers/tools" class="issue-link" data-issue-key="LU-17322">LU-17322</a> auster: move functions to test-framework.sh<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 27e1ecb19cef4f04ab56727f2382cf228b368ad2</p> Development Rank 1|i04333: Rank (Obsolete) 9223372036854775807 Severity