https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-728 Lustre <p>With the testing of large stripe count with the lustre test suite creating a list of OSTDEV and oss host can become very large so to simply this I implement pdsh HOSTLIST for the test suite configuration file. For example instead of ost1_HOST=foo1;ost2_HOST=foo2,etc you can do a simple ost_HOST=${ost_HOST:<del>"foo<span class="error">&#91;1-n&#93;</span>"}. Also with the power of HOSTLIST combos like ost_HOST=${ost_HOST:</del>"foo<span class="error">&#91;1-3,4,9-20&#93;</span>"} are possible. Many forms of HOSTLIST have been tested in our test beds. Can be expanded later to devices as well as host.</p> Lustre nodes running auster suite LU-728

pdsh HOSTLIST expression support in test sutie

Bug Minor Resolved Fixed Minh Diep James A Simmons Mon, 3 Oct 2011 11:50:54 +0000 Tue, 27 Mar 2012 23:05:17 +0000 Wed, 4 Jan 2012 09:05:01 +0000 Lustre 2.2.0 Lustre 2.2.0 0 2 <p>Yu Jian</p> <p>I think that this one will be of interest to you</p> <p>Peter</p> <p>Patch at <a href="http://review.whamcloud.com/#change,1462" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,1462</a></p> <p>reassigning to Minh</p> <p>James,</p> <p>please correct me if I am wrong but the patch you upload is about RCLIENTS and nothing to do with ost_HOST. I don't believe we can apply the hostlist_expand to any of the server names which are in the form ost#_HOST = hostname. If you agree, please change the description to reflect what the patch does</p> <p>Thanks</p> <p>You can by using get_nodes. I will include that in the next patch. The problem with the RCLIENTS and CLIENTS list is the comma list and non comma list. Its unclear in ncli for those list to have the values seperated by a comma or not. Simple example-</p> <p>ncli.sh <br/> -----------------------------------------<br/> CLIENT1=${CLIENT1:-`hostname`}<br/> SINGLECLIENT=$CLIENT1</p> <ol> <li>Note spoon01 is local host, should be filtered out.<br/> RCLIENTS=${RCLIENTS:-"spoon01 spoon03"}<br/> -----------------------------------------</li> </ol> <p>From my test file </p> <p>echo "CLIENTS=$CLIENTS RCLIENTS=$RCLIENTS"<br/> FAIL_LIST=($RCLIENTS)<br/> FAIL_NUM=${#FAIL_LIST<span class="error">&#91;*&#93;</span>}<br/> echo "FAIL_NUM=$FAIL_NUM"<br/> echo "CLIENT2 = $CLIENT2"</p> <p>I get...</p> <p>CLIENTS=spoon01,spoon03 RCLIENTS=spoon01 spoon03<br/> FAIL_NUM=2<br/> CLIENT2 = spoon03</p> <p>Now if you have a comma in the RCLIENTS then FAIL_NUM=1. Also `hostname` is spoon1 yet it ends up in RCLIENTS. Commas are also a issue in the simple loop</p> <p>for client in $CLIENTS; do<br/> echo "$client !!!!"<br/> done</p> <p>Which prints spoon01,spoon03 !!!! This is also wrong.</p> <p>The next patch will greatly simpliy this handling.</p> <p>The last patch should sort the client list out with or without commas. Also the example I gave from insanity doesn't handle the comma listing of RCLIENT well. From what I can tell all host list are expected to have commas normally.</p> <p>"The problem with the RCLIENTS and CLIENTS list is the comma list and non comma list. Its unclear in ncli for those list to have the values seperated by a comma or not."</p> <p>We should make it work for both.</p> <p>There is also an issue with hostname return with domain name (ie. host.local) and this will not be filtered out</p> <p>Great, because this patch allows both in the client list. I looked at the value of $HOSTNAME to discover that it always does not have the domain name. We could always go with the short name (hostname -s) but is that what we want? Consider the case of WAN support. On last thing that I want to fix up is facet_active. That is a lot of file at a very large scale when testing large stripe count support. Their has to be a better way.</p> <p>Since get_nodes needs more work I can remove it from this patch and include it in a later patch. Looking at the code the best way to handle a node list is without commas. If we need a comma list a function exist to do that. I will posta updated patch that makes the node list without commas.</p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Landed for 2.2</p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/398/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #398</a><br/> <a href="https://jira.whamcloud.com/browse/LU-728" title="pdsh HOSTLIST expression support in test sutie" class="issue-link" data-issue-key="LU-728"><del>LU-728</del></a> tests: pdsh HOSTLIST test suite support (Revision f6d84d790c63bc200f8f25ac40b3f72321f62190)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=f6d84d790c63bc200f8f25ac40b3f72321f62190" class="external-link" target="_blank" rel="nofollow noopener">f6d84d790c63bc200f8f25ac40b3f72321f62190</a><br/> Files : </p> <ul> <li>lustre/tests/test-framework.sh</li> </ul> Development Rank 1|hzv7rj: Rank (Obsolete) 4792