Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-250] Router random shuffling support. https://jira.whamcloud.com/browse/LU-250 Lustre <p>This is the last of the router improvements that where developed at ORNL. This feature allows routes to be randomly placed. Are results show a 20 percent improvement with random shuffling.</p> Lustre routers LU-250

Router random shuffling support.

Improvement Minor Resolved Fixed Lai Siyao James A Simmons Fri, 29 Apr 2011 08:32:40 +0000 Thu, 5 Jan 2012 13:27:28 +0000 Thu, 5 Jan 2012 13:05:17 +0000 Lustre 2.1.0 Lustre 2.2.0 0 3 <p>Original patch at </p> <p><a href="http://review.whamcloud.com/#change,249" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,249</a></p> <p>There was comment by Zhen about what part of the nid address space is used to merge with the random seed.<br/> The current code does </p> <p>if (LNET_NETTYP(LNET_NIDNET(ni->to ni_nid)) != LOLND) <br/> seed<span class="error">[0]</span> ^= LNET_NIDADDR(ni->ni_nid);</p> <p>The issue is that you could end up with a system such as</p> <p>NODE_1: 192.168.1.100@o2ib and 192.168.2.100@tcp;</p> <p>NODE_2: 192.168.1.101@o2ib and 192.168.2.101@tcp;</p> <p>Thus generating the same seed. Zhen what would you recommend to merge with the seed value?</p> <p>James, one option is to use the lnet network number and the LND type to disambiguate the IP addresses. </p> <p>New posted patch with your suggestion at <a href="http://review.whamcloud.com/#change,249" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,249</a></p> <p>Lai</p> <p>Could you please work with Liang to inspect and land this patch form ORNL?</p> <p>Thanks</p> <p>Peter</p> <p>Hi James,</p> <p>You mentioned that "Our results show a 20 percent improvement with random shuffling."</p> <p>Can you point me to more details about it?</p> <p>oThe prblem we were seeing at the lab was a very large number of lnet hash collisions. Adding a random number to the selection progress helped reduce the collisions.</p> <p>I was quite surprised by the 20% number, and was wondering how it was calculated, e.g. what kind of tests done and when (i.e. right after lnet initialization or long after). The 20% seemed quite significant even comparing the new shuffler and no shuffling at all.</p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/red.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = FAILURE<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/router.c</li> <li>lnet/lnet/lib-move.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/router.c</li> <li>lnet/lnet/lib-move.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/router.c</li> <li>lnet/lnet/lib-move.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/router.c</li> <li>lnet/lnet/lib-move.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/router.c</li> <li>lnet/lnet/lib-move.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/407/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #407</a><br/> <a href="https://jira.whamcloud.com/browse/LU-250" title="Router random shuffling support." class="issue-link" data-issue-key="LU-250"><del>LU-250</del></a> lnet: Router random shuffling support (Revision cd46a96e518722547d4b34a393e0e87bf9828e4c)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=cd46a96e518722547d4b34a393e0e87bf9828e4c" class="external-link" target="_blank" rel="nofollow noopener">cd46a96e518722547d4b34a393e0e87bf9828e4c</a><br/> Files : </p> <ul> <li>lnet/lnet/lib-move.c</li> <li>lnet/lnet/router.c</li> </ul> Bugzilla ID 21103.0 Development Rank 1|hzv7of: Rank (Obsolete) 4778