https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-7475 Lustre <p>Using <tt>lnetctl import</tt> produces different results than using <tt>lnet</tt> module parameters. </p> <p>Entry in <tt>lnet.conf</tt> modprobe file:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">options lnet check_routers_before_use=1 \ router_ping_timeout=130 \ dead_router_check_interval=300 \ live_router_check_interval=600\ tiny_router_buffers=8192 \ small_router_buffers=131072 \ large_router_buffers=4096 \ peer_buffer_credits=64 options lnet forwarding=<span class="code-quote">"enabled"</span> </pre> </div></div> <p>Will create the following setup:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"># lnetctl routing show routing: - cpt[0]: tiny: npages: 0 nbuffers: 2048 credits: 2048 mincredits: 2048 small: npages: 1 nbuffers: 32768 credits: 32768 mincredits: 32768 large: npages: 256 nbuffers: 1024 credits: 1024 mincredits: 1024 ...... </pre> </div></div> <p>But, specifying these parameters in <tt>/etc/sysconfig/lnet.conf</tt> does not. Entry in <tt>/etc/sysconfig/lnet.conf</tt>:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">routing: - cpt[0]: tiny: npages: 0 nbuffers: 2048 credits: 2048 mincredits: 2048 small: npages: 1 nbuffers: 32768 credits: 32768 mincredits: 32768 large: npages: 256 nbuffers: 1024 credits: 1024 mincredits: 1024 </pre> </div></div> <p>Result:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"># lnetctl routing show routing: - cpt[0]: tiny: npages: 0 nbuffers: 512 credits: 512 mincredits: 512 small: npages: 1 nbuffers: 4096 credits: 4096 mincredits: 4096 large: npages: 256 nbuffers: 256 credits: 256 mincredits: 256 ...... </pre> </div></div> <p>Are these settings not supported by <tt>lnetctl</tt>, or is using the module parameters still the preferred method?</p> <p>Thanks!<br/> &#8211;<br/> Jesse</p> RHEL 6.6<br/> lustre-client-2.7.1-2.6.32_504.30.3.el6.x86_64_g43f9fd9.x86_64 LU-7475

lnetctl import not honoring nbuffers, credits, or mincredits

Bug Minor Resolved Fixed Amir Shehata Jesse Hanley Tue, 24 Nov 2015 19:57:01 +0000 Sat, 16 Jan 2016 05:05:31 +0000 Mon, 14 Dec 2015 05:29:05 +0000 Lustre 2.7.0 Lustre 2.8.0 0 8 <p>The syntax to configure buffers from YAML is:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">routing: enable: 1 buffers: tiny: 8192 small: 131072 large: 4096 </pre> </div></div> <p>Amir, it should be possible to take the output of lnetctl show and use that as the input (i.e. the input and output should describe the same parameters in the same way).</p> <p>Thanks for the info Amir. I just tested it and it appears to work as expected. Does this just mean that the buffers section should be added to <tt>lnetctl export</tt> and to the man page?</p> <p>I think the best way to do it is to sum up the output of the routing YAML block for each of the tiny/small/large buffers and add it in the show block as the buffers section. I think we need to do that because if you have multiple CPTs in the system, then when you show routing, each CPT will show the number of buffers assigned to it. But if you want to use the output to configure and get the exact same result, the total number of buffers should be fed back to LNet, and the only way to do that is to sum up the buffers for all the CPTs. Technically, you can do that in the LNet module, but I would rather keep these type of calculations in user space.</p> <p>I'll create a patch for this.</p> <p>Amir Shehata (amir.shehata@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/17370" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/17370</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-7475" title="lnetctl import not honoring nbuffers, credits, or mincredits " class="issue-link" data-issue-key="LU-7475"><del>LU-7475</del></a> lnet: ensure buffer config symmetry<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 5f7939976652e16bdc9eb4b5dcbe023fc75f80ea</p> <p>Thanks Amir.</p> <p>Will this also allow us to set the lnet params for <tt>check_routers_before_use</tt>, <tt>avoid_asym_router_failure</tt>, <tt>live_router_check_interval</tt>, <tt>dead_router_check_interval</tt>, and <tt>router_ping_timeout</tt>, or will we still need to use a modprofile file for this?</p> <p>Thanks again,<br/> &#8211;<br/> Jesse</p> <p>Currently there is no way to set those values outside of the modprobe config file <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/sad.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/17370/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/17370/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-7475" title="lnetctl import not honoring nbuffers, credits, or mincredits " class="issue-link" data-issue-key="LU-7475"><del>LU-7475</del></a> lnet: ensure buffer config symmetry<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: e48f5a556f05e8dd6f2ffc57ad7c1220c24c9be1</p> <p>Landed for .2.8</p> Related Development Rank 1|hzxu7z: Rank (Obsolete) 9223372036854775807 Severity