<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 02:50:42 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-12222] LNet should select loopback NI when possible</title>
                <link>https://jira.whamcloud.com/browse/LU-12222</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;I happened to notice that when mounting an MGT and MDT co-located on the same node that we end up sending RPCs to ourselves:&lt;/p&gt;

&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;00000100:00000040:11.0:1556165595.786175:0:30688:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff881f275f8000 x1631757890748560/t0(0) o502-&amp;gt;MGC10.12.0.50@o2ib40@10.12.0.50@o2ib40:26/25 lens 272/8472 e 0 to 0 dl 1556165690 ref 3 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000001:11.0:1556165595.786177:0:30688:0:(niobuf.c:54:ptl_send_buf()) Process entered
00000100:00000040:11.0:1556165595.786177:0:30688:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.12.0.50@o2ib40
00000400:00000010:11.0:1556165595.786178:0:30688:0:(lib-lnet.h:221:lnet_md_alloc()) slab-alloced &apos;md&apos; of size 136 at ffff881f279d26e8.
00000100:00000200:11.0:1556165595.786178:0:30688:0:(niobuf.c:85:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1631757890748560, offset 0
00000400:00000010:11.0:1556165595.786179:0:30688:0:(lib-lnet.h:472:lnet_msg_alloc()) alloc &apos;(msg)&apos;: 440 at ffff881f279c3200 (tot 331800384).
00000400:00000200:11.0:1556165595.786181:0:30688:0:(lib-move.c:4637:LNetPut()) LNetPut -&amp;gt; 12345-10.12.0.50@o2ib40
00000400:00000200:11.0:1556165595.786183:0:30688:0:(lib-move.c:2545:lnet_handle_send_case_locked()) Source ANY to MR:  10.12.0.50@o2ib40 local destination
00000400:00000200:11.0:1556165595.786184:0:30688:0:(lib-move.c:1619:lnet_get_best_ni()) compare ni 0@lo [c:0, d:10, s:0] with best_ni not seleced [c:-2147483648, d:-1, s:0]
00000400:00000200:11.0:1556165595.786185:0:30688:0:(lib-move.c:1662:lnet_get_best_ni()) selected best_ni 0@lo
00000400:00000200:11.0:1556165595.786186:0:30688:0:(lib-move.c:1619:lnet_get_best_ni()) compare ni 10.12.0.50@o2ib40 [c:2045, d:10, s:26] with best_ni 0@lo [c:0, d:10, s:0]
00000400:00000200:11.0:1556165595.786188:0:30688:0:(lib-move.c:1662:lnet_get_best_ni()) selected best_ni 10.12.0.50@o2ib40
00000400:00000200:11.0:1556165595.786188:0:30688:0:(lib-move.c:1367:lnet_select_peer_ni()) 10.12.0.50@o2ib40 ni_is_pref = 0
00000400:00000200:11.0:1556165595.786189:0:30688:0:(lib-move.c:1428:lnet_select_peer_ni()) sd_best_lpni = 10.12.0.50@o2ib40
00000400:00000200:11.0:1556165595.786192:0:30688:0:(lib-move.c:1837:lnet_handle_send()) TRACE: 10.12.0.50@o2ib40(10.12.0.50@o2ib40:&amp;lt;?&amp;gt;) -&amp;gt; 10.12.0.50@o2ib40(10.12.0.50@o2ib40:10.12.0.50@o2ib40) : PUT try# 0&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;In the above excerpt we can see that LNet has enough information to determine that we&apos;re sending this to ourselves (the nid of best_ni == the nid of best_lpni). Ideally we&apos;d just use the loopback NI whenever possible.&lt;/p&gt;</description>
                <environment></environment>
        <key id="55485">LU-12222</key>
            <summary>LNet should select loopback NI when possible</summary>
                <type id="4" iconUrl="https://jira.whamcloud.com/secure/viewavatar?size=xsmall&amp;avatarId=11310&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.whamcloud.com/images/icons/priorities/major.svg">Major</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="1">Fixed</resolution>
                                        <assignee username="shadow">Alexey Lyashkov</assignee>
                                    <reporter username="hornc">Chris Horn</reporter>
                        <labels>
                            <label>HPv3</label>
                    </labels>
                <created>Thu, 25 Apr 2019 04:46:25 +0000</created>
                <updated>Wed, 9 Dec 2020 21:08:16 +0000</updated>
                            <resolved>Wed, 20 May 2020 13:57:12 +0000</resolved>
                                    <version>Lustre 2.12.0</version>
                    <version>Lustre 2.13.0</version>
                                    <fixVersion>Lustre 2.14.0</fixVersion>
                    <fixVersion>Lustre 2.12.6</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>8</watches>
                                                                            <comments>
                            <comment id="246349" author="adilger" created="Thu, 25 Apr 2019 14:19:48 +0000"  >&lt;p&gt;This seems pretty important. It could cause problems with local communication on the MDS or OSS under load. &lt;/p&gt;</comment>
                            <comment id="246351" author="pfarrell" created="Thu, 25 Apr 2019 14:25:17 +0000"  >&lt;p&gt;Chris,&lt;/p&gt;

&lt;p&gt;Are you planning a patch for this?&lt;/p&gt;</comment>
                            <comment id="246359" author="hornc" created="Thu, 25 Apr 2019 16:45:39 +0000"  >&lt;p&gt;I was, but Amir tells me that he relies on this behavior for recovery. If he can provide some more details on what he means by that then I can work out a patch, otherwise I&apos;m fine to let Amir work it out himself.&lt;/p&gt;</comment>
                            <comment id="246361" author="pfarrell" created="Thu, 25 Apr 2019 17:02:25 +0000"  >&lt;p&gt;OK, thanks!&#160; Was just curious.&lt;/p&gt;</comment>
                            <comment id="252975" author="gerrit" created="Mon, 12 Aug 2019 22:58:24 +0000"  >&lt;p&gt;Chris Horn (hornc@cray.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/35778&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/35778&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Check if we&apos;re sending to ourselves&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: ee8e5be8951ed60d25b3aeae563a0f54cde59ea7&lt;/p&gt;</comment>
                            <comment id="260177" author="gerrit" created="Fri, 20 Dec 2019 03:25:28 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/35778/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/35778/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Check if we&apos;re sending to ourselves&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: e4af756e1f428a9f7883bf883f66941defb1447f&lt;/p&gt;</comment>
                            <comment id="260203" author="pjones" created="Fri, 20 Dec 2019 03:48:32 +0000"  >&lt;p&gt;Landed for 2.14&lt;/p&gt;</comment>
                            <comment id="260339" author="shadow" created="Mon, 23 Dec 2019 12:00:45 +0000"  >&lt;p&gt;In fact this is invalid fix, with performance impact.&lt;br/&gt;
based on hits provided by Chirs, I able to replicate this issue and it looks like a ptlrpc bug.&lt;/p&gt;

&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;00000400:00000200:5.0:1577100140.229954:0:10627:0:(peer.c:1215:LNetPrimaryNID()) NID 0@lo primary NID 198.18.0.33@tcp rc 0
00000100:00000010:5.0:1577100140.229963:0:10627:0:(connection.c:55:ptlrpc_connection_get()) kmalloced &apos;(conn)&apos;: 88 at ffff942f2df04518.
00000100:00000001:5.0:1577100140.229965:0:10627:0:(connection.c:80:ptlrpc_connection_get()) Process leaving
00000100:00000040:5.0:1577100140.229966:0:10627:0:(connection.c:84:ptlrpc_connection_get()) conn=ffff942f2df04518 refcount 2 to 198.18.0.33@tcp
00000100:00000040:5.0:1577100140.229967:0:10627:0:(client.c:107:ptlrpc_uuid_to_connection()) MGC198.18.0.33@tcp_0 -&amp;gt; ffff942f2df04518
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;ptlrpc_uuid_to_connection - don&apos;t able to understand this is local NID and provide a replacement as needs.&lt;/p&gt;</comment>
                            <comment id="260340" author="shadow" created="Mon, 23 Dec 2019 12:21:06 +0000"  >&lt;p&gt;In fact this MR bug.&lt;br/&gt;
ptlrpc_uuid_to_peer - correctly resolved 198.18.0.33@tcp as local address, and it replaced to 0@lo, but &lt;br/&gt;
ptlrpc_connection_get have call a LNetPrimaryNID on top, and it call make this replacement away.&lt;/p&gt;</comment>
                            <comment id="261286" author="hornc" created="Wed, 15 Jan 2020 21:16:29 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.whamcloud.com/secure/ViewProfile.jspa?name=pjones&quot; class=&quot;user-hover&quot; rel=&quot;pjones&quot;&gt;pjones&lt;/a&gt; &lt;a href=&quot;https://jira.whamcloud.com/secure/ViewProfile.jspa?name=green&quot; class=&quot;user-hover&quot; rel=&quot;green&quot;&gt;green&lt;/a&gt; Since my fix for this issue has a bad interaction with the fix for &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12889&quot; title=&quot;Do not assume peers are MR capable&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12889&quot;&gt;&lt;del&gt;LU-12889&lt;/del&gt;&lt;/a&gt; I think we should revert it. The &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12889&quot; title=&quot;Do not assume peers are MR capable&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12889&quot;&gt;&lt;del&gt;LU-12889&lt;/del&gt;&lt;/a&gt; bug is more serious, and per Shadow&apos;s last couple comments in this ticket, he thinks we can resolve this issue in a different way. What do you think?&lt;/p&gt;</comment>
                            <comment id="261310" author="green" created="Thu, 16 Jan 2020 02:03:40 +0000"  >&lt;p&gt;since &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12889&quot; title=&quot;Do not assume peers are MR capable&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12889&quot;&gt;&lt;del&gt;LU-12889&lt;/del&gt;&lt;/a&gt; is not yet landed, you can submit a series consisting of reversal and then &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12889&quot; title=&quot;Do not assume peers are MR capable&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12889&quot;&gt;&lt;del&gt;LU-12889&lt;/del&gt;&lt;/a&gt; on top of it (or a single patch that reverts just the needed bits if desirable) with necessary explanations and all.&lt;/p&gt;</comment>
                            <comment id="261346" author="hornc" created="Thu, 16 Jan 2020 17:46:47 +0000"  >&lt;p&gt;Okay, that sounds like a plan. Thanks.&lt;/p&gt;</comment>
                            <comment id="261353" author="gerrit" created="Thu, 16 Jan 2020 19:48:56 +0000"  >&lt;p&gt;Chris Horn (hornc@cray.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/37259&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/37259&lt;/a&gt;&lt;br/&gt;
Subject: Revert &quot;&lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Check if we&apos;re sending to ourselves&quot;&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: ee971ecfbeb4a8192e4ab0e2762048a89a31e339&lt;/p&gt;</comment>
                            <comment id="261367" author="adilger" created="Thu, 16 Jan 2020 22:38:12 +0000"  >&lt;blockquote&gt;
&lt;p&gt;In fact this MR bug.&lt;br/&gt;
ptlrpc_uuid_to_peer - correctly resolved 198.18.0.33@tcp as local address, and it replaced to 0@lo, but&lt;br/&gt;
ptlrpc_connection_get have call a LNetPrimaryNID on top, and it call make this replacement away.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.whamcloud.com/secure/ViewProfile.jspa?name=shadow&quot; class=&quot;user-hover&quot; rel=&quot;shadow&quot;&gt;shadow&lt;/a&gt; - thanks for the clear analysis.  We definitely don&apos;t want to be sending messages destined for ourselves out over the network.  I&apos;m not sure what the semantics for &lt;tt&gt;LNetPrimaryNID()&lt;/tt&gt; are.  Should the &lt;tt&gt;0@lo&lt;/tt&gt; NID be handled specifically in that function, or would it be better to skip that function in &lt;tt&gt;ptlrpc_connection_get()&lt;/tt&gt; and keep &lt;tt&gt;0@lo&lt;/tt&gt; as the target NID?  &lt;/p&gt;</comment>
                            <comment id="261395" author="shadow" created="Fri, 17 Jan 2020 04:39:19 +0000"  >&lt;p&gt;Andreas, From my view, exceptions should be on lower level as possible - to avoid similar bugs in future, in case ptlrpc code will changed and someone forget why this exceptions was made.&lt;/p&gt;</comment>
                            <comment id="261397" author="adilger" created="Fri, 17 Jan 2020 06:47:58 +0000"  >&lt;p&gt;Shadow, I was thinking that &lt;tt&gt;LNetPrimaryNID()&lt;/tt&gt; might be called to map &lt;tt&gt;0@lo&lt;/tt&gt; to the primary external NID for other reasons.  However, it looks like there is only one caller of this function, in &lt;tt&gt;ptlrpc_connection_get()&lt;/tt&gt;, so changing the semantic to just return &lt;tt&gt;0@lo&lt;/tt&gt; immediately is pretty safe.  I don&apos;t mind to add a fast path in both &lt;tt&gt;LNetPrimaryNID()&lt;/tt&gt; and &lt;tt&gt;ptlrpc_connection_get()&lt;/tt&gt; that special-case this NID to avoid overhead (e.g. skipping &lt;tt&gt;lnet_net_lock_current()&lt;/tt&gt; and maybe avoiding the need to look up the peer connection?).&lt;/p&gt;

&lt;p&gt;It probably also makes sense to &lt;tt&gt;#define LNET_NID_LO_0&lt;/tt&gt; (or similar) like we do for &lt;tt&gt;LNET_NID_ANY&lt;/tt&gt; so that we don&apos;t have to compose this every time.  That could also be used in other places, like &lt;tt&gt;infra_ping_nid()&lt;/tt&gt; rather than turning it into a string and comparing that much more efficiently in that loop:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt;
-                        &lt;span class=&quot;code-keyword&quot;&gt;if&lt;/span&gt; (!strcmp(libcfs_nid2str(ping.ping_buf[i].nid),
-                                    &lt;span class=&quot;code-quote&quot;&gt;&quot;0@lo&quot;&lt;/span&gt;))
+                       &lt;span class=&quot;code-keyword&quot;&gt;if&lt;/span&gt; (ping.ping_buf[i].nid == LNET_NID_LO_0))
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</comment>
                            <comment id="261617" author="adilger" created="Wed, 22 Jan 2020 07:07:39 +0000"  >&lt;p&gt;Any comments from LNet developers on a global &lt;tt&gt;LNET_NID_LO_0&lt;/tt&gt; constant to indicate &quot;myself&quot;?&lt;/p&gt;</comment>
                            <comment id="262378" author="gerrit" created="Sat, 1 Feb 2020 08:10:21 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/37259/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/37259/&lt;/a&gt;&lt;br/&gt;
Subject: Revert &quot;&lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Check if we&apos;re sending to ourselves&quot;&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 275016fcae729f8467dc09aa15aa2b4bb2690875&lt;/p&gt;</comment>
                            <comment id="268175" author="hornc" created="Tue, 21 Apr 2020 20:15:11 +0000"  >&lt;blockquote&gt;&lt;p&gt;Any comments from LNet developers on a global LNET_NID_LO_0 constant to indicate &quot;myself&quot;?&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.whamcloud.com/secure/ViewProfile.jspa?name=adilger&quot; class=&quot;user-hover&quot; rel=&quot;adilger&quot;&gt;adilger&lt;/a&gt; Sounds like a good idea to me.&lt;/p&gt;</comment>
                            <comment id="268282" author="gerrit" created="Wed, 22 Apr 2020 18:52:09 +0000"  >&lt;p&gt;Chris Horn (chris.horn@hpe.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/38312&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38312&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Introduce constant for the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 620d738ec490c1fc475f6e2312f2290800051705&lt;/p&gt;</comment>
                            <comment id="268283" author="gerrit" created="Wed, 22 Apr 2020 18:52:10 +0000"  >&lt;p&gt;Chris Horn (chris.horn@hpe.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/38313&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38313&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Primary NID of lolnd NID is the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: c11c50152cffea9e05fc8124f7b988fae828f1e4&lt;/p&gt;</comment>
                            <comment id="268653" author="gerrit" created="Mon, 27 Apr 2020 15:12:24 +0000"  >&lt;p&gt;Chris Horn (chris.horn@hpe.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/38388&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38388&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; ptlrpc: Check if NID is local, not just lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: b17862a23870bc3be8f24ae9441dab316cfac611&lt;/p&gt;</comment>
                            <comment id="268899" author="hornc" created="Wed, 29 Apr 2020 21:14:25 +0000"  >
&lt;p&gt;Without the fix, performing llmount.sh with -1 debug:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep PTLDEBUG cfg/local.sh
PTLDEBUG=${PTLDEBUG:--1}
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # ./llmount.sh
...
Setting lustre.sys.jobid_var from disable to procname_uid
Waiting 90 secs for update
Updated after 4s: wanted &apos;procname_uid&apos; got &apos;procname_uid&apos;
disable quota as required
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # lctl dk &amp;gt; /tmp/dk.log
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;Of interest are the messages with &quot;TRACE&quot; string. There are two types: lnet_parse() for incoming and lnet_handle_send() for outgoing:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep -m 1 lnet_parse
00000400:00000200:19.0:1587582336.656655:0:12299:0:(lib-move.c:4290:lnet_parse()) TRACE: 0@lo(0@lo) &amp;lt;- 0@lo : GET - for me
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep -m 1 lnet_handle_send
00000400:00000200:21.0:1587582336.657784:0:12301:0:(lib-move.c:1853:lnet_handle_send()) TRACE: 192.168.2.20@tcp(192.168.2.20@tcp:&amp;lt;?&amp;gt;) -&amp;gt; 192.168.2.20@tcp(192.168.2.20@tcp:192.168.2.20@tcp) &amp;lt;?&amp;gt; : PUT try# 0
sles15build01:/home/hornc/lustre-filesystem/lustre/tests #
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;Since this is a single node setup, all traffic should be sent via lolnd, but we can see that is not the case:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep -c TRACE /tmp/dk.log
887
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep -c 0@lo
4
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep -vc 0@lo
883
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep 0@lo
00000400:00000200:19.0:1587582336.656655:0:12299:0:(lib-move.c:4290:lnet_parse()) TRACE: 0@lo(0@lo) &amp;lt;- 0@lo : GET - for me
00000400:00000200:19.0:1587582336.656681:0:12299:0:(lib-move.c:4290:lnet_parse()) TRACE: 0@lo(0@lo) &amp;lt;- 0@lo : REPLY - for me
00000400:00000200:19.0:1587582336.656763:0:12299:0:(lib-move.c:4290:lnet_parse()) TRACE: 0@lo(0@lo) &amp;lt;- 0@lo : PUT - for me
00000400:00000200:19.0:1587582336.656801:0:12299:0:(lib-move.c:4290:lnet_parse()) TRACE: 0@lo(0@lo) &amp;lt;- 0@lo : ACK - for me
sles15build01:/home/hornc/lustre-filesystem/lustre/tests #
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;In fact only 4 messages were sent over lolnd.&lt;/p&gt;

&lt;p&gt;Doing the same thing with the fix we can see all messages use the lolnd:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep -c TRACE /tmp/dk.log
462
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep -c 0@lo
462
sles15build01:/home/hornc/lustre-filesystem/lustre/tests # grep TRACE /tmp/dk.log | grep -vc 0@lo
0
sles15build01:/home/hornc/lustre-filesystem/lustre/tests #
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</comment>
                            <comment id="269495" author="gerrit" created="Thu, 7 May 2020 05:42:57 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/38312/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38312/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Introduce constant for the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 56203e4ba0a64789e42ea45946e8c51f1db351fb&lt;/p&gt;</comment>
                            <comment id="269496" author="gerrit" created="Thu, 7 May 2020 05:43:01 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/38313/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38313/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Primary NID of lolnd NID is the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 33d2e44e5026f1e9162dd5e6b931085fdc035a34&lt;/p&gt;</comment>
                            <comment id="270333" author="ashehata" created="Fri, 15 May 2020 15:36:44 +0000"  >&lt;p&gt;An exception to this is recovery messages. Recovery messages can not use the lolnd as that breaks the purpose of the attempt to ascertain the health of a local interface.&lt;/p&gt;</comment>
                            <comment id="270661" author="gerrit" created="Wed, 20 May 2020 08:23:23 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/38388/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38388/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; ptlrpc: Check if NID is local, not just lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 95bcc24642c4b95d093407fef0947ee2f5a2c01a&lt;/p&gt;</comment>
                            <comment id="270713" author="pjones" created="Wed, 20 May 2020 13:57:12 +0000"  >&lt;p&gt;Landed for 2.14&lt;/p&gt;</comment>
                            <comment id="272247" author="gerrit" created="Mon, 8 Jun 2020 14:03:13 +0000"  >&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;Deleted&amp;#93;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="272248" author="gerrit" created="Mon, 8 Jun 2020 14:03:14 +0000"  >&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;Deleted&amp;#93;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="272249" author="gerrit" created="Mon, 8 Jun 2020 14:03:15 +0000"  >&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;Deleted&amp;#93;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="272300" author="gerrit" created="Mon, 8 Jun 2020 19:18:24 +0000"  >&lt;p&gt;Chris Horn (chris.horn@hpe.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/38863&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38863&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Introduce constant for the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_12&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: a0bb5d5f52414dcfc95bfa699c5d800c1d7daa7a&lt;/p&gt;</comment>
                            <comment id="272301" author="gerrit" created="Mon, 8 Jun 2020 19:18:24 +0000"  >&lt;p&gt;Chris Horn (chris.horn@hpe.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/38864&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38864&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Primary NID of lolnd NID is the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_12&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 7e924bc9a53ad82a0c4e6da4084e4de8536e4ada&lt;/p&gt;</comment>
                            <comment id="272302" author="gerrit" created="Mon, 8 Jun 2020 19:18:25 +0000"  >&lt;p&gt;Chris Horn (chris.horn@hpe.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/38865&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38865&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; ptlrpc: Check if NID is local, not just lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_12&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 35c6cfeec9d5b9a354bc49319694d2360c48c68c&lt;/p&gt;</comment>
                            <comment id="276990" author="gerrit" created="Fri, 7 Aug 2020 21:13:31 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/38863/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38863/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Introduce constant for the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_12&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: b5fb6f1fe6dedca0ba6e405e90d7ec72d9b97e83&lt;/p&gt;</comment>
                            <comment id="276991" author="gerrit" created="Fri, 7 Aug 2020 21:13:36 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/38864/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38864/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; lnet: Primary NID of lolnd NID is the lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_12&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 4494f55aa2fe7d2ae274405fc0f2314193db1c0e&lt;/p&gt;</comment>
                            <comment id="276992" author="gerrit" created="Fri, 7 Aug 2020 21:14:19 +0000"  >&lt;p&gt;Oleg Drokin (green@whamcloud.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/38865/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/38865/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-12222&quot; title=&quot;LNet should select loopback NI when possible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-12222&quot;&gt;&lt;del&gt;LU-12222&lt;/del&gt;&lt;/a&gt; ptlrpc: Check if NID is local, not just lolnd NID&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_12&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 7635e6326de88bfd035c82ac9261e90e4f9b4a1b&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Related</name>
                                            <outwardlinks description="is related to ">
                                                        </outwardlinks>
                                                                <inwardlinks description="is related to">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                            <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i00fbz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>