https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-10245 Lustre <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@fre805 tests]# cat /sys/devices/system/cpu/online 0-1 [root@fre805 tests]# lnetctl net show --verbose net: - net type: lo local NI(s): - nid: 0@lo status: up statistics: send_count: 0 recv_count: 0 drop_count: 0 tunables: peer_timeout: 0 peer_credits: 0 peer_buffer_credits: 0 credits: 0 lnd tunables: tcp bonding: 0 dev cpt: 0 CPT: <span class="code-quote">"[0]"</span> - net type: tcp local NI(s): - nid: 192.168.108.5@tcp status: up interfaces: 0: eth0 statistics: send_count: 276723 recv_count: 316655 drop_count: 0 tunables: peer_timeout: 180 peer_credits: 8 peer_buffer_credits: 0 credits: 256 lnd tunables: tcp bonding: 0 dev cpt: -1 CPT: <span class="code-quote">"[0]"</span> - nid: 192.168.118.5@tcp status: up interfaces: 0: eth1 statistics: send_count: 0 recv_count: 0 drop_count: 0 tunables: peer_timeout: 180 peer_credits: 8 peer_buffer_credits: 0 credits: 256 lnd tunables: tcp bonding: 0 dev cpt: -1 CPT: <span class="code-quote">"[0]"</span> [root@fre805 tests]# [root@fre805 tests]# lnetctl net add --net tcp --<span class="code-keyword">if</span> eth2 --cpt [0, 1] [root@fre805 tests]# lnetctl net show --verbose net: - net type: lo local NI(s): - nid: 0@lo status: up statistics: send_count: 0 recv_count: 0 drop_count: 0 tunables: peer_timeout: 0 peer_credits: 0 peer_buffer_credits: 0 credits: 0 lnd tunables: tcp bonding: 0 dev cpt: 0 CPT: <span class="code-quote">"[0]"</span> - net type: tcp local NI(s): - nid: 192.168.108.5@tcp status: up interfaces: 0: eth0 statistics: send_count: 276843 recv_count: 316775 drop_count: 0 tunables: peer_timeout: 180 peer_credits: 8 peer_buffer_credits: 0 credits: 256 lnd tunables: tcp bonding: 0 dev cpt: -1 CPT: <span class="code-quote">"[0]"</span> - nid: 192.168.118.5@tcp status: up interfaces: 0: eth1 statistics: send_count: 0 recv_count: 0 drop_count: 0 tunables: peer_timeout: 180 peer_credits: 8 peer_buffer_credits: 0 credits: 256 lnd tunables: tcp bonding: 0 dev cpt: -1 CPT: <span class="code-quote">"[0]"</span> - nid: 192.168.128.5@tcp status: up interfaces: 0: eth2 statistics: send_count: 0 recv_count: 0 drop_count: 0 tunables: peer_timeout: 180 peer_credits: 8 peer_buffer_credits: 0 credits: 256 lnd tunables: tcp bonding: 0 dev cpt: -1 CPT: <span class="code-quote">"[0]"</span> [root@fre805 tests]# </pre> </div></div> <p>nid 192.168.128.5@tcp is not associated with CPT <span class="error">&#91;1&#93;</span></p> LU-10245

lnetctl --cpt does not assosiate cpt properly

Bug Minor Resolved Not a Bug WC Triage Elena Gryaznova Wed, 15 Nov 2017 15:04:04 +0000 Fri, 1 Dec 2017 13:42:28 +0000 Fri, 1 Dec 2017 13:42:28 +0000 Lustre 2.10.1 0 3 <p>Take a look at your libcfs cpu partitions. Just because you have 2 CPUs doesn't directly mean that you'll endup with two CPTs. Both CPUs can be part of the same NUMA and by default libcfs cpu partitions will be set to "N", if you don't explicitly set it to something else. "N" means to use the NUMA architecture. IE: create a CPT per NUMA node which has at least one CPU attached to it.</p> <p>From the output you shared above, I think that's the issue, since when you configure without explicitly specifying a cpt option, the network gets attached to CPT 0, which just means that you only have one CPT partition in your system. </p> <p>to get your test to work you might need to add the following line in your lustre.conf:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">options libcfs cpu_pattern=<span class="code-quote">"0[0], 1[1]"</span> </pre> </div></div> <p>That'll create two CPTs. CPT 0 will have CPU 0 and CPT 1 will have CPU 1.</p> <p>The lnetctl syntax you used should then work.</p> <p>Amir,<br/> thank you.<br/> Yes, this works if the following is added to lustre.conf :</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">options libcfs cpu_pattern=<span class="code-quote">"0[0] 1[1]"</span> </pre> </div></div> <p>Ticket can be closed.</p> <p>thanks Elena</p> Development Rank 1|hzznwv: Rank (Obsolete) 9223372036854775807 Severity