https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8008 Lustre <p>I am trying to enable NRS_TBF but getting errors. </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> nbp1-oss6 ~ # cat /proc/fs/lustre/version lustre: 2.7.1 kernel: 2.6.32-504.30.3.el6.20151008.x86_64.lustre271 build: 2.7.1-2nasS_mofed31v5 nbp1-oss6 ~ # lctl set_param ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=tbf error: set_param: setting /proc/fs/lustre/ost/OSS/ost_io/nrs_policies=tbf: Invalid argument nbp1-oss6 ~ # lctl set_param ost.OSS.ost_io.nrs_tbf_rule=<span class="code-quote">"start rule1 { 10.151.27.22@2oib } 50"</span> ost.OSS.ost_io.nrs_tbf_rule=start rule1 { 10.151.27.22@2oib } 50 error: set_param: setting /proc/fs/lustre/ost/OSS/ost_io/nrs_tbf_rule=start rule1 { 10.151.27.22@2oib } 50: Invalid argument </pre> </div></div> LU-8008

Can't enable or add rules to TBF

Bug Major Resolved Won't Fix Emoly Liu Mahmoud Hanafi Mon, 11 Apr 2016 23:00:42 +0000 Thu, 20 Apr 2017 19:23:01 +0000 Thu, 5 May 2016 01:18:48 +0000 0 4 <p>Here is some introduction on NRS-TBF for your reference:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>3.1 Enable TBF policy The command to enable a TBF policy is shown as follows: #lctl set_param x.x.x.nrs_policies=”tbf [reg|hp] &lt;type&gt;” The argument "type" is the classification type of RPC requests. Currently, only "nid" and "jobid" are supported. For example, #lctl set_param ost.OSS.ost_io.nrs_policies="tbf nid" #lctl set_param ost.OSS.ost_io.nrs_policies="tbf reg nid" #lctl set_param ost.OSS.ost_io.nrs_policies="tbf hp nid" 3.2 Start rule The command to start a TBF policy rule is shown as follows: #lctl set_param x.x.x.nrs_policies=”[reg|hp] start &lt;rule_name&gt; &lt;arguments&gt;...” The argument "rule_name" argument is the TBF policy rule name. The format of the ‘arguments’ is different per the different TBF policy type. For NID based TBF policy, the format is shown as follows: #lctl set_param x.x.x.nrs_policies=”[reg|hp] start &lt;rule_name&gt; {&lt;nid_list&gt;} &lt;rate&gt;” The ‘nid_list’ argument uses the same format used to configure an LNET route. The ‘rate’ argument is the RPC rate of the rule. For example, #lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start loginnode {192.168.1.1@tcp} 10000" #lctl set_param ost.OSS.ost_io.nrs_tbf_rule="reg start loginnode {192.168.1.1@tcp} 10000" #lctl set_param ost.OSS.ost_io.nrs_tbf_rule="hp start loginnode {192.168.1.1@tcp} 10000" #lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start computenodes {192.168.1.[1-128]@tcp} 1000" #lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start other_clients {192.168.*.*@tcp} 100" </pre> </div></div> <p>Here is the output of your example with correct format, on my computer:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@centos6-1 tests]# ../utils/lctl set_param ost.OSS.ost_io.nrs_policies="tbf nid" ost.OSS.ost_io.nrs_policies=tbf nid [root@centos6-1 tests]# ../utils/lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1 {10.151.27.22@o2ib} 50" ost.OSS.ost_io.nrs_tbf_rule=start rule1 {10.151.27.22@o2ib} 50 </pre> </div></div> <p>You can find the similar introduction in Lustre manual, or the wiki page <a href="https://wiki.hpdd.intel.com/display/ENG/Token+Bucket+Filter+Policy" class="external-link" target="_blank" rel="nofollow noopener">https://wiki.hpdd.intel.com/display/ENG/Token+Bucket+Filter+Policy</a>.</p> <p>That link doesn't work.</p> <p>Is the type (nid or jobid) mutually exclusive? Or can we use both at the same time.</p> <p>The work to use both at the same time is in progress in <a href="https://jira.whamcloud.com/browse/LU-7470" title="Extend TBF policy with NID/JobID expressions" class="issue-link" data-issue-key="LU-7470"><del>LU-7470</del></a> (<a href="http://review.whamcloud.com/#/c/17345/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/17345/</a>).</p> <p>BTW, I converted that wiki page into pdf format and attached here, but some animation gif images can't be shown correctly.</p> <p>Hmmm, <a href="http://review.whamcloud.com/#/c/17345/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/17345/</a> marked it conflicts with <a href="https://jira.whamcloud.com/browse/LU-8006" title="Specify ordering of TBF policy rules" class="issue-link" data-issue-key="LU-8006"><del>LU-8006</del></a>, another ticket Mahmoud opened. </p> <p>So, we can only have one solution? <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/wink.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>I think we can discuss this issue with LiXi in <a href="https://jira.whamcloud.com/browse/LU-8006" title="Specify ordering of TBF policy rules" class="issue-link" data-issue-key="LU-8006"><del>LU-8006</del></a> or <a href="https://jira.whamcloud.com/browse/LU-7470" title="Extend TBF policy with NID/JobID expressions" class="issue-link" data-issue-key="LU-7470"><del>LU-7470</del></a> directly.</p> <p>Resolving this because the work is being done on <a href="https://jira.whamcloud.com/browse/LU-8006" title="Specify ordering of TBF policy rules" class="issue-link" data-issue-key="LU-8006"><del>LU-8006</del></a>.</p> <p>~ jfc.</p> Related LU-7470 LU-8006 LU-3558 Development Rank 1|hzy7lz: Rank (Obsolete) 9223372036854775807 Severity