https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6921 Lustre <p>stdout.log</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanityn test 77f: check TBF JobID nrs policy == 15:43:56 (1438011836) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid error: set_param: ost/OSS/ost_io/nrs_tbf_rule: Found no match sanityn test_77f: @@@@@@ FAIL: failed to operate on TBF rules Trace dump: = /usr/lib64/lustre/tests/../tests/test-framework.sh:4732:error_noexit() = /usr/lib64/lustre/tests/../tests/test-framework.sh:4763:error() = /usr/lib64/lustre/tests/sanityn.sh:2943:tbf_rule_operate() = /usr/lib64/lustre/tests/sanityn.sh:3008:test_77f() = /usr/lib64/lustre/tests/../tests/test-framework.sh:5010:run_one() = /usr/lib64/lustre/tests/../tests/test-framework.sh:5047:run_one_logged() = /usr/lib64/lustre/tests/../tests/test-framework.sh:4864:run_test() = /usr/lib64/lustre/tests/sanityn.sh:3043:main() Dumping lctl log to /tmp/test_logs/1438011830/sanityn.test_77f.*.1438011837.log FAIL 77f (1s) sanityn: FAIL: test_77f failed to operate on TBF rules Stopping clients: fre0107,fre0108 /mnt/lustre2 (opts:) Stopping client fre0108 /mnt/lustre2 opts: </pre> </div></div> LU-6921

sanityn 77f test failed Lustre: DEBUG MARKER: sanityn test_77f: @@@@@@ FAIL: failed to operate on TBF rules

Bug Major Resolved Fixed WC Triage Vinayak patch Tue, 28 Jul 2015 09:30:10 +0000 Wed, 18 May 2016 04:33:46 +0000 Tue, 20 Oct 2015 07:16:38 +0000 Lustre 2.8.0 Lustre 2.8.0 0 11 <p>sanityn test_77e, sanityn test_77g failed with the same reason :</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanityn test 77e: check TBF NID nrs policy == 14:29:25 (1438073965) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf nid error: set_param: ost/OSS/ost_io/nrs_tbf_rule: Found no match sanityn test_77e: @@@@@@ FAIL: failed to operate on TBF rules Trace dump: = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:4732:error_noexit() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:4763:error() = /home/build/lustre-xx/lustre/tests/sanityn.sh:2943:tbf_rule_operate() = /home/build/lustre-xx/lustre/tests/sanityn.sh:2957:test_77e() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:5010:run_one() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:5047:run_one_logged() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:4864:run_test() = /home/build/lustre-xx/lustre/tests/sanityn.sh:2987:main() Dumping lctl log to /tmp/test_logs/1438073937/sanityn.test_77e.*.1438073966.log FAIL 77e (2s) cleanup: ====================================================== == sanityn test complete, duration 30 sec == 14:29:27 (1438073967) sanityn: FAIL: test_77e failed to operate on TBF rules cli-1: warning: 'lctl conf_param' is deprecated, use 'lctl set_param -P' instead cli-1: warning: 'lctl conf_param' is deprecated, use 'lctl set_param -P' instead </pre> </div></div> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanityn test 77g: Change TBF type directly == 15:02:47 (1438075967) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid error: set_param: ost/OSS/ost_io/nrs_tbf_rule: Found no match sanityn test_77g: @@@@@@ FAIL: failed to operate on TBF rules Trace dump: = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:4732:error_noexit() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:4763:error() = /home/build/lustre-xx/lustre/tests/sanityn.sh:2943:tbf_rule_operate() = /home/build/lustre-xx/lustre/tests/sanityn.sh:3064:test_77g() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:5010:run_one() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:5047:run_one_logged() = /home/build/lustre-xx/lustre/tests/../tests/test-framework.sh:4864:run_test() = /home/build/lustre-xx/lustre/tests/sanityn.sh:3076:main() Dumping lctl log to /tmp/test_logs/1438075942/sanityn.test_77g.*.1438075968.log FAIL 77g (2s) </pre> </div></div> <p>HI Li Xi, Wang Shilong,<br/> could you please take a look at this failure in the new TBF tests.</p> <p>Strange, looks like ost/OSS/ost_io/nrs_tbf_rule is missing</p> <p>Hi Vinayak, which branch did you test? Was it a branch with TBF NRS policy?</p> <p>Hi Li Xi<br/> &gt;&gt; which branch did you test?<br/> latest master</p> <p>&gt;&gt; Was it a branch with TBF NRS policy?<br/> Do we know if complete TBF NFS policy is present for sure in master? I don't know how can we find that out. </p> <p>Followed this to find TBF related changes.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@cli-1 lustre-release]# git branch -a | grep master * master remotes/origin/HEAD -&gt; origin/master remotes/origin/master [root@cli-1 lustre-release]# git log --oneline | grep -i TBF fb14b7b LU-6668 test: regression tests for NRS TBF policy e7ab554 LU-5580 ptlrpc: policy switch directly in tbf 75752e9 LU-3319 procfs: Move NRS TBF proc handling to seq_files 0539dc5 LU-4832 ptlrpc: fix incorrect name string in nrs_tbf 33e35c0 LU-3558 ptlrpc: Add the NRS TBF policy </pre> </div></div> <p>Please let me know if you want any other info <b>or</b> anything you want me to check on my side.<br/> and also please correct me If I am missing any thing.</p> <p>Vinayak (vinayakswami.hariharmath@seagate.com) uploaded a new patch: <a href="http://review.whamcloud.com/16305" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/16305</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6921" title="sanityn 77f test failed Lustre: DEBUG MARKER: sanityn test_77f: @@@@@@ FAIL: failed to operate on TBF rules" class="issue-link" data-issue-key="LU-6921"><del>LU-6921</del></a> test: failed to operate on TBF rules<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: e9064c1edc56a21a7687002894d044a3f8f9f1c5</p> <p>Can anyone please let me know what is the behavior of this part (type) of script in sanityn.sh, test_77e, 77f, 77g</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> tbf_rule_operate ost0 "start\ localhost\ {0@lo}\ 1000" </pre> </div></div> <p>It is failing with<br/> "error: set_param: ost/OSS/ost_io/nrs_tbf_rule: Found no match" on my local set up. </p> <p>Is this behavior same on your side also ? Looks like ost0 is not correctly interpreted on my side.</p> <p>If passes, <br/> do we need to specify anything explicitly to make test work for <b>ost0</b> (any changes to frame work or any environment variable need to set etc).</p> <p>I am using 4 node set up (2 OSTs, 1 MDS, 2 clients)</p> <p>Hello Andreas,</p> <p>I have rebased the patch.</p> <p><a href="http://review.whamcloud.com/#/c/16305/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/16305/</a>. Please let me know if anything else to be done.</p> <p>Encountered same issue for sanity test_77g.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>20:26:40:CMD: onyx-38vm4 lctl set_param ost.OSS.ost_io.nrs_tbf_rule=start\ dd_runas\ {dd.500}\ 50 20:26:40:onyx-38vm4: error: set_param: setting /proc/fs/lustre/ost/OSS/ost_io/nrs_tbf_rule=start dd_runas {dd.500} 50: Invalid argument 20:26:41:ost.OSS.ost_io.nrs_tbf_rule=start dd_runas {dd.500} 50 20:26:42: sanityn test_77g: @@@@@@ FAIL: failed to operate on TBF rules </pre> </div></div> <p>Hello Suarabh,</p> <p>Can you please try the patch <a href="http://review.whamcloud.com/#/c/16305/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/16305/</a> and check if it fixes the problem. </p> <p>Thanks,</p> <p><a href="http://review.whamcloud.com/#/c/16305/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/16305/</a> is ready to be merged - Andreas and Li have given positive reviews. </p> <p>Andreas Dilger (andreas.dilger@intel.com) merged in patch <a href="http://review.whamcloud.com/16305/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/16305/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6921" title="sanityn 77f test failed Lustre: DEBUG MARKER: sanityn test_77f: @@@@@@ FAIL: failed to operate on TBF rules" class="issue-link" data-issue-key="LU-6921"><del>LU-6921</del></a> test: failed to operate on TBF rules<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: abbef8759e93c31a2c88ba650a04ae9076600afa</p> <p>I finally figured out why this test wasn't failing in our testing - in <tt>facet_host()</tt> it uses <tt>$ost_HOST</tt> for any facet named ostX if there isn't an explicit <tt>$ost0_HOST</tt> set in the configuration.</p> <p>In any case, the patch has been landed to master for 2.8.0.</p> Related LU-6668 LU-6939 LU-7044 Development Epic test Rank 1|hzxj7j: Rank (Obsolete) 9223372036854775807 Severity