https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12048 Lustre <p>Setting nrs_policies on the MGS does not apply them when a server is rebooted. It seems to work only on the MGS node.</p> <p> </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> lctl set_param -P ost.OSS.ost_io.nrs_policies=<span class="code-quote">"tbf"</span> </pre> </div></div> <p>I check the params log file and it has the setting</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> # llog_reader /tmp/params rec #1 type=10620000 len=224 offset 8192 rec #2 type=10620000 len=104 offset 8416 rec #3 type=10620000 len=224 offset 8520 rec #4 type=10620000 len=224 offset 8744 rec #5 type=10620000 len=104 offset 8968 rec #6 type=10620000 len=224 offset 9072 rec #7 type=10620000 len=224 offset 9296 rec #8 type=10620000 len=120 offset 9520 rec #9 type=10620000 len=224 offset 9640 rec #10 type=10620000 len=224 offset 9864 rec #11 type=10620000 len=128 offset 10088 rec #12 type=10620000 len=224 offset 10216 rec #13 type=10620000 len=224 offset 10440 rec #14 type=10620000 len=120 offset 10664 rec #15 type=10620000 len=224 offset 10784 Header size : 8192 Time : Wed Mar 6 11:05:31 2019 <span class="code-object">Number</span> of records: 15 Target uuid : ----------------------- #01 (224)SKIP START marker 2 (flags=0x05, v2.12.0.0) general <span class="code-quote">'at_min'</span> Tue Feb 26 12:28:57 2019-Tue Feb 26 12:29:08 2019 #02 (104)SKIP set_param 0:general 1:at_min=200 2:lctl #03 (224)SKIP END marker 2 (flags=0x06, v2.12.0.0) general <span class="code-quote">'at_min'</span> Tue Feb 26 12:28:57 2019-Tue Feb 26 12:29:08 2019 #04 (224)marker 3 (flags=0x01, v2.12.0.0) general <span class="code-quote">'at_min'</span> Tue Feb 26 12:29:08 2019- #05 (104)set_param 0:general 1:at_min=200 2:lctl #06 (224)END marker 3 (flags=0x02, v2.12.0.0) general <span class="code-quote">'at_min'</span> Tue Feb 26 12:29:08 2019- #07 (224)SKIP START marker 2 (flags=0x05, v2.12.0.0) OSS <span class="code-quote">'ost.OSS.ost_io.nrs_policies'</span> Wed Mar 6 10:48:11 2019-Wed Mar 6 10:50:01 2019 #08 (120)SKIP set_param 0:OSS 1:ost.OSS.ost_io.nrs_policies=tbf 2:lctl #09 (224)SKIP END marker 2 (flags=0x06, v2.12.0.0) OSS <span class="code-quote">'ost.OSS.ost_io.nrs_policies'</span> Wed Mar 6 10:48:11 2019-Wed Mar 6 10:50:01 2019 #10 (224)SKIP START marker 3 (flags=0x05, v2.12.0.0) OSS <span class="code-quote">'ost.OSS.ost_io.nrs_policies'</span> Wed Mar 6 10:50:01 2019-Wed Mar 6 10:50:50 2019 #11 (128)SKIP set_param 0:OSS 1:ost.OSS.ost_io.nrs_policies=fifio 2:lctl #12 (224)SKIP END marker 3 (flags=0x06, v2.12.0.0) OSS <span class="code-quote">'ost.OSS.ost_io.nrs_policies'</span> Wed Mar 6 10:50:01 2019-Wed Mar 6 10:50:50 2019 #13 (224)marker 4 (flags=0x01, v2.12.0.0) OSS <span class="code-quote">'ost.OSS.ost_io.nrs_policies'</span> Wed Mar 6 10:50:50 2019- #14 (120)set_param 0:OSS 1:ost.OSS.ost_io.nrs_policies=tbf 2:lctl #15 (224)END marker 4 (flags=0x02, v2.12.0.0) OSS <span class="code-quote">'ost.OSS.ost_io.nrs_policies'</span> Wed Mar 6 10:50:50 2019- </pre> </div></div> <p>Also when running the following on the MGS this should push out the settings all servers.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> lctl set_param -P ost.OSS.ost_io.nrs_policies=<span class="code-quote">"tbf"</span> lctl set_param -P ost.OSS.ost_io.nrs_tbf_rule=<span class="code-quote">"start css gid={1128} rate=10000"</span> </pre> </div></div> <p> </p> LU-12048

nrs_policies not being set after reboot.

Bug Minor Resolved Fixed Emoly Liu Mahmoud Hanafi Wed, 6 Mar 2019 19:33:21 +0000 Wed, 27 Mar 2019 01:22:25 +0000 Wed, 27 Mar 2019 01:13:30 +0000 Lustre 2.12.0 0 4 <p>I just tried it manually, no reboot and it looks like it works. Is it only a reboot issue?</p> <p>What do you mean "manually"</p> <p>Those setting should get set correctly on all servers after a reboot.</p> <p>Is this related?</p> <p><a href="https://jira.whamcloud.com/browse/LU-10937" class="external-link" rel="nofollow">https://jira.whamcloud.com/browse/LU-10937</a></p> <p>Hi <a href="https://jira.whamcloud.com/secure/ViewProfile.jspa?name=mhanafi" class="user-hover" rel="mhanafi">mhanafi</a>,</p> <p>I tried this locally, after umount and mount my OST, it still works. Could you please try the following steps in your system?</p> <ul class="alternate" type="square"> <li>run " lctl set_param -P ost.OSS.ost_io.nrs_policies="tbf" " on the MGS</li> <li>run " lctl get_param ost.OSS.ost_io.nrs_policies " to make sure "tbf" is enabled correctly. This may take a few seconds.</li> <li>reboot or umount/mount your OST and see if "tbf" is still enabled.</li> </ul> <p>Please post the output here and upload MGS/OST logs if you still hit the issue.</p> <p>Thanks.</p> <p>Ok Now I can't reproduce it. Is there way to I can clear out the params file on the MGS and re-test this.</p> <p> </p> <p><a href="https://jira.whamcloud.com/secure/ViewProfile.jspa?name=mhanafi" class="user-hover" rel="mhanafi">mhanafi</a>,</p> <p>You can erase configuration logs by writeconf command. After that and the servers restart, the configuration logs are re-generated and stored on the MGS (as in a new file system). But in this way, you must umount all the clients/MDT/OSTs, run writeconf command on MGS/MDT/OSTs/ devices respectively, then mount them again. Please note that all the parameters will be cleared, so this is a dangerous operation.</p> <p>Are you sure you want to do this? Or just use "lctl set_param" to set nrs_policies to fifo back, and then redo tbf test again?</p> <p> </p> <p>We can close this case</p> <p>Thanks.</p> <p>lctl set_param  -P -d "cmd" will delete parameters on the MGS server.</p> Development Rank 1|i00cun: Rank (Obsolete) 9223372036854775807 Severity