[LU-5379] Get error when has many rules in nrs tbf policy

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.7.0
• Type: Bug
• Priority: Minor
• Reporter: wu libin (Inactive)
• Assignee: Nathaniel Clark
• Resolution: Fixed
• Labels: patch
• Severity: 3

Description

When i add so many rules, like:
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1

{192.0.8.122@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2

{192.0.8.123@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3

{192.0.8.124@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4

{192.0.8.125@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule5

{192.0.9.200@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule6

{192.0.9.201@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule7

{192.0.9.202@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule8

{192.0.9.203@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule9

{192.0.9.204@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule10

{192.0.9.205@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule11

{192.0.9.206@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule12

{192.0.9.207@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule13

{192.0.9.208@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule14

{192.0.9.209@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule15

{192.0.9.210@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule16

{192.0.9.211@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule101

{192.1.8.122@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule102

{192.1.8.123@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule103

{192.1.8.124@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule104

{192.1.8.125@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule105

{192.1.9.200@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule106

{192.1.9.201@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule107

{192.1.9.202@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule108

{192.1.9.203@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule109

{192.1.9.204@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1010

{192.1.9.205@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1011

{192.1.9.206@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1012

{192.1.9.207@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1013

{192.1.9.208@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1014

{192.1.9.209@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1015

{192.1.9.210@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule1016

{192.1.9.211@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule201

{192.2.8.122@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule202 {192.2.8.123@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule203 {192.2.8.124@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule204 {192.2.8.125@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule205 {192.2.9.200@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule206 {192.2.9.201@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule207 {192.2.9.202@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule208 {192.2.9.203@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule209 {192.2.9.204@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2010 {192.2.9.205@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2011 {192.2.9.206@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2012 {192.2.9.207@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2013 {192.2.9.208@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2014 {192.2.9.209@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2015 {192.2.9.210@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule2016 {192.2.9.211@o2ib} 10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule301 {192.2.8.122@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule302

{192.2.8.123@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule303

{192.2.8.124@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule304

{192.2.8.125@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule305

{192.2.9.200@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule306

{192.2.9.201@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule307

{192.2.9.202@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule308

{192.2.9.203@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule309

{192.2.9.204@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3010

{192.2.9.205@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3011

{192.2.9.206@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3012

{192.2.9.207@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3013

{192.2.9.208@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3014

{192.2.9.209@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3015

{192.2.9.210@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule3016

{192.2.9.211@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule401

{192.3.8.122@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule402

{192.3.8.123@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule403

{192.3.8.124@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule404

{192.3.8.125@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule405

{192.3.9.200@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule406

{192.3.9.201@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule407

{192.3.9.202@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule408

{192.3.9.203@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule409

{192.3.9.204@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4010

{192.3.9.205@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4011

{192.3.9.206@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4012

{192.3.9.207@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4013

{192.3.9.208@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4014

{192.3.9.209@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4015

{192.3.9.210@o2ib}

10"
lctl set_param ost.OSS.ost_io.nrs_tbf_rule="start rule4016

{192.3.9.211@o2ib}

10"
It succeed, however, when i try to cat the rules, it failed, like:

1. cat nrs_tbf_rule
   cat: nrs_tbf_rule: No space left on device

Issue Links

• is related to: LU-3558 NRS TBF policy for QoS purposes

Comments

[wu libin (Inactive)]

Here is the patch for this problem: http://review.whamcloud.com/#/c/11154/

[Peter Jones]

Nathaniel

Could you please take care of this patch?

Thanks

Peter

[Peter Jones]

Landed for 2.7