Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-3558

NRS TBF policy for QoS purposes

    XMLWordPrintable

Details

    • New Feature
    • Resolution: Fixed
    • Minor
    • Lustre 2.6.0
    • None
    • 8963

    Description

      NRS (Network Request Scheduler) enables the services to schedule the RPCs in different manners. And there have been a bunch of policies implemented over the main framework. Most of them are aimed at improving throughput rate or similar purposes. But we are trying to implement policies for a differnt kind of purpose, QoS.

      The TBF (Token Bucket Filter) is one of the policies that we implemented for traffic control. It enforces a RPC rate limit on every client according to the NID. The handling of a RPC will be delayed until there are enough tokens for the client. Different clients are scheduled according to their deadlines, so that none of them will be starving even though the service does not have the ability to satisfy all the RPC rate requirments of clients. The RPCs from the the same clients are queued in a FIFO manner.)

      Early tests show that the policy works to enforce the RPC rate limit. But more tests, bechmarks and analyses is needed for its correctness and efficiency.

      Attachments

        1. NRS-initial-test-result.xlsx
          35 kB
          Shuichi Ihara
        2. TBF-design-1.0.pdf
          274 kB
          Shuichi Ihara

        Issue Links

          is blocking

          Improvement - An improvement or enhancement to an existing feature or task. LU-11431 Global QoS management based on TBF

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-5717 Dead lock of nrs_tbf_timer_cb

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-6668 Add tests for TBF

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-5379 Get error when has many rules in nrs tbf policy

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-9227 Changing rate of a TBF rule loses control in some testcases

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-5580 Switch between 'JOBID' and 'NID' directly in NRS TBF

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-5620 nrs tbf policy based on opcode

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LUDOC-221 Document Token Bucket Filter (TBF) NRS policy

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-4586 build failure in nrs_tbf_ctl()

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LUDOC-328 documentation updates for complex TBF policies

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-8008 Can't enable or add rules to TBF

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-5620 nrs tbf policy based on opcode

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-7470 Extend TBF policy with NID/JobID expressions

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-9228 Hard TBF Token Compensation under congestion

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-3266 Regression tests for NRS policies

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Question/Request - A product question or request LU-8006 Specify ordering of TBF policy rules

          • Major - Major loss of function.
          • Resolved

          Question/Request - A product question or request LU-8236 Wild-card in jobid TBF rule

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              laisiyao Lai Siyao
              lixi Li Xi (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: