Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-10018

MDT as a statfs proxy

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.12.0
    • None
    • 9223372036854775807

    Description

      given MDT updates statfs data from all OSTs every second it can provide data to the clients. this can be useful for idling connections feature as we won't need to connect to OST for a single OST_STATFS RPC. this can also make df less expensive in terms of RPC and faster.

      Attachments

        Issue Links

          is blocking

          Improvement - An improvement or enhancement to an existing feature or task. LU-7236 OST connect and disconnect on demand

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-11375 Client 2.10 fails to mount Server 2.11.54

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-7770 conf-sanity test_50b: Error: 'lazystatfs should not return EIO'

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11721 "lfs df -i" prints used blocks percentage instead of inodes

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-7880 add OST/MDT performance statistics to obd_statfs

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-7233 parallelize lmv_statfs() implementation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-9555 "df /path/to/project" should return projid-specific values

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-10018] MDT as a statfs proxy
            pjones Peter Jones added a comment -

            Landed for 2.12

            pjones Peter Jones added a comment - Landed for 2.12
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/29136/
            Subject: LU-10018 protocol: MDT as a statfs proxy
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: b500d5193360711a6c6b07497f34e61cc590cf19

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/29136/ Subject: LU-10018 protocol: MDT as a statfs proxy Project: fs/lustre-release Branch: master Current Patch Set: Commit: b500d5193360711a6c6b07497f34e61cc590cf19
            adilger Andreas Dilger added a comment - - edited

            Not sure why this wasn't added automatically:

            https://review.whamcloud.com/29136

            LU-10018 protocol: MDT as a statfs proxy
MDT can act as a proxy for statfs data. this should
make df faster (RTT vs RTT*(#MDTs+11)) and enable
idling connections so that clients don't connect to
each OST just to report statfs data. the protocol
has been changing slightly to let MDT differentiate
self and aggregated statfs.
also, obd_statfs has got a new field "granted" where
OST reports how much space has been granted to the
requesting MDT so that space can be added to available
space.

TODO:
- clients to use different MDTs to balance load

Change-Id: I59e03cb5abf809ae8820f874ec51dd2b74e1806c
Signed-off-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
            adilger Andreas Dilger added a comment - - edited Not sure why this wasn't added automatically: https://review.whamcloud.com/29136 LU-10018 protocol: MDT as a statfs proxy MDT can act as a proxy for statfs data. this should make df faster (RTT vs RTT*(#MDTs+11)) and enable idling connections so that clients don't connect to each OST just to report statfs data. the protocol has been changing slightly to let MDT differentiate self and aggregated statfs. also, obd_statfs has got a new field "granted" where OST reports how much space has been granted to the requesting MDT so that space can be added to available space. TODO: - clients to use different MDTs to balance load Change-Id: I59e03cb5abf809ae8820f874ec51dd2b74e1806c Signed-off-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>

            People

              bzzz Alex Zhuravlev
              bzzz Alex Zhuravlev
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: