Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-3285

Data on MDT

Details

    • New Feature
    • Resolution: Fixed
    • Major
    • Lustre 2.11.0
    • Lustre 2.7.0
    • None
    • 8127

    Description

      Change MDS and client stacks to handle both meta and data requests. This makes MDS to be able to store data of file along with metadata.

      Attachments

        1. DOM_HLD.pdf
          118 kB
        2. DOM_user_guide.pdf
          33 kB
        3. DOM Test Plan.pdf
          250 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10496 sanity-dom sanity test_39k: FAIL: mtime is lost on close: 1515705427, should be 1484169395

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11558 t32_verify_quota() not being called by t32_test()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-14808 yaml support for DOM file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10498 sanity-dom test_fsx: FAIL: test_fsx failed with 120

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Technical task - A technical task. LU-10178 DoM: Use synced last BRW instead of extra SYNC RPC for CLIO fsync

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical task - A technical task. LU-10280 DoM cross-file open+readahead via statahead

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical task - A technical task. LU-10177 DoM: manual migration MDT-OST

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-10181 DoM performance optimization

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-11421 DoM: manual migration OST-MDT, MDT-MDT

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-10175 DoM:Full support for the LDLM lock convert

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-10180 DoM technical debts

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-10179 DoM: Data-on-MDT recovery cases

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-1757 Short I/O support

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12196 mkfs.lustre should handle large MDTs properly

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-10176 Data-on-MDT phase II

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LUDOC-385 Data on MDT Documentation

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-5319 Support multiple slots per client in last_rcvd file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-3285] Data on MDT
            adilger Andreas Dilger added a comment -

            Mike, thanks for attaching the design doc here. If you get a chance, it would be great to also upload this to wiki.lustre.org and link it into the "Layout Enhancement" and "PFL" Pages.

            adilger Andreas Dilger added a comment - Mike, thanks for attaching the design doc here. If you get a chance, it would be great to also upload this to wiki.lustre.org and link it into the "Layout Enhancement" and "PFL" Pages.
            gerrit Gerrit Updater added a comment - - edited

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30059
            Subject: LU-3285 tests: add FIO as test for DOM
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 7983be9af572433f24ceb4e3533b77866ec0e4e8

            Patch moved to LU-10176

            gerrit Gerrit Updater added a comment - - edited Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30059 Subject: LU-3285 tests: add FIO as test for DOM Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 7983be9af572433f24ceb4e3533b77866ec0e4e8 Patch moved to LU-10176
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/29851/
            Subject: LU-3285 merge: 'dom' branch merging
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 3cbe63e72c83ba50c3553d28e2fe6bc9d18c347a

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/29851/ Subject: LU-3285 merge: 'dom' branch merging Project: fs/lustre-release Branch: master Current Patch Set: Commit: 3cbe63e72c83ba50c3553d28e2fe6bc9d18c347a
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30058
            Subject: LU-3285 mdt: remove assertion on mdt_pack_size2body()
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: d4b49722cd070e9f7a5c9531cea0bd8b397e04a0

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30058 Subject: LU-3285 mdt: remove assertion on mdt_pack_size2body() Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: d4b49722cd070e9f7a5c9531cea0bd8b397e04a0
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30057
            Subject: LU-3285 mdt: get lu_object_attr for existent object
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 27b5a0923ddc1bde88f2bbc5dd5b08c09b763745

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30057 Subject: LU-3285 mdt: get lu_object_attr for existent object Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 27b5a0923ddc1bde88f2bbc5dd5b08c09b763745
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30055
            Subject: LU-3285 mdt: remove assertion on mdt_pack_size2body()
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 549e839f5fc4f73e0d41d04a45ce20051f42c04e

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30055 Subject: LU-3285 mdt: remove assertion on mdt_pack_size2body() Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 549e839f5fc4f73e0d41d04a45ce20051f42c04e
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30054
            Subject: LU-3285 mdt: get lu_object_attr for existent object
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 87fdb34df47bb49a67a21cedc5d944ace6a24886

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30054 Subject: LU-3285 mdt: get lu_object_attr for existent object Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 87fdb34df47bb49a67a21cedc5d944ace6a24886
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/30021/
            Subject: LU-3285 mdc: remove wrong assertion from mdc_object_ast_clear
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: f8929e6d0f3c28639763ba474f663cdfd5181268

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/30021/ Subject: LU-3285 mdc: remove wrong assertion from mdc_object_ast_clear Project: fs/lustre-release Branch: dom Current Patch Set: Commit: f8929e6d0f3c28639763ba474f663cdfd5181268
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/30020/
            Subject: LU-3285 tests: disable DOM files in racer by default
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 4eefbc353d464dcbf24afcc575f5a9830cdc6806

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/30020/ Subject: LU-3285 tests: disable DOM files in racer by default Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 4eefbc353d464dcbf24afcc575f5a9830cdc6806
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30024
            Subject: LU-3285 merge: Merge branch 'dom'
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0b6a59ba120e709659d543048b65beb8c9c67e86

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30024 Subject: LU-3285 merge: Merge branch 'dom' Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0b6a59ba120e709659d543048b65beb8c9c67e86
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30021
            Subject: LU-3285 mdc: remove wrong assertion from mdc_object_ast_clear
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 2428df03b685078619620e47d582bd586367df89

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30021 Subject: LU-3285 mdc: remove wrong assertion from mdc_object_ast_clear Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 2428df03b685078619620e47d582bd586367df89

            People

              tappro Mikhail Pershin
              tappro Mikhail Pershin
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: