Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-3285

Data on MDT

Details

    • New Feature
    • Resolution: Fixed
    • Major
    • Lustre 2.11.0
    • Lustre 2.7.0
    • None
    • 8127

    Description

      Change MDS and client stacks to handle both meta and data requests. This makes MDS to be able to store data of file along with metadata.

      Attachments

        1. DOM_HLD.pdf
          118 kB
        2. DOM_user_guide.pdf
          33 kB
        3. DOM Test Plan.pdf
          250 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10496 sanity-dom sanity test_39k: FAIL: mtime is lost on close: 1515705427, should be 1484169395

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11558 t32_verify_quota() not being called by t32_test()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-14808 yaml support for DOM file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10498 sanity-dom test_fsx: FAIL: test_fsx failed with 120

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Technical task - A technical task. LU-10178 DoM: Use synced last BRW instead of extra SYNC RPC for CLIO fsync

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical task - A technical task. LU-10280 DoM cross-file open+readahead via statahead

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical task - A technical task. LU-10177 DoM: manual migration MDT-OST

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-10181 DoM performance optimization

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-11421 DoM: manual migration OST-MDT, MDT-MDT

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-10175 DoM:Full support for the LDLM lock convert

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-10180 DoM technical debts

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-10179 DoM: Data-on-MDT recovery cases

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-1757 Short I/O support

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12196 mkfs.lustre should handle large MDTs properly

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-10176 Data-on-MDT phase II

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LUDOC-385 Data on MDT Documentation

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-5319 Support multiple slots per client in last_rcvd file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-3285] Data on MDT
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29851
            Subject: LU-3285 dom: Data-on-MDT branch merge commit
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0c6439dfd5ebf3e1698b93eb0b7c04e562aaf1f6

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29851 Subject: LU-3285 dom: Data-on-MDT branch merge commit Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0c6439dfd5ebf3e1698b93eb0b7c04e562aaf1f6
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29813/
            Subject: LU-3285 mdc: implement own mdc_io_fsync_start()
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 1d2e9f42027ca0de07bbaf46a7c1f6866935f1a5

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29813/ Subject: LU-3285 mdc: implement own mdc_io_fsync_start() Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 1d2e9f42027ca0de07bbaf46a7c1f6866935f1a5
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29811/
            Subject: LU-3285 osc: remove wrongly applied assertion.
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 138b3eee3b61e06b34999c599d388f5e6e0effed

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29811/ Subject: LU-3285 osc: remove wrongly applied assertion. Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 138b3eee3b61e06b34999c599d388f5e6e0effed
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29810/
            Subject: LU-3285 llite: check layout size after cl_object_layout_get
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 877669a282efe8fea173b59723d121c25f91ee7b

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29810/ Subject: LU-3285 llite: check layout size after cl_object_layout_get Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 877669a282efe8fea173b59723d121c25f91ee7b
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29812/
            Subject: LU-3285 lod: don't initialize OSP objects for DoM
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: aeaa120d0d460ecce81a6d5d37ae0dc13936f590

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29812/ Subject: LU-3285 lod: don't initialize OSP objects for DoM Project: fs/lustre-release Branch: dom Current Patch Set: Commit: aeaa120d0d460ecce81a6d5d37ae0dc13936f590
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29809/
            Subject: LU-3285 lfs: handle -L option alphabetically
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 68d4aa397dcc71554aacd59a3d904ceaa09f3c68

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29809/ Subject: LU-3285 lfs: handle -L option alphabetically Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 68d4aa397dcc71554aacd59a3d904ceaa09f3c68
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29813
            Subject: LU-3285 mdc: implement own mdc_io_fsync_start()
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 391bd376970470e49277a266b8340fa0e3286d4d

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29813 Subject: LU-3285 mdc: implement own mdc_io_fsync_start() Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 391bd376970470e49277a266b8340fa0e3286d4d
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29812
            Subject: LU-3285 lod: don't initialize OSP objects for DoM
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: dd0e3c01fb01fe9927652e5ecd9ae784b28351ed

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29812 Subject: LU-3285 lod: don't initialize OSP objects for DoM Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: dd0e3c01fb01fe9927652e5ecd9ae784b28351ed
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29811
            Subject: LU-3285 osc: remove wrongly applied assertion.
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 3539db567e6cdd8450555d68d322c4583c62c515

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29811 Subject: LU-3285 osc: remove wrongly applied assertion. Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 3539db567e6cdd8450555d68d322c4583c62c515
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29810
            Subject: LU-3285 llite: check layout size after cl_object_layout_get
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 7a6849970520badc5a5de222620cebfeeb29a207

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29810 Subject: LU-3285 llite: check layout size after cl_object_layout_get Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 7a6849970520badc5a5de222620cebfeeb29a207
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29809
            Subject: LU-3285 lfs: handle -L option alphabetically
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 5d4ef2e8cd602ffa43d65edb0b24be0c817dfaa0

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29809 Subject: LU-3285 lfs: handle -L option alphabetically Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 5d4ef2e8cd602ffa43d65edb0b24be0c817dfaa0

            People

              tappro Mikhail Pershin
              tappro Mikhail Pershin
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: