Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-3285

Data on MDT

Details

    • New Feature
    • Resolution: Fixed
    • Major
    • Lustre 2.11.0
    • Lustre 2.7.0
    • None
    • 8127

    Description

      Change MDS and client stacks to handle both meta and data requests. This makes MDS to be able to store data of file along with metadata.

      Attachments

        1. DOM_HLD.pdf
          118 kB
        2. DOM_user_guide.pdf
          33 kB
        3. DOM Test Plan.pdf
          250 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10496 sanity-dom sanity test_39k: FAIL: mtime is lost on close: 1515705427, should be 1484169395

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11558 t32_verify_quota() not being called by t32_test()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-14808 yaml support for DOM file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10498 sanity-dom test_fsx: FAIL: test_fsx failed with 120

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Technical task - A technical task. LU-10178 DoM: Use synced last BRW instead of extra SYNC RPC for CLIO fsync

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical task - A technical task. LU-10280 DoM cross-file open+readahead via statahead

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical task - A technical task. LU-10177 DoM: manual migration MDT-OST

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-10181 DoM performance optimization

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-11421 DoM: manual migration OST-MDT, MDT-MDT

          • Major - Major loss of function.
          • Resolved

          Technical task - A technical task. LU-10175 DoM:Full support for the LDLM lock convert

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-10180 DoM technical debts

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-10179 DoM: Data-on-MDT recovery cases

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-1757 Short I/O support

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12196 mkfs.lustre should handle large MDTs properly

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-10176 Data-on-MDT phase II

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LUDOC-385 Data on MDT Documentation

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-5319 Support multiple slots per client in last_rcvd file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-3285] Data on MDT
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/30020/
            Subject: LU-3285 tests: disable DOM files in racer by default
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 4eefbc353d464dcbf24afcc575f5a9830cdc6806

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/30020/ Subject: LU-3285 tests: disable DOM files in racer by default Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 4eefbc353d464dcbf24afcc575f5a9830cdc6806
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30024
            Subject: LU-3285 merge: Merge branch 'dom'
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0b6a59ba120e709659d543048b65beb8c9c67e86

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30024 Subject: LU-3285 merge: Merge branch 'dom' Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0b6a59ba120e709659d543048b65beb8c9c67e86
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30021
            Subject: LU-3285 mdc: remove wrong assertion from mdc_object_ast_clear
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: 2428df03b685078619620e47d582bd586367df89

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30021 Subject: LU-3285 mdc: remove wrong assertion from mdc_object_ast_clear Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: 2428df03b685078619620e47d582bd586367df89
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30020
            Subject: LU-3285 tests: disable DOM files in racer by default
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set: 1
            Commit: dedddfe975d7de644d290e14f025efed96a07722

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30020 Subject: LU-3285 tests: disable DOM files in racer by default Project: fs/lustre-release Branch: dom Current Patch Set: 1 Commit: dedddfe975d7de644d290e14f025efed96a07722
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30016
            Subject: LU-3285 tests: clear client stats right before unlink
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: d5dcdf36ee14efcfdc50d8d1711d6581035e5c62

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30016 Subject: LU-3285 tests: clear client stats right before unlink Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: d5dcdf36ee14efcfdc50d8d1711d6581035e5c62
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30004
            Subject: LU-3285 mdt: use max_mdsize in reply for layout intent
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: dd588e593fdca37fc2ab6d62b96e07b2603efabd

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/30004 Subject: LU-3285 mdt: use max_mdsize in reply for layout intent Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: dd588e593fdca37fc2ab6d62b96e07b2603efabd
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29983
            Subject: LU-3285 tests: disable DOM files in racer by default
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 49e9fa3d80482f2601486245ee537333b93da5b8

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29983 Subject: LU-3285 tests: disable DOM files in racer by default Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 49e9fa3d80482f2601486245ee537333b93da5b8
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29968
            Subject: LU-3285 mdt: high-priority request handling for DOM
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 2be47650a7cb3b762d6153ae2bbe1fc5a07d7e72

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29968 Subject: LU-3285 mdt: high-priority request handling for DOM Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 2be47650a7cb3b762d6153ae2bbe1fc5a07d7e72
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29930
            Subject: LU-3285 mdt: take discard lock at cleanup stage
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 8c6aecc34f580368851897b0877b45058c7bcb74

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29930 Subject: LU-3285 mdt: take discard lock at cleanup stage Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 8c6aecc34f580368851897b0877b45058c7bcb74
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29851
            Subject: LU-3285 dom: Data-on-MDT branch merge commit
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0c6439dfd5ebf3e1698b93eb0b7c04e562aaf1f6

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/29851 Subject: LU-3285 dom: Data-on-MDT branch merge commit Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0c6439dfd5ebf3e1698b93eb0b7c04e562aaf1f6
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29813/
            Subject: LU-3285 mdc: implement own mdc_io_fsync_start()
            Project: fs/lustre-release
            Branch: dom
            Current Patch Set:
            Commit: 1d2e9f42027ca0de07bbaf46a7c1f6866935f1a5

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) merged in patch https://review.whamcloud.com/29813/ Subject: LU-3285 mdc: implement own mdc_io_fsync_start() Project: fs/lustre-release Branch: dom Current Patch Set: Commit: 1d2e9f42027ca0de07bbaf46a7c1f6866935f1a5

            People

              tappro Mikhail Pershin
              tappro Mikhail Pershin
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: