Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-10176 Data-on-MDT phase II
  3. LU-11428

Writeback on close for DoM

    XMLWordPrintable

Details

    • Technical task
    • Resolution: Unresolved
    • Minor
    • None
    • None
    • 9223372036854775807

    Description

      Writeback on close is to piggyback the dirty data for DoM files in the close RPC if the data could fit into the inline buffer. This way it should be able to improve write on small files significantly.

      I have had this idea before and I have seen this problem in my recent test. The writeback to small files are really slow and no matter how large the number I set it to max_rpcs_in_flight of mdc, it could simply max out. Small RPCs are expensive. An alternative solution would be to have compound RPC to merge those small RPCs but it would introduce more issues. The easier solution is to have writeback on close.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-12325 Downgrade lock mode for DOM files when DOM bit gone

          • Major - Major loss of function.
          • Open

          Activity

            People

              tappro Mikhail Pershin
              Jinshan Jinshan Xiong
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated: