Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-10938 Metadata writeback cache support
  3. LU-14820

WBC: trigger flush on background when exceed the dirty inode threshold

Details

    • Technical task
    • Resolution: Unresolved
    • Minor
    • None
    • None
    • None
    • 9223372036854775807

    Description

      Linux kernel only provides the periodic flush algorithm where the dirty inodes will stay in cache until dirty period is expired. This may result in many accumulated dirty inodes caching in memory before flushing. During this period, it does not make full use of the network and server capacity and resource.

       

      Thus, it would better to design an aggressive dirty inodes flush algorithm on background when accumulated dirty inodes exceeds a threshold.

      Moreover, the current writeback mechanism in kernel is single-threaded for each filesystem backend. It would better to parallelize the flushing of the dirty inodes on background.

      Attachments

        Activity

          [LU-14820] WBC: trigger flush on background when exceed the dirty inode threshold

          "Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/45645
          Subject: LU-14820 wbc: fix some misc bugs V2
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 38508ed606d2976dd49bff94b138c785dfc3871a

          gerrit Gerrit Updater added a comment - "Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/45645 Subject: LU-14820 wbc: fix some misc bugs V2 Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 38508ed606d2976dd49bff94b138c785dfc3871a

          "Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/45644
          Subject: LU-14820 wbc: Fix for some misc bugs
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 8e55b33d1a256637f5c05d5f955f5aea9261572e

          gerrit Gerrit Updater added a comment - "Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/45644 Subject: LU-14820 wbc: Fix for some misc bugs Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 8e55b33d1a256637f5c05d5f955f5aea9261572e
          gerrit Gerrit Updater added a comment - - edited

          Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/44147
          Subject: LU-14820 wbc: parallel flush on background
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 9cafa692cffc0ac770885721d132fa1567b5b839

          gerrit Gerrit Updater added a comment - - edited Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/44147 Subject: LU-14820 wbc: parallel flush on background Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 9cafa692cffc0ac770885721d132fa1567b5b839

          People

            qian_wc Qian Yingjin
            qian_wc Qian Yingjin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: