Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-15481

speedup "lfs changelog" llog processing with a startrec

Details

    • 9223372036854775807

    Description

      Accessing a changelog record at the end of a catalog could be really slow if there is a lot of "idle records" or if difference of indexes between changelog users is important.
      In all cases, changelog llog callback (chlg_read_cat_process_cb) is called for each changelog records.

      We could easily determine the number of record to skip based on internal changelog indexes. This enable to conditionally skip an entire llog plain file (64k records) (see LU-14688).

      Attachments

        Activity

          [LU-15481] speedup "lfs changelog" llog processing with a startrec
          gerrit Gerrit Updater added a comment -

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48771/
          Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
          Project: fs/lustre-release
          Branch: b2_15
          Current Patch Set:
          Commit: 053ab4a47a3391ff2b3b252b649b88e4579ab88f

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48771/ Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: 053ab4a47a3391ff2b3b252b649b88e4579ab88f
          gerrit Gerrit Updater added a comment -

          "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/48771
          Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
          Project: fs/lustre-release
          Branch: b2_15
          Current Patch Set: 1
          Commit: 478e5782ee0956443f01585203a23602282abf6d

          gerrit Gerrit Updater added a comment - "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/48771 Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: 478e5782ee0956443f01585203a23602282abf6d
          gerrit Gerrit Updater added a comment -

          "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/48396
          Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
          Project: fs/lustre-release
          Branch: b2_12
          Current Patch Set: 1
          Commit: 6ff3e31e14b99e0aac680fa7bdb04d96ce09ecd6

          gerrit Gerrit Updater added a comment - "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/48396 Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain Project: fs/lustre-release Branch: b2_12 Current Patch Set: 1 Commit: 6ff3e31e14b99e0aac680fa7bdb04d96ce09ecd6
          pjones Peter Jones added a comment -

          Landed for 2.16

          pjones Peter Jones added a comment - Landed for 2.16
          gerrit Gerrit Updater added a comment -

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/46310/
          Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: aa22a6826ee521ab14994a4533b0dbffb529aab0

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/46310/ Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain Project: fs/lustre-release Branch: master Current Patch Set: Commit: aa22a6826ee521ab14994a4533b0dbffb529aab0
          gerrit Gerrit Updater added a comment -

          "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/46310
          Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: ed27f38c4f163701571a99dae1f34766fdd3e5a8

          gerrit Gerrit Updater added a comment - "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/46310 Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: ed27f38c4f163701571a99dae1f34766fdd3e5a8

          People

            eaujames Etienne Aujames
            eaujames Etienne Aujames
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: