Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9443

omit changelogs for volatile files

Details

    • 3
    • 9223372036854775807

    Description

      The slow rate of changelog consumption is probably the biggest issue for Robinhood deployments. So let's try emit as few changelog records as are necessary. AFAICT we can omit changelogs for volatile files without affecting RBH. As for other changelog consumers, who knows? rsync? Are there others?

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-6449 Broadcast HSM remove requests with undetermined archive_id to all registered copytools

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-9443] omit changelogs for volatile files
            pjones Peter Jones added a comment -

            Landed for 2.10

            pjones Peter Jones added a comment - Landed for 2.10
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/26931/
            Subject: LU-9443 mdd: omit changelog records for volatile files
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: af73b39130f789341c9eba4cdd8427bba895b005

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/26931/ Subject: LU-9443 mdd: omit changelog records for volatile files Project: fs/lustre-release Branch: master Current Patch Set: Commit: af73b39130f789341c9eba4cdd8427bba895b005
            adilger Andreas Dilger added a comment -

            In theory, it should also be possible to skip records like setattr that only affect timestamp changes, in particular atime, so long as these are not also affecting the data. That may already be done, I'm not sure.

            adilger Andreas Dilger added a comment - In theory, it should also be possible to skip records like setattr that only affect timestamp changes, in particular atime, so long as these are not also affecting the data. That may already be done, I'm not sure.
            gerrit Gerrit Updater added a comment -

            Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/26931
            Subject: LU-9443 mdd: omit changelog records for volatile files
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: e5d6bfc19bae1297ece9fada715e012f8a717f9b

            gerrit Gerrit Updater added a comment - Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/26931 Subject: LU-9443 mdd: omit changelog records for volatile files Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: e5d6bfc19bae1297ece9fada715e012f8a717f9b

            People

              mdiep Minh Diep
              mdiep Minh Diep
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: