Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-4277

Integrate ZFS zpool resilver status with OFD OS_STATE_DEGRADED flag

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.11.0
    • Lustre 2.11.0
    • 11749

    Description

      The OFD statfs() handled can optionally add an OS_STATE_DEGRADED flag to the statfs reply, which the MDS uses to help decide which OSTs to allocate new file objects from. Unless all other OSTs are also degraded, offline, or full, the DEGRADED OSTs will be skipped for newly created files.

      This avoids the application waiting for slow writes because of the rebuild long after it has completed on other healthy OSTs. It also avoids the new writes from interfering with the OST rebuild process, so it is a double win.

      This was previously implemented as a /proc tunable suitable for mdadm or a hardware-RAID utility to set from userspace, but since ZFS RAID is in the kernel it should be possible to query this status directly from the kernel when the MDS statfs() arrives.

      Attachments

        Issue Links

          Activity

            [LU-4277] Integrate ZFS zpool resilver status with OFD OS_STATE_DEGRADED flag
            pjones Peter Jones made changes -
            Affects Version/s New: Lustre 2.11.0 [ 13091 ]
            Affects Version/s Original: LTS [ 13791 ]
            pjones Peter Jones made changes -
            Affects Version/s New: LTS [ 13791 ]
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: In Progress [ 3 ] New: Resolved [ 5 ]
            pjones Peter Jones added a comment -

            Landed for 2.11

             

            pjones Peter Jones added a comment - Landed for 2.11  

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30907/
            Subject: LU-4277 scripts: ofd status integrated with zpool status
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 8ef3ddd2f2798d04b495c8223673a38452ac5c99

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30907/ Subject: LU-4277 scripts: ofd status integrated with zpool status Project: fs/lustre-release Branch: master Current Patch Set: Commit: 8ef3ddd2f2798d04b495c8223673a38452ac5c99
            utopiabound Nathaniel Clark made changes -
            Status Original: Open [ 1 ] New: In Progress [ 3 ]

            Nathaniel Clark (nathaniel.l.clark@intel.com) uploaded a new patch: https://review.whamcloud.com/30907
            Subject: LU-4277 scripts: ofd status integrated with zpool status
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 2f58dcb71a6246ce29a3a548f9ccafd006b97d44

            gerrit Gerrit Updater added a comment - Nathaniel Clark (nathaniel.l.clark@intel.com) uploaded a new patch: https://review.whamcloud.com/30907 Subject: LU-4277 scripts: ofd status integrated with zpool status Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 2f58dcb71a6246ce29a3a548f9ccafd006b97d44
            pjones Peter Jones made changes -
            Assignee Original: Tom Nabarro [ tanabarr ] New: Nathaniel Clark [ utopiabound ]
            pjones Peter Jones added a comment -

            Nathaniel

            Can you please see what is required to move this forward?

            Thanks

            Peter

            pjones Peter Jones added a comment - Nathaniel Can you please see what is required to move this forward? Thanks Peter
            adilger Andreas Dilger made changes -
            Fix Version/s New: Lustre 2.11.0 [ 13091 ]
            Fix Version/s Original: Lustre 2.10.1 [ 13090 ]

            People

              utopiabound Nathaniel Clark
              adilger Andreas Dilger
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: