[LU-7585] Implement OI Scrub for ZFS

• Type: Improvement
• Resolution: Fixed
• Priority: Critical
• Fix Version/s: Lustre 2.11.0
• Affects Version/s: Lustre 2.9.0
• Labels: lfsck
• Assignee: nasf (Inactive)
• Reporter: Andreas Dilger

Description

There at occasions where the OI file can become corrupted (e.g. double mount of a filesystem), or otherwise need to be rebuilt (e.g. upgrade of normal ZFS filesystem to Lustre MDT in the future). It would be useful to be able to verify and/or rebuild the ZFS OI files during dnode iteration.

Issue Links

• is related to: LU-7797 Can't mount zpools after OSS restart
• is related to: LU-3569 Use real OST index as ostid_to_fid() parameter instead of always "0"
• is related to: LU-5855 sanity-lfsck does not work under ZFS-based DNE mode
• is related to: LU-7582 Manual delete of oi directory in ZFS backed server causes panic
• is related to: LU-8521 ZFS OST is unwritable
• is related to: LUDOC-161 document backup/restore process for ZFS backing filesystems
• is related to: LU-8620 Get rid of mystery object '???<object#138>' from the output of zdb

Comments

[nasf (Inactive)]

All the remaining three patches have been approved by reviewers, just waiting gate keeper for landing.

[Peter Jones]

Ah. Got it. Thanks

[nasf (Inactive)]

LU-10193 is one of the sub-tasks of this ticket.

[Peter Jones]

Isn't that distinct functionality tracked under a different JIRA ticket (LU-10193)?

[nasf (Inactive)]

No, there are still three patches to be landed:
https://review.whamcloud.com/#/c/30910/
https://review.whamcloud.com/#/c/30911/
https://review.whamcloud.com/#/c/30106/

[Peter Jones]

Can this work now be marked as resolved?

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/30909/
Subject: LU-7585 zfs: OI scrub for ZFS
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 89ead218ebe99a955afc0bc7f6aba83ef35019fb

[Gerrit Updater]

Fan Yong ([e-mail]) uploaded a new patch: https://review.whamcloud.com/30909
Subject: LU-7585 zfs: OI scrub for ZFS
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b5f4bb73612dc2060208c20265f7c4d4ec367371

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/29710/
Subject: LU-7585 osd-ldiskfs: auto scrub control
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 3ff1c932f869c8535aaebc56f0c924a760d1d601

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/28607/
Subject: LU-7585 scrub: general framework for OI scrub
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 7e21ea59edcc65426e1753ab1884b9a2b93826ce

[nasf (Inactive)]

All the patches for this ticket:
1) https://review.whamcloud.com/#/c/28607
2) https://review.whamcloud.com/#/c/29710
3) https://review.whamcloud.com/#/c/29241
4) https://review.whamcloud.com/#/c/28679
5) https://review.whamcloud.com/#/c/28609
6) https://review.whamcloud.com/#/c/29696
7) https://review.whamcloud.com/#/c/28855
8) https://review.whamcloud.com/#/c/29984
9) https://review.whamcloud.com/#/c/29617
10) https://review.whamcloud.com/#/c/29985
11) https://review.whamcloud.com/#/c/28610
12) https://review.whamcloud.com/#/c/28834
13) https://review.whamcloud.com/#/c/28847
14) https://review.whamcloud.com/#/c/30106