LFSCK 4: improve LFSCK performance (LU-6361)

[LU-1452] LFSCK 4: Improve inode iteration for uninitialized groups Created: 31/May/12  Updated: 13/Mar/15  Resolved: 03/Dec/14

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.7.0

Type: Technical task Priority: Critical
Reporter: nasf (Inactive) Assignee: nasf (Inactive)
Resolution: Fixed Votes: 0
Labels: LFSCK

Rank (Obsolete): 10552

 Description   

For ldiskfs-based backend, the OI scrub scans the local device linearly. It iterates all the inodes on the ldiskfs partition in the inode tables in each block group without distinguishing whether the block group that contains the inode table has been initialised or not. In fact, to speed up the mke2fs and local e2fsck, the ldiskfs supports "uninit_bg" feature that allows to create the backend-filesystem without initializing all of the block groups, then dramatically reduce e2fsck time.

So for the iteration used by the new LFSCK (including backend OI scrub), it should also make use of such feature to skip uninitialised block groups to optimise the scanning.



 Comments   
Comment by Cory Spitz [ 06/Nov/14 ]

This ticket could use a better description.

Comment by Gerrit Updater [ 15/Nov/14 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/12737
Subject: LU-1452 scrub: OI scrub skips uninitialized groups
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5abec40daf05205d1cf04fcf2eac2c2924b814b0

Comment by Gerrit Updater [ 15/Nov/14 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/12737
Subject: LU-1452 scrub: OI scrub skips uninitialized groups
Project: fs/lustre-release
Branch: master
Current Patch Set: 2
Commit: d85bf60a31d617b3fd69cd33e652d71fc44e2030

Comment by Gerrit Updater [ 17/Nov/14 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/12737
Subject: LU-1452 scrub: OI scrub skips uninitialized groups
Project: fs/lustre-release
Branch: master
Current Patch Set: 3
Commit: 215bdd0e1384a2c27b9cf4ca0e19fefbe61f10c4

Comment by Gerrit Updater [ 03/Dec/14 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/12737/
Subject: LU-1452 scrub: OI scrub skips uninitialized groups
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 9ce1fdd9b79bca5cd4dbeb4740fbc889c573d5fc

Comment by nasf (Inactive) [ 03/Dec/14 ]

The patch has been landed to master.

Comment by Gerrit Updater [ 10/Jan/15 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/13338
Subject: LU-1452 scrub: test for skipping uninitialized groups
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 813640e4144042ff774ea54417073a5f4f9e2ce3

Generated at Sat Feb 10 01:16:45 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.