[LU-6361] LFSCK 4: improve LFSCK performance

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.8.0
• Type: Improvement
• Priority: Major
• Reporter: nasf (Inactive)
• Assignee: nasf (Inactive)
• Resolution: Fixed

Sub-Tasks

Key	Summary	Type	Status	Assignee
LU-1452	LFSCK 4: Improve inode iteration for ...	Technical task	Resolved	nasf
LU-1453	LFSCK 4: Improve OI scrub trigger str...	Technical task	Resolved	nasf
LU-5820	LFSCK 4: Record linkEA verification h...	Technical task	Resolved	nasf
LU-5682	LFSCK 4: optimize ldlm lock used by L...	Technical task	Resolved	nasf
LU-6316	LFSCK 4: namespace LFSCK can skip dot...	Technical task	Resolved	nasf
LU-6317	LFSCK 4: namespace LFSCK counts the o...	Technical task	Resolved	nasf
LU-6343	LFSCK 4: locate object only when nece...	Technical task	Resolved	nasf
LU-6350	LFSCK 4: lock the MDT-object based on...	Technical task	Resolved	nasf
LU-6322	LFSCK 4: show LFSCK started/completed...	Technical task	Resolved	nasf
LU-6177	LFSCK 4: namespace LFSCK scalability	Technical task	Resolved	nasf
LU-6351	LFSCK MDS crash: unable to handle ker...	Technical task	Resolved	nasf

• Key: Summary
• Summary: Type
• Type: Status
• Status: Assignee
• Severity: 3

Description

It is used for tracing all LFSCK 4 tasks.

Comments

[nasf (Inactive)]

The patch for measure LFSCK 4 performance:
http://review.whamcloud.com/#/c/12109/

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/12109/
Subject: LU-6361 lfsck: measure LFSCK 4 performance
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: db2110a7af734f42a3a0b425feade8498c309895

[Peter Jones]

Landed for 2.8

[John Bent (Inactive)]

Hello, has anyone actually used this awesome sounding patch to measure performance?  We have an RFP that wants 1B namespace entries to be fsck'd in 12 hours.  Anyone have any ideas what a reasonable lfsck rate is?  Thanks!

 

[Andreas Dilger]

Attached are the test results comparing LFSCK phase 3 (DNE support) with LFSCK phase 4 (performance tuning), measured when this work was competed in 2015.