[#LU-1453] LFSCK 4: Improve OI scrub trigger strategy: do not trigger urgent OI scrub on the whole system if only few inconsistent OI entries are found

LFSCK 4: improve LFSCK performance (LU-6361) [LU-1453] LFSCK 4: Improve OI scrub trigger strategy: do not trigger urgent OI scrub on the whole system if only few inconsistent OI entries are found Created: 31/May/12 Updated: 13/Mar/15 Resolved: 20/Jan/15
Status:	Resolved
Project:	Lustre
Component/s:	None
Affects Version/s:	Lustre 2.7.0, Lustre 2.5.3
Fix Version/s:	Lustre 2.7.0, Lustre 2.5.4

Type:

Technical task

Priority:

Critical

Reporter:

nasf (Inactive)

Assignee:

nasf (Inactive)

Resolution:

Fixed

Votes:

Labels:

HB, LFSCK

Issue Links:

Related
is related to	~~LU-6012~~	sanity-scrub test_6 test_7 test_8 tes...	Resolved

Rank (Obsolete):

10228

Description

Generally, scanning the whole device for OI scrub routine check may take a long time. If the whole system only contains a few bad OI mappings, then it is not prudent to trigger OI scrub automatically with full speed when bad OI mapping is auto-detected. Instead, We should make the OI scrub to fix the found bad OI mappings only, and if more and more bad OI mappings are found that exceeds some given threshold, the OI scrub will run with full speed to scan whole device. The threshold of bad OI mappings that will trigger a complete scan can be adjusted via a proc interface.

Comments

Comment by Gerrit Updater [ 15/Nov/14 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/12738
Subject: ~~LU-1453~~ scrub: auto trigger OI scrub more flexible
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: e90af6e90a76041a09c5c36fc2ac52ece3f84222

Comment by Gerrit Updater [ 15/Nov/14 ]

Comment by Gerrit Updater [ 17/Nov/14 ]

Comment by Gerrit Updater [ 03/Dec/14 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/12738/
Subject: ~~LU-1453~~ scrub: auto trigger OI scrub more flexible
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2c5b57ca3aaf1d27a24bce028220355a005dde3d

Comment by nasf (Inactive) [ 03/Dec/14 ]

The patch has been landed to master.

Comment by Gerrit Updater [ 05/Dec/14 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/12958
Subject: ~~LU-1453~~ scrub: rename confused name full_scrub_speed
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c08581fc842c6b1ffeb89af58d6bc07989e3c47a

Comment by nasf (Inactive) [ 07/Dec/14 ]

There are some other patch(es) to be landed.

Comment by Gerrit Updater [ 10/Dec/14 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/13021
Subject: ~~LU-1453~~ tests: scrub interoperability issues with master
Project: fs/lustre-release
Branch: b2_5
Current Patch Set: 1
Commit: 09a685b0b02fe19300167c2dcb60773fa4830b72

Comment by Gerrit Updater [ 10/Jan/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/12958/
Subject: ~~LU-1453~~ scrub: rename confused name full_scrub_speed
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2d3d4525b1ac6697b5df207400801c4399d20378

Comment by nasf (Inactive) [ 20/Jan/15 ]

Although the patch 12958 has been landed to master, we still need the patch 13021 on b2_5 to avoid interoperability issues.

Comment by Peter Jones [ 20/Jan/15 ]

Landed for 2.7. Will track 2.5.x landing separately

Comment by Gerrit Updater [ 25/Jan/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/13021/
Subject: ~~LU-1453~~ tests: scrub interoperability issues with master
Project: fs/lustre-release
Branch: b2_5
Current Patch Set:
Commit: e677ff40708dae0b216df9e6316227effe134de3

Generated at Sat Feb 10 01:16:46 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.

[LU-1453] LFSCK 4: Improve OI scrub trigger strategy: do not trigger urgent OI scrub on the whole system if only few inconsistent OI entries are found Created: 31/May/12 Updated: 13/Mar/15 Resolved: 20/Jan/15