[LU-6420] layout LFSCK fixing dangling/unmatched_pair during soak tests unexpectedly Created: 02/Apr/15  Updated: 21/Dec/17  Resolved: 21/Dec/17

Status: Closed
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.8.0

Type: Bug Priority: Critical
Reporter: nasf (Inactive) Assignee: nasf (Inactive)
Resolution: Duplicate Votes: 0
Labels: None

Issue Links:
Duplicate
duplicates LU-10422 layout LFSCK try to fix consistent ow... Resolved
is duplicated by LU-10349 debug and cleanup of corrupted PFID, ... Resolved
Related
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

We have noticed that lfsck is sometimes fixing dangling/unmatched_pair on the soak cluster which is pretty unexpected:
repaired_dangling: 2108
repaired_unmatched_pair: 7527414
We are running metadata tests with striped directories and MDT failover. We are investigating the root cause ...

 Comments   
Comment by nasf (Inactive) [ 02/Apr/15 ]

Here is the patch:
http://review.whamcloud.com/#/c/14332/

Comment by Cliff White (Inactive) [ 07/Apr/15 ]

This patch does not apply cleanly to current master, we have been unable to test it - can we have an updated version, please?

Comment by nasf (Inactive) [ 07/Apr/15 ]

Have you tried the single patch http://review.whamcloud.com/#/c/14332/ or all its dependent patches? We need the later case.

Comment by Cliff White (Inactive) [ 24/Apr/15 ]

We have tested now with the 14332 patch and all dependent patches, the errors continue. 

2015-04-22 18:33:12,077:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_multiple_referenced: 0
2015-04-22 18:33:12,077:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_orphan: 0
2015-04-22 18:33:12,077:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_inconsistent_owner: 2670573
2015-04-22 18:33:12,077:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_others: 0
2015-04-22 18:33:27,360:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_dangling: 0
2015-04-22 18:33:27,360:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_unmatched_pair: 0
2015-04-22 18:33:27,360:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_multiple_referenced: 0
2015-04-22 18:33:27,361:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_orphan: 0
2015-04-22 18:33:27,361:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_inconsistent_owner: 2670573
2015-04-22 18:33:27,361:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_others: 0
2015-04-22 18:33:42,649:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_dangling: 0
2015-04-22 18:33:42,649:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_unmatched_pair: 0
2015-04-22 18:33:42,649:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_multiple_referenced: 0
2015-04-22 18:33:42,650:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_orphan: 0
2015-04-22 18:33:42,650:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_inconsistent_owner: 2670573
2015-04-22 18:33:42,650:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_others: 0
2015-04-22 18:33:57,933:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_dangling: 0
2015-04-22 18:33:57,934:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_unmatched_pair: 0
2015-04-22 18:33:57,934:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_multiple_referenced: 0
2015-04-22 18:33:57,934:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_orphan: 0
2015-04-22 18:33:57,934:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_inconsistent_owner: 2670573
2015-04-22 18:33:57,935:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_others: 0
2015-04-22 18:34:13,220:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_dangling: 0
2015-04-22 18:34:13,220:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_unmatched_pair: 0
2015-04-22 18:34:13,221:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_multiple_referenced: 0
2015-04-22 18:34:13,221:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_orphan: 0
2015-04-22 18:34:13,221:fsmgmt.fsmgmt:ERROR    lfsck found errors lola-8/soaked-MDT0000: repaired_inconsistent_owner: 2670573
Comment by nasf (Inactive) [ 27/Apr/15 ]

The unexpected "repaired_unmatched_pair" disappeared, we still more work about the unexpected "repaired_inconsistent_owner" issues.

Comment by Gerrit Updater [ 30/May/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14332/
Subject: LU-6420 lfsck: misc patch to avoid unexpected repairing
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: cb7da2d4c0241f52dec5e05c57847ad6cd0dbb83

Comment by Peter Jones [ 30/May/15 ]

Landed for 2.8

Comment by nasf (Inactive) [ 20/Dec/17 ]

We need more work to resolve the unexpected inconsistent owner issue

Comment by Gerrit Updater [ 20/Dec/17 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: https://review.whamcloud.com/30612
Subject: LU-6420 lfsck: misc fixes to avoid unexpected repairing
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: bf0448c16e6d311b4773a80ec02ed9c48e8c11f4

Comment by nasf (Inactive) [ 21/Dec/17 ]

We will resolve the unexpected inconsistent owner issue via LU-10422.

Generated at Sat Feb 10 02:00:04 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.