[LU-11857] repeated "could not delete orphan [0x200060151:0x38a8:0x0]: rc = -2" messages

• Type: Bug
• Resolution: Duplicate
• Priority: Minor
• Severity: 3
• Assignee: Alex Zhuravlev
• Reporter: Jeff Johnson (Inactive)

Description

After upgrade from 2.9 to 2.12 the MDS syslog gets beaucoup error messages lfs-MDD0000 cannot delete orphan messages. On the active MDS the orph_lfs-MDD00 process is pegged at 100%

[Sat Jan 12 23:21:18 2019] LustreError: 14125:0:(mdd_orphans.c:327:mdd_orphan_destroy()) lfs-MDD0000: could not delete orphan [0x200060151:0x38a8:0x0]: rc = -2
[Sat Jan 12 23:21:18 2019] LustreError: 14125:0:(mdd_orphans.c:327:mdd_orphan_destroy()) Skipped 8067628 previous similar messages
[Sat Jan 12 23:31:18 2019] LustreError: 14125:0:(mdd_orphans.c:327:mdd_orphan_destroy()) lfs-MDD0000: could not delete orphan [0x200060151:0x38a8:0x0]: rc = -2
[Sat Jan 12 23:31:18 2019] LustreError: 14125:0:(mdd_orphans.c:327:mdd_orphan_destroy()) Skipped 7958773 previous similar messages
[Sat Jan 12 23:41:18 2019] LustreError: 14125:0:(mdd_orphans.c:327:mdd_orphan_destroy()) lfs-MDD0000: could not delete orphan [0x200060151:0x38a8:0x0]: rc = -2

Issue Links

• is related to: LU-11418 hung threads on MDT and MDT won't umount

Comments

[Peter Jones]

No objections it seems

[Peter Jones]

So, it seems like this is believed to be a duplicate of the recently landed LU-11418 fix. Jeff, if this issue is not currently causing MSU any heartburn and explicitly trying to prove/disprove whether the theory is sound would be disruptive, is it enough to close this ticket as a duplicate of LU-11418 and reopen it if it is seen on a release including the fix (2.13, or an upcoming 2.12.x maintenance releases)

[Andreas Dilger]

The patch has passed review and testing and is scheduled to land in 2.13 shortly. This should avoid the repeated attempts to destroy the same object.

[Jeff Johnson (Inactive)]

I can. This is a production LFS. Given that there is data in place, should I? Not arguing, just applying caution and respect for end user's data.

[Alex Zhuravlev]

aeonjeffjcan you please try https://review.whamcloud.com/#/c/33661/ ?

[Alex Zhuravlev]

I think https://review.whamcloud.com/#/c/33661/ should help

[Jeff Johnson (Inactive)]

After seven hours the orph_lfs-MDD00 thread still pegged at 100%

Attaching orph_100pct_201901142137.txt.bz2