[LU-5163] (lu_object.h:852:lu_object_attr()) ASSERTION( ((o)->lo_header->loh_attr & LOHA_EXISTS) != 0 ) failed

• Type: Bug
• Resolution: Fixed
• Priority: Blocker
• Fix Version/s: Lustre 2.11.0, Lustre 2.10.4
• Affects Version/s: Lustre 2.6.0, Lustre 2.7.0, Lustre 2.11.0, Lustre 2.10.2
• Labels: dne2 mdd migration
• Severity: 3
• Assignee: Lai Siyao
• Reporter: John Hammond

Description

Running racer on 2.5.59-66-g47cde80 with MDSCOUNT=4 and file_create.sh modified to do fewer writes.

[ 2383.017816] LustreError: 16406:0:(lu_object.h:852:lu_object_attr()) ASSERTION( ((o)->lo_header->loh_attr & LOHA_EXISTS) != 0 ) failed: 
[ 2383.020138] LustreError: 16406:0:(lu_object.h:852:lu_object_attr()) LBUG
[ 2383.021290] Pid: 16406, comm: mdt00_002
[ 2383.021909] 
[ 2383.021910] Call Trace:
[ 2383.022612]  [<ffffffffa02be8c5>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[ 2383.023915]  [<ffffffffa02beec7>] lbug_with_loc+0x47/0xb0 [libcfs]
[ 2383.025200]  [<ffffffffa0bc6e8b>] mdd_migrate_entries+0xffb/0x1100 [mdd]
[ 2383.026503]  [<ffffffffa0bc7af7>] mdd_migrate+0xb67/0x13d0 [mdd]
[ 2383.027666]  [<ffffffffa0afc61b>] ? osd_object_read_unlock+0x8b/0xd0 [osd_ldiskfs]
[ 2383.029154]  [<ffffffffa0c25c78>] mdt_reint_migrate_internal+0x15c8/0x1b40 [mdt]
[ 2383.030578]  [<ffffffff815547cb>] ? _spin_unlock+0x2b/0x40
[ 2383.031524]  [<ffffffffa0c299d3>] mdt_reint_rename_or_migrate+0x2a3/0x660 [mdt]
[ 2383.032776]  [<ffffffffa0c03c95>] ? mdt_ucred+0x15/0x20 [mdt]
[ 2383.033739]  [<ffffffffa0c1e4cc>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
[ 2383.034849]  [<ffffffffa06b7026>] ? __req_capsule_get+0x166/0x6e0 [ptlrpc]
[ 2383.035986]  [<ffffffffa0c29da3>] mdt_reint_migrate+0x13/0x20 [mdt]
[ 2383.037045]  [<ffffffffa0c223e1>] mdt_reint_rec+0x41/0xe0 [mdt]
[ 2383.038083]  [<ffffffffa0c07e43>] mdt_reint_internal+0x4c3/0x7c0 [mdt]
[ 2383.039234]  [<ffffffffa0c086cb>] mdt_reint+0x6b/0x120 [mdt]
[ 2383.040228]  [<ffffffffa06f0a85>] tgt_request_handle+0x245/0xad0 [ptlrpc]
[ 2383.041371]  [<ffffffffa06a18d1>] ptlrpc_main+0xce1/0x1970 [ptlrpc]
[ 2383.042435]  [<ffffffffa06a0bf0>] ? ptlrpc_main+0x0/0x1970 [ptlrpc]
[ 2383.043468]  [<ffffffff8109eab6>] kthread+0x96/0xa0
[ 2383.044261]  [<ffffffff8100c30a>] child_rip+0xa/0x20
[ 2383.045066]  [<ffffffff81554710>] ? _spin_unlock_irq+0x30/0x40
[ 2383.045986]  [<ffffffff8100bb10>] ? restore_args+0x0/0x30
[ 2383.046914]  [<ffffffff8109ea20>] ? kthread+0x0/0xa0
[ 2383.047770]  [<ffffffff8100c300>] ? child_rip+0x0/0x20
[ 2383.048666] 
[ 2383.049141] Kernel panic - not syncing: LBUG

This is from mdd_migrate_entries() line 3473.

                child = mdd_object_find(env, mdd, &ent->lde_fid);
                if (IS_ERR(child))
                        GOTO(out, rc = PTR_ERR(child));

                is_dir = S_ISDIR(lu_object_attr(&child->mod_obj.mo_lu));

Issue Links

• is duplicated by: LU-5242 Test hang sanity test_132, test_133: umount ost
• is related to: LU-5388 Interop 2.5.2<->2.6 failure on test suite replay-dual test_24: (lu_object.h:855:lu_object_attr()) ASSERTION( ((o)->lo_header->loh_attr & LOHA_EXISTS) != 0 ) failed
• is related to: LU-11135 racer: ASSERTION( ((o)->lo_header->loh_attr & LOHA_EXISTS) != 0 ) failed: LBUG
• is related to: LU-5125 lu_object_attr() should return 0 for non-existing objects

Comments

[Gerrit Updater]

John L. Hammond ([e-mail]) merged in patch https://review.whamcloud.com/31281/
Subject: LU-5163 mdd: migrated entry may not exist
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: 8af27a326ffebc7c0f40734767035d353bafa43c

[Gerrit Updater]

Minh Diep ([e-mail]) uploaded a new patch: https://review.whamcloud.com/31281
Subject: LU-5163 mdd: migrated entry may not exist
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: dac6aa7caf537d4d3e7a772c36fbdb355da47e56

[Minh Diep]

+1 on b2_10

https://testing.hpdd.intel.com/test_sets/cbf69ae0-0ed3-11e8-a6ad-52540065bddc

[Peter Jones]

ok - thanks!

[Lai Siyao]

Peter, it can be marked as resolved now, and Di's patch is not needed IMHO.

[Peter Jones]

Lai

Can this ticket be marked as resolved now or is Di's patch still needed too?

Peter

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/26620/
Subject: LU-5163 mdd: migrated entry may not exist
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 542b76d142c491a0a1bf8a2f4fd22af4733f59cb

[Sarah Liu]

on 2.10.2
https://testing.hpdd.intel.com/test_sets/c087a034-d4bb-11e7-8027-52540065bddc

[Bob Glossman (Inactive)]

another on master:
https://testing.hpdd.intel.com/test_sets/77756eb8-cb0a-11e7-9c63-52540065bddc

[James Casper (Inactive)]

Seen in master 2.10.55 b3667:

https://testing.hpdd.intel.com/test_sessions/0a9fe899-314e-4874-bd82-8a966bc7ad88