[LU-2821] osd_handler.c:2482:osd_declare_object_ref_del()) ASSERTION( dt_object_exists(dt) && !dt_object_remote(dt) ) failed

• Type: Bug
• Resolution: Cannot Reproduce
• Priority: Critical
• Affects Version/s: Lustre 2.4.0
• Severity: 3
• Assignee: WC Triage
• Reporter: Oleg Drokin

Description

Had this assertion failure in replay-single test 26:

[447277.695681] Lustre: DEBUG MARKER: == replay-single test 27: |X| open(O_CREAT), unlink two, replay, close two (test mds_cleanup_orphans) == 04:43:29 (1360921409)
[447278.101651] Turning device loop0 (0x700000) read-only
[447278.145558] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[447278.152329] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
[447278.795747] Removing read-only on unknown block (0x700000)
[447290.601469] LDISKFS-fs (loop0): recovery complete
[447290.615599] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: 
[447290.655601] LustreError: 5393:0:(ldlm_resource.c:805:ldlm_resource_complain()) Namespace MGC192.168.10.211@tcp resource refcount nonzero (1) after lock cleanup; forcing cleanup.
[447290.656331] LustreError: 5393:0:(ldlm_resource.c:805:ldlm_resource_complain()) Skipped 1 previous similar message
[447290.656915] LustreError: 5393:0:(ldlm_resource.c:811:ldlm_resource_complain()) Resource: ffff88008def0e78 (111542254400876/0/0/0) (rc: 1)
[447290.657404] LustreError: 5393:0:(ldlm_resource.c:811:ldlm_resource_complain()) Skipped 1 previous similar message
[447290.657864] LustreError: 5393:0:(ldlm_resource.c:1404:ldlm_resource_dump()) --- Resource: ffff88008def0e78 (111542254400876/0/0/0) (rc: 2)
[447292.228086] Lustre: lustre-MDT0000-mdc-ffff88005bca2bf0: Connection restored to lustre-MDT0000 (at 0@lo)
[447292.228559] Lustre: Skipped 23 previous similar messages
[447292.241230] LustreError: 5456:0:(osd_handler.c:2482:osd_declare_object_ref_del()) ASSERTION( dt_object_exists(dt) && !dt_object_remote(dt) ) failed: 
[447292.241794] LustreError: 5456:0:(osd_handler.c:2482:osd_declare_object_ref_del()) LBUG
[447292.242247] Pid: 5456, comm: tgt_recov
[447292.242486] 
[447292.242486] Call Trace:
[447292.242862]  [<ffffffffa0cbd915>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[447292.243133]  [<ffffffffa0cbdf17>] lbug_with_loc+0x47/0xb0 [libcfs]
[447292.243393]  [<ffffffffa081ee38>] osd_declare_object_ref_del+0x98/0x130 [osd_ldiskfs]
[447292.243831]  [<ffffffffa098632b>] lod_declare_ref_del+0x3b/0xd0 [lod]
[447292.244094]  [<ffffffffa075fd32>] orph_declare_index_delete+0x112/0x2e0 [mdd]
[447292.244523]  [<ffffffffa0760579>] __mdd_orphan_cleanup+0x679/0xca0 [mdd]
[447292.244828]  [<ffffffffa076f4ad>] mdd_recovery_complete+0xed/0x170 [mdd]
[447292.245135]  [<ffffffffa0894bb5>] mdt_postrecov+0x35/0xd0 [mdt]
[447292.245394]  [<ffffffffa0896638>] mdt_obd_postrecov+0x78/0x90 [mdt]
[447292.245703]  [<ffffffffa1257f90>] ? ldlm_reprocess_res+0x0/0x20 [ptlrpc]
[447292.246005]  [<ffffffffa1268b01>] target_recovery_thread+0xb31/0x1610 [ptlrpc]
[447292.246449]  [<ffffffffa1267fd0>] ? target_recovery_thread+0x0/0x1610 [ptlrpc]
[447292.246866]  [<ffffffff8100c14a>] child_rip+0xa/0x20
[447292.247113]  [<ffffffffa1267fd0>] ? target_recovery_thread+0x0/0x1610 [ptlrpc]
[447292.247552]  [<ffffffffa1267fd0>] ? target_recovery_thread+0x0/0x1610 [ptlrpc]
[447292.247971]  [<ffffffff8100c140>] ? child_rip+0x0/0x20
[447292.248208] 
[447292.304220] Kernel panic - not syncing: LBUG

Crashdump and modules in /exports/crashdumps/192.168.10.211-2013-02-15-04\:43\:51

Issue Links

• is related to: LU-5565 (osd_handler.c:1959:osd_attr_set()) ASSERTION( dt_object_exists(dt) && !dt_object_remote(dt) ) failed