[LU-3505] Failure on test suite racer test_1: ASSERTION( !mdd_object_exists(c) ) failed

• Type: Bug
• Resolution: Unresolved
• Priority: Minor
• Affects Version/s: Lustre 2.4.1, Lustre 2.5.0
• Labels: yuc2
• Environment: server and client: lustre-master build #1536; client is running FC18
• Severity: 3
• Assignee: Lai Siyao
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: http://maloo.whamcloud.com/test_sets/4a81e8ac-dcc9-11e2-8c97-52540035b04c.

The sub-test test_1 failed with the following error:

test failed to respond and timed out

MDS console:

16:14:21:Lustre: DEBUG MARKER: == racer test 1: racer on clients: client-14vm1,client-14vm2.lab.whamcloud.com DURATION=900 ========== 16:17:28 (1372029448)
16:14:21:Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:mdt
16:14:43:LustreError: 8932:0:(osd_oi.c:630:osd_oi_insert()) lustre-MDT0000: the FID [0x200000400:0x1fb:0x0] is used by two objects: 178/3292964813 201/3292964829
16:18:26:LustreError: 8914:0:(osd_oi.c:630:osd_oi_insert()) lustre-MDT0000: the FID [0x200000402:0x1618:0x0] is used by two objects: 409/3292973200 464/3292973217
16:22:10:LustreError: 8916:0:(mdd_object.c:380:mdd_object_create_internal()) ASSERTION( !mdd_object_exists(c) ) failed: 
16:22:10:LustreError: 8916:0:(mdd_object.c:380:mdd_object_create_internal()) LBUG
16:22:10:Pid: 8916, comm: mdt00_014
16:22:10:
16:22:10:Call Trace:
16:22:10: [<ffffffffa0ba7895>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
16:22:10: [<ffffffffa0ba7e97>] lbug_with_loc+0x47/0xb0 [libcfs]
16:22:10: [<ffffffffa1588810>] mdd_declare_object_create_internal+0x0/0x1f0 [mdd]
16:22:10: [<ffffffffa159925c>] mdd_create+0xa3c/0x1740 [mdd]
16:22:10: [<ffffffffa05fcc20>] ? lod_index_lookup+0x0/0x30 [lod]
16:22:10: [<ffffffffa055ffdf>] mdt_reint_open+0x135f/0x20c0 [mdt]
16:22:10: [<ffffffffa0bc45ee>] ? upcall_cache_get_entry+0x28e/0x860 [libcfs]
16:22:10: [<ffffffffa12f6ffc>] ? lustre_msg_add_version+0x6c/0xc0 [ptlrpc]
16:22:10: [<ffffffffa0ceedc0>] ? lu_ucred+0x20/0x30 [obdclass]
16:22:10: [<ffffffffa054a951>] mdt_reint_rec+0x41/0xe0 [mdt]
16:22:10: [<ffffffffa052fb73>] mdt_reint_internal+0x4c3/0x780 [mdt]
16:22:10: [<ffffffffa05300fd>] mdt_intent_reint+0x1ed/0x520 [mdt]
16:22:10: [<ffffffffa052df6e>] mdt_intent_policy+0x3ae/0x770 [mdt]
16:22:10: [<ffffffffa12ae441>] ldlm_lock_enqueue+0x361/0x8d0 [ptlrpc]
16:22:10: [<ffffffffa12d53bf>] ldlm_handle_enqueue0+0x4ef/0x10b0 [ptlrpc]
16:22:10: [<ffffffffa052e436>] mdt_enqueue+0x46/0xe0 [mdt]
16:22:10: [<ffffffffa0534b88>] mdt_handle_common+0x648/0x1660 [mdt]
16:22:10: [<ffffffffa056e335>] mds_regular_handle+0x15/0x20 [mdt]
16:22:10: [<ffffffffa1307598>] ptlrpc_server_handle_request+0x398/0xc60 [ptlrpc]
16:22:10: [<ffffffffa0ba854e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
16:22:10: [<ffffffffa0bb9c2f>] ? lc_watchdog_touch+0x6f/0x170 [libcfs]
16:22:10: [<ffffffffa12fe959>] ? ptlrpc_wait_event+0xa9/0x290 [ptlrpc]
16:22:10: [<ffffffff81055ab3>] ? __wake_up+0x53/0x70
16:22:10: [<ffffffffa130892e>] ptlrpc_main+0xace/0x1700 [ptlrpc]
16:22:10: [<ffffffffa1307e60>] ? ptlrpc_main+0x0/0x1700 [ptlrpc]
16:22:10: [<ffffffff81096936>] kthread+0x96/0xa0
16:22:10: [<ffffffff8100c0ca>] child_rip+0xa/0x20
16:22:10: [<ffffffff810968a0>] ? kthread+0x0/0xa0
16:22:10: [<ffffffff8100c0c0>] ? child_rip+0x0/0x20
16:22:10:
16:22:10:Kernel panic - not syncing: LBUG
16:22:10:Pid: 8916, comm: mdt00_014 Not tainted 2.6.32-358.11.1.el6_lustre.x86_64 #1
16:22:10:Call Trace:
16:22:10: [<ffffffff8150d8f8>] ? panic+0xa7/0x16f
16:22:10: [<ffffffffa0ba7eeb>] ? lbug_with_loc+0x9b/0xb0 [libcfs]
16:22:10: [<ffffffffa1588810>] ? mdd_declare_object_create_internal+0x0/0x1f0 [mdd]
16:22:10: [<ffffffffa159925c>] ? mdd_create+0xa3c/0x1740 [mdd]
16:22:10: [<ffffffffa05fcc20>] ? lod_index_lookup+0x0/0x30 [lod]
16:22:10: [<ffffffffa055ffdf>] ? mdt_reint_open+0x135f/0x20c0 [mdt]
16:22:11: [<ffffffffa0bc45ee>] ? upcall_cache_get_entry+0x28e/0x860 [libcfs]
16:22:11: [<ffffffffa12f6ffc>] ? lustre_msg_add_version+0x6c/0xc0 [ptlrpc]
16:22:11: [<ffffffffa0ceedc0>] ? lu_ucred+0x20/0x30 [obdclass]
16:22:11: [<ffffffffa054a951>] ? mdt_reint_rec+0x41/0xe0 [mdt]
16:22:11: [<ffffffffa052fb73>] ? mdt_reint_internal+0x4c3/0x780 [mdt]
16:22:11: [<ffffffffa05300fd>] ? mdt_intent_reint+0x1ed/0x520 [mdt]
16:22:11: [<ffffffffa052df6e>] ? mdt_intent_policy+0x3ae/0x770 [mdt]
16:22:11: [<ffffffffa12ae441>] ? ldlm_lock_enqueue+0x361/0x8d0 [ptlrpc]
16:22:11: [<ffffffffa12d53bf>] ? ldlm_handle_enqueue0+0x4ef/0x10b0 [ptlrpc]
16:22:11: [<ffffffffa052e436>] ? mdt_enqueue+0x46/0xe0 [mdt]
16:22:11: [<ffffffffa0534b88>] ? mdt_handle_common+0x648/0x1660 [mdt]
16:22:11: [<ffffffffa056e335>] ? mds_regular_handle+0x15/0x20 [mdt]
16:22:11: [<ffffffffa1307598>] ? ptlrpc_server_handle_request+0x398/0xc60 [ptlrpc]
16:22:11: [<ffffffffa0ba854e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
16:22:11: [<ffffffffa0bb9c2f>] ? lc_watchdog_touch+0x6f/0x170 [libcfs]
16:22:11: [<ffffffffa12fe959>] ? ptlrpc_wait_event+0xa9/0x290 [ptlrpc]
16:22:11: [<ffffffff81055ab3>] ? __wake_up+0x53/0x70
16:22:11: [<ffffffffa130892e>] ? ptlrpc_main+0xace/0x1700 [ptlrpc]
16:22:11: [<ffffffffa1307e60>] ? ptlrpc_main+0x0/0x1700 [ptlrpc]
16:22:11: [<ffffffff81096936>] ? kthread+0x96/0xa0
16:22:11: [<ffffffff8100c0ca>] ? child_rip+0xa/0x20
16:22:11: [<ffffffff810968a0>] ? kthread+0x0/0xa0
16:22:11: [<ffffffff8100c0c0>] ? child_rip+0x0/0x20
16:22:11:Initializing cgroup subsys cpuset
16:22:11:Initializing cgroup subsys cpu