[LU-2412] Interop 2.3<->2.4 Failure on test suite parallel-scale test_compilebench: multiple LBUG ASSERTION( dt->do_ops ) / ASSERTION( (desc->bd_export != ((void *)0)) ^ (desc->bd_import != ((void *)0)) )

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.4.0
• Type: Bug
• Priority: Minor
• Reporter: Maloo
• Assignee: WC Triage
• Resolution: Duplicate

Environment

server 2.3 RHEL6
client lustre-master build# 1065 RHEL6

• Severity: 3

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/6e479c78-3986-11e2-9fda-52540035b04c.

The sub-test test_compilebench failed with the following error:

test failed to respond and timed out

23:05:50:Lustre: DEBUG MARKER: == parallel-scale test compilebench: compilebench == 23:05:40 (1354086340)
23:05:50:Lustre: DEBUG MARKER: /usr/sbin/lctl mark .\/compilebench -D \/mnt\/lustre\/d0.compilebench -i 4         -r 4 --makej
23:05:50:Lustre: DEBUG MARKER: ./compilebench -D /mnt/lustre/d0.compilebench -i 4 -r 4 --makej
23:06:22:LustreError: 15475:0:(dt_object.h:959:dt_attr_get()) ASSERTION( dt->do_ops ) failed: 
23:06:22:LustreError: 15475:0:(dt_object.h:959:dt_attr_get()) LBUG
23:06:22:Pid: 15475, comm: ll_ost00_003
23:06:22:
23:06:22:Call Trace:
23:06:22: [<ffffffffa0e5e905>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
23:06:22: [<ffffffffa0e5ef17>] lbug_with_loc+0x47/0xb0 [libcfs]
23:06:22: [<ffffffffa0b4fc9b>] ofd_attr_get+0x22b/0x280 [ofd]
23:06:22: [<ffffffffa0b5d926>] ofd_lvbo_init+0x346/0x850 [ofd]
23:06:22: [<ffffffffa06128f3>] ldlm_resource_get+0x373/0x760 [ptlrpc]
23:06:22: [<ffffffffa060d535>] ldlm_lock_create+0x55/0xa50 [ptlrpc]
23:06:22: [<ffffffffa063367e>] ldlm_handle_enqueue0+0x14e/0xf70 [ptlrpc]
23:06:22: [<ffffffffa0634506>] ldlm_handle_enqueue+0x66/0x70 [ptlrpc]
23:06:22: [<ffffffffa0634510>] ? ldlm_server_completion_ast+0x0/0x610 [ptlrpc]
23:06:22: [<ffffffffa0b1ee20>] ? ost_blocking_ast+0x0/0xe60 [ost]
23:06:22: [<ffffffffa062e600>] ? ldlm_server_glimpse_ast+0x0/0x370 [ptlrpc]
23:06:22: [<ffffffffa0b277a3>] ost_handle+0x1d83/0x4850 [ost]
23:06:22: [<ffffffffa0e6f5f1>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
23:06:22: [<ffffffffa0e6b3f4>] ? libcfs_id2str+0x74/0xb0 [libcfs]
23:06:22: [<ffffffffa0663b3c>] ptlrpc_server_handle_request+0x41c/0xe00 [ptlrpc]
23:06:22: [<ffffffffa0e5f65e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
23:06:22: [<ffffffffa065af37>] ? ptlrpc_wait_event+0xa7/0x2a0 [ptlrpc]
23:06:22: [<ffffffff810533f3>] ? __wake_up+0x53/0x70
23:06:22: [<ffffffffa0665111>] ptlrpc_main+0xbf1/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c14a>] child_rip+0xa/0x20
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c140>] ? child_rip+0x0/0x20
23:06:22:
23:06:22:LustreError: 20599:0:(client.c:186:ptlrpc_free_bulk()) ASSERTION( (desc->bd_export != ((void *)0)) ^ (desc->bd_import != ((void *)0)) ) failed: 
23:06:22:LustreError: 20599:0:(client.c:186:ptlrpc_free_bulk()) LBUG
23:06:22:Pid: 20599, comm: ll_ost_io00_059
23:06:22:
23:06:22:Call Trace:
23:06:22: [<ffffffffa0e5e905>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
23:06:22: [<ffffffffa0e5ef17>] lbug_with_loc+0x47/0xb0 [libcfs]
23:06:22: [<ffffffffa0640446>] ptlrpc_free_bulk+0x2b6/0x330 [ptlrpc]
23:06:22: [<ffffffffa0b22611>] ost_brw_write+0x501/0x1600 [ost]
23:06:22: [<ffffffff8127ce76>] ? vsnprintf+0x2b6/0x5f0
23:06:22: [<ffffffffa06140e0>] ? target_bulk_timeout+0x0/0xc0 [ptlrpc]
23:06:22: [<ffffffffa0b2902c>] ost_handle+0x360c/0x4850 [ost]
23:06:22: [<ffffffffa0e6f5f1>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
23:06:22: [<ffffffffa0e6b3f4>] ? libcfs_id2str+0x74/0xb0 [libcfs]
23:06:22: [<ffffffffa0663b3c>] ptlrpc_server_handle_request+0x41c/0xe00 [ptlrpc]
23:06:22: [<ffffffffa0e5f65e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
23:06:22: [<ffffffffa065af37>] ? ptlrpc_wait_event+0xa7/0x2a0 [ptlrpc]
23:06:22: [<ffffffff810533f3>] ? __wake_up+0x53/0x70
23:06:22: [<ffffffffa0665111>] ptlrpc_main+0xbf1/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c14a>] child_rip+0xa/0x20
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c140>] ? child_rip+0x0/0x20
23:06:22:
23:06:22:LustreError: 20556:0:(client.c:186:ptlrpc_free_bulk()) ASSERTION( (desc->bd_export != ((void *)0)) ^ (desc->bd_import != ((void *)0)) ) failed: 
23:06:22:LustreError: 20556:0:(client.c:186:ptlrpc_free_bulk()) LBUG
23:06:22:Pid: 20556, comm: ll_ost_io00_041
23:06:22:
23:06:22:Call Trace:
23:06:22: [<ffffffffa0e5e905>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
23:06:22: [<ffffffffa0e5ef17>] lbug_with_loc+0x47/0xb0 [libcfs]
23:06:22: [<ffffffffa0640446>] ptlrpc_free_bulk+0x2b6/0x330 [ptlrpc]
23:06:22: [<ffffffffa0b22611>] ost_brw_write+0x501/0x1600 [ost]
23:06:22: [<ffffffff8127ce76>] ? vsnprintf+0x2b6/0x5f0
23:06:22: [<ffffffffa06140e0>] ? target_bulk_timeout+0x0/0xc0 [ptlrpc]
23:06:22: [<ffffffffa0b2902c>] ost_handle+0x360c/0x4850 [ost]
23:06:22: [<ffffffffa0e6f5f1>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
23:06:22: [<ffffffffa0e6b3f4>] ? libcfs_id2str+0x74/0xb0 [libcfs]
23:06:22: [<ffffffffa0663b3c>] ptlrpc_server_handle_request+0x41c/0xe00 [ptlrpc]
23:06:22: [<ffffffffa0e5f65e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
23:06:22: [<ffffffffa065af37>] ? ptlrpc_wait_event+0xa7/0x2a0 [ptlrpc]
23:06:22: [<ffffffff810533f3>] ? __wake_up+0x53/0x70
23:06:22: [<ffffffffa0665111>] ptlrpc_main+0xbf1/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c14a>] child_rip+0xa/0x20
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c140>] ? child_rip+0x0/0x20
23:06:22:
23:06:22:LustreError: 18783:0:(client.c:186:ptlrpc_free_bulk()) ASSERTION( (desc->bd_export != ((void *)0)) ^ (desc->bd_import != ((void *)0)) ) failed: 
23:06:22:LustreError: 18783:0:(client.c:186:ptlrpc_free_bulk()) LBUG
23:06:22:Pid: 18783, comm: ll_ost_io00_015
23:06:22:
23:06:22:Call Trace:
23:06:22: [<ffffffffa0e5e905>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
23:06:22: [<ffffffffa0e5ef17>] lbug_with_loc+0x47/0xb0 [libcfs]
23:06:22: [<ffffffffa0640446>] ptlrpc_free_bulk+0x2b6/0x330 [ptlrpc]
23:06:22: [<ffffffffa0b22611>] ost_brw_write+0x501/0x1600 [ost]
23:06:22: [<ffffffff8127ce76>] ? vsnprintf+0x2b6/0x5f0
23:06:22: [<ffffffffa06140e0>] ? target_bulk_timeout+0x0/0xc0 [ptlrpc]
23:06:22: [<ffffffffa0b2902c>] ost_handle+0x360c/0x4850 [ost]
23:06:22: [<ffffffffa0e6f5f1>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
23:06:22: [<ffffffffa0e6b3f4>] ? libcfs_id2str+0x74/0xb0 [libcfs]
23:06:22: [<ffffffffa0663b3c>] ptlrpc_server_handle_request+0x41c/0xe00 [ptlrpc]
23:06:22: [<ffffffffa0e5f65e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
23:06:22: [<ffffffffa065af37>] ? ptlrpc_wait_event+0xa7/0x2a0 [ptlrpc]
23:06:22: [<ffffffff810533f3>] ? __wake_up+0x53/0x70
23:06:22: [<ffffffffa0665111>] ptlrpc_main+0xbf1/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c14a>] child_rip+0xa/0x20
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c140>] ? child_rip+0x0/0x20
23:06:22:
23:06:22:LustreError: 20566:0:(client.c:186:ptlrpc_free_bulk()) ASSERTION( (desc->bd_export != ((void *)0)) ^ (desc->bd_import != ((void *)0)) ) failed: 
23:06:22:LustreError: 20566:0:(client.c:186:ptlrpc_free_bulk()) LBUG
23:06:22:Pid: 20566, comm: ll_ost_io00_048
23:06:22:
23:06:22:Call Trace:
23:06:22: [<ffffffffa0e5e905>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
23:06:22: [<ffffffffa0e5ef17>] lbug_with_loc+0x47/0xb0 [libcfs]
23:06:22: [<ffffffffa0640446>] ptlrpc_free_bulk+0x2b6/0x330 [ptlrpc]
23:06:22: [<ffffffffa0b22611>] ost_brw_write+0x501/0x1600 [ost]
23:06:22: [<ffffffff8127ce76>] ? vsnprintf+0x2b6/0x5f0
23:06:22: [<ffffffffa06140e0>] ? target_bulk_timeout+0x0/0xc0 [ptlrpc]
23:06:22: [<ffffffffa0b2902c>] ost_handle+0x360c/0x4850 [ost]
23:06:22: [<ffffffffa0e6f5f1>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
23:06:22: [<ffffffffa0e6b3f4>] ? libcfs_id2str+0x74/0xb0 [libcfs]
23:06:22: [<ffffffffa0663b3c>] ptlrpc_server_handle_request+0x41c/0xe00 [ptlrpc]
23:06:22: [<ffffffffa0e5f65e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
23:06:22: [<ffffffffa065af37>] ? ptlrpc_wait_event+0xa7/0x2a0 [ptlrpc]
23:06:22: [<ffffffff810533f3>] ? __wake_up+0x53/0x70
23:06:22: [<ffffffffa0665111>] ptlrpc_main+0xbf1/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c14a>] child_rip+0xa/0x20
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffffa0664520>] ? ptlrpc_main+0x0/0x19e0 [ptlrpc]
23:06:22: [<ffffffff8100c140>] ? child_rip+0x0/0x20
23:06:22:
23:06:22:BUG: unable to handle kernel NULL pointer dereference at 0000000000000008

Comments

[Peter Jones]

duplicate of LU-2406