[LU-1772] Test failure on test suite racer, subtest test_1

Sun, 2 Sep 2012 15:06:36 +0000
This issue was created by maloo for sarah <sarah@whamcloud.com>
This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/9d777c2e-e9a0-11e1-881a-52540035b04c.
The sub-test test_1 failed with the following error:
test failed to respond and timed out
There are some hanging threads on client side
14:14:58:Lustre: DEBUG MARKER: == racer test 1: racer on clients: client-26vm5,client-26vm6.lab.whamcloud.com DURATION=900 == 14:14:56 (1345238096)
14:14:59:Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
14:14:59:Lustre: DEBUG MARKER: DURATION=900 /usr/lib64/lustre/tests/racer/racer.sh /mnt/lustre2/racer 
14:15:08:Lustre: DEBUG MARKER: DURATION=900 /usr/lib64/lustre/tests/racer/racer.sh /mnt/lustre/racer 
14:18:31:LustreError: 11-0: an error occurred while communicating with 10.10.4.151@tcp. The ost_write operation failed with -2
14:18:31:LustreError: 11-0: an error occurred while communicating with 10.10.4.151@tcp. The ost_write operation failed with -2
14:18:32:LustreError: 9716:0:(vvp_io.c:1039:vvp_io_commit_write()) Write page 34217 of inode ffff880078a36178 failed -2
14:18:32:Lustre: lustre-MDT0000-mdc-ffff880074b62000: Connection to lustre-MDT0000 (at 10.10.4.150@tcp) was lost; in progress operations using this service will wait for recovery to complete
14:18:32:LustreError: 167-0: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
14:18:32:LustreError: 9716:0:(file.c:155:ll_close_inode_openhandle()) inode 144115205272502283 mdc close failed: rc = -5
14:18:32:LustreError: 23544:0:(ldlm_resource.c:761:ldlm_resource_complain()) Namespace lustre-MDT0000-mdc-ffff880074b62000 resource refcount nonzero (1) after lock cleanup; forcing cleanup.
14:18:34:LustreError: 23544:0:(ldlm_resource.c:767:ldlm_resource_complain()) Resource: ffff88007a1c2480 (8589935617/1747/0/0) (rc: 1)
14:18:34:Lustre: lustre-MDT0000-mdc-ffff880074b62000: Connection restored to lustre-MDT0000 (at 10.10.4.150@tcp)
14:18:36:LustreError: 11-0: an error occurred while communicating with 10.10.4.151@tcp. The obd_ping operation failed with -107
14:18:36:LustreError: Skipped 1 previous similar message
14:18:36:Lustre: lustre-OST0001-osc-ffff880074b62000: Connection to lustre-OST0001 (at 10.10.4.151@tcp) was lost; in progress operations using this service will wait for recovery to complete
14:18:36:LustreError: 167-0: This client was evicted by lustre-OST0001; in progress operations using this service will fail.
14:19:14:INFO: task ldlm_bl_02:8789 blocked for more than 120 seconds.
14:19:14:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:14:ldlm_bl_02    D 0000000000000000     0  8789      2 0x00000080
14:19:15: ffff8800763fdd50 0000000000000046 0000000100000000 0000000000000000
14:19:15: ffff8800763fdce0 ffffffffa04fb262 ffff8800763fdd40 0000000000000001
14:19:15: ffff8800377e4638 ffff8800763fdfd8 000000000000fb88 ffff8800377e4638
14:19:15:Call Trace:
14:19:15: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:15: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:15: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:15: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:15: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:15: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:15: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:15: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:15: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:17: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:17: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:17: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:17: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:17: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:17: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:17:INFO: task ldlm_bl_03:8790 blocked for more than 120 seconds.
14:19:17:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:17:ldlm_bl_03    D 0000000000000000     0  8790      2 0x00000080
14:19:17: ffff880052c8dd50 0000000000000046 0000000100000000 0000000000000000
14:19:18: ffff880052c8dce0 ffffffffa04fb262 ffff880052c8dd40 0000000000000001
14:19:18: ffff88007a4545f8 ffff880052c8dfd8 000000000000fb88 ffff88007a4545f8
14:19:18:Call Trace:
14:19:18: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:18: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:18: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:19: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:19: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:19: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:19: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:19: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:19: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:19: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:19: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:19: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:19: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:19: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:19: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:19:INFO: task ldlm_bl_05:9660 blocked for more than 120 seconds.
14:19:19:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:19:ldlm_bl_05    D 0000000000000000     0  9660      2 0x00000080
14:19:19: ffff88007adbbd50 0000000000000046 0000000100000000 0000000000000000
14:19:20: ffff88007adbbce0 ffffffffa04fb262 ffff88007adbbd40 0000000000000001
14:19:20: ffff880075433098 ffff88007adbbfd8 000000000000fb88 ffff880075433098
14:19:20:Call Trace:
14:19:21: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:21: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:21: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:21: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:21: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:21: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:21: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:22: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:22: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:22: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:22: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:22: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:22: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:22: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:22: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:22:INFO: task ldlm_bl_08:9663 blocked for more than 120 seconds.
14:19:22:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:23:ldlm_bl_08    D 0000000000000000     0  9663      2 0x00000080
14:19:23: ffff88007ade1d50 0000000000000046 0000000100000000 0000000000000000
14:19:24: ffff88007ade1ce0 ffffffffa04fb262 ffff88007ade1d40 0000000000000001
14:19:24: ffff88007a1ce5f8 ffff88007ade1fd8 000000000000fb88 ffff88007a1ce5f8
14:19:24:Call Trace:
14:19:24: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:24: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:24: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:24: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:24: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:24: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:24: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:24: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:24: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:25: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:25: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:25: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:27: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:27: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:27: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:27:INFO: task ldlm_bl_12:9667 blocked for more than 120 seconds.
14:19:27:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:27:ldlm_bl_12    D 0000000000000000     0  9667      2 0x00000080
14:19:27: ffff880053011ad8 0000000000000046 000000000027a41e ffff880078a56030
14:19:27: ffff880078a57000 ffff880053011a90 ffffffff81039678 ffff8800ffffffff
14:19:27: ffff88005300fab8 ffff880053011fd8 000000000000fb88 ffff88005300fab8
14:19:28:Call Trace:
14:19:28: [<ffffffff81039678>] ? pvclock_clocksource_read+0x58/0xd0
14:19:28: [<ffffffff814ffec5>] rwsem_down_failed_common+0x95/0x1d0
14:19:28: [<ffffffff81500056>] rwsem_down_read_failed+0x26/0x30
14:19:28: [<ffffffff8127e664>] call_rwsem_down_read_failed+0x14/0x30
14:19:28: [<ffffffff814ff554>] ? down_read+0x24/0x30
14:19:28: [<ffffffffa09a4f04>] lov_lsm_addref+0x34/0x150 [lov]
14:19:28: [<ffffffffa09a56e5>] lov_io_init+0x75/0x1c0 [lov]
14:19:28: [<ffffffffa0659378>] cl_io_init0+0x98/0x160 [obdclass]
14:19:29: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:29: [<ffffffffa065c264>] cl_io_init+0x64/0x100 [obdclass]
14:19:29: [<ffffffffa0653fa4>] cl_lock_discard_pages+0x64/0x1f0 [obdclass]
14:19:30: [<ffffffffa09004e0>] osc_lock_flush+0x110/0x200 [osc]
14:19:30: [<ffffffffa0900629>] osc_lock_cancel+0x59/0x1a0 [osc]
14:19:30: [<ffffffffa0651dc5>] cl_lock_cancel0+0x75/0x160 [obdclass]
14:19:30: [<ffffffffa0652a2b>] cl_lock_cancel+0x13b/0x140 [obdclass]
14:19:30: [<ffffffffa090230a>] osc_ldlm_blocking_ast+0x13a/0x380 [osc]
14:19:30: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:31: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:31: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:31: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:31: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:31: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:31: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:31: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:31:INFO: task ldlm_bl_13:9668 blocked for more than 120 seconds.
14:19:32:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:32:ldlm_bl_13    D 0000000000000000     0  9668      2 0x00000080
14:19:32: ffff880053015d50 0000000000000046 0000000100000000 0000000000000000
14:19:32: ffff880053015ce0 ffffffffa04fb262 ffff880053015d40 0000000000000001
14:19:32: ffff88005300f058 ffff880053015fd8 000000000000fb88 ffff88005300f058
14:19:32:Call Trace:
14:19:33: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:33: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:33: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:33: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:33: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:34: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:34: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:34: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:34: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:34: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:34: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:35: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:35: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:35: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:35: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:35:INFO: task ldlm_bl_15:9676 blocked for more than 120 seconds.
14:19:35:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:35:ldlm_bl_15    D 0000000000000000     0  9676      2 0x00000080
14:19:36: ffff880053155d50 0000000000000046 0000000100000000 0000000000000000
14:19:36: ffff880053155ce0 ffffffffa04fb262 ffff880053155d40 0000000000000001
14:19:36: ffff880053057af8 ffff880053155fd8 000000000000fb88 ffff880053057af8
14:19:36:Call Trace:
14:19:36: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:36: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:36: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:36: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:36: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:36: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:37: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:37: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:37: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:37: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:37: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:37: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:38: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:38: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:38: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:39:INFO: task ldlm_bl_18:10487 blocked for more than 120 seconds.
14:19:39:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:39:ldlm_bl_18    D 0000000000000000     0 10487      2 0x00000080
14:19:39: ffff880052cffd50 0000000000000046 0000000100000000 0000000000000000
14:19:39: ffff880052cffce0 ffffffffa04fb262 ffff880052cffd40 0000000000000001
14:19:39: ffff8800532c1098 ffff880052cfffd8 000000000000fb88 ffff8800532c1098
14:19:39:Call Trace:
14:19:39: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:40: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:40: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:40: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:41: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:41: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:41: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:41: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:41: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:41: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:41: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:41: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:42: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:42: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:42: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:42:INFO: task ldlm_bl_23:10492 blocked for more than 120 seconds.
14:19:42:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:42:ldlm_bl_23    D 0000000000000000     0 10492      2 0x00000080
14:19:43: ffff880053d7bd50 0000000000000046 0000000100000000 0000000000000000
14:19:43: ffff880053d7bce0 ffffffffa04fb262 ffff880053d7bd40 0000000000000001
14:19:43: ffff880053d75098 ffff880053d7bfd8 000000000000fb88 ffff880053d75098
14:19:43:Call Trace:
14:19:43: [<ffffffffa04fb262>] ? cfs_hash_bd_add_locked+0x62/0x90 [libcfs]
14:19:43: [<ffffffffa04fb0c4>] ? cfs_hash_dual_bd_unlock+0x34/0x60 [libcfs]
14:19:43: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:43: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:44: [<ffffffffa06545b7>] cl_lock_mutex_get+0x77/0xe0 [obdclass]
14:19:44: [<ffffffffa090224a>] osc_ldlm_blocking_ast+0x7a/0x380 [osc]
14:19:44: [<ffffffffa04f6521>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
14:19:44: [<ffffffffa077fcd3>] ldlm_handle_bl_callback+0x123/0x2e0 [ptlrpc]
14:19:45: [<ffffffffa0780111>] ldlm_bl_thread_main+0x281/0x3d0 [ptlrpc]
14:19:45: [<ffffffff81060250>] ? default_wake_function+0x0/0x20
14:19:45: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:45: [<ffffffff8100c14a>] child_rip+0xa/0x20
14:19:45: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:45: [<ffffffffa077fe90>] ? ldlm_bl_thread_main+0x0/0x3d0 [ptlrpc]
14:19:47: [<ffffffff8100c140>] ? child_rip+0x0/0x20
14:19:47:INFO: task ls:21953 blocked for more than 120 seconds.
14:19:47:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
14:19:47:ls            D 0000000000000000     0 21953   9441 0x00000080
14:19:47: ffff88004288bae8 0000000000000082 000000000000009e 0020000000000080
14:19:47: 502eb4be00000000 00000000000ee1f8 000055c100000000 00000a2d00000000
14:19:47: ffff88007920faf8 ffff88004288bfd8 000000000000fb88 ffff88007920faf8
14:19:48:Call Trace:
14:19:48: [<ffffffffa04f5e63>] ? libcfs_debug_vmsg2+0x4e3/0xb60 [libcfs]
14:19:48: [<ffffffff814fefbe>] __mutex_lock_slowpath+0x13e/0x180
14:19:48: [<ffffffff81193788>] ? __d_lookup+0xd8/0x150
14:19:48: [<ffffffff814fee5b>] mutex_lock+0x2b/0x50
14:19:48: [<ffffffff8118969b>] do_lookup+0x11b/0x230
14:19:48: [<ffffffff81189abd>] __link_path_walk+0x20d/0x1030
14:19:48: [<ffffffff81097e2f>] ? up+0x2f/0x50
14:19:48: [<ffffffffa0a55dbc>] ? ll_follow_link+0x1ec/0x260 [lustre]
14:19:48: [<ffffffff8118a647>] __link_path_walk+0xd97/0x1030
14:19:48: [<ffffffff8118ab6a>] path_walk+0x6a/0xe0
14:19:48: [<ffffffff8118ad3b>] do_path_lookup+0x5b/0xa0
14:19:50: [<ffffffff8117c780>] ? get_empty_filp+0xa0/0x180
14:19:50: [<ffffffff8118bc6b>] do_filp_open+0xfb/0xd60
14:19:50: [<ffffffff8119a460>] ? mntput_no_expire+0x30/0x110
14:19:50: [<ffffffff811982b2>] ? alloc_fd+0x92/0x160
14:19:50: [<ffffffff81178769>] do_sys_open+0x69/0x140
14:19:51: [<ffffffff81178880>] sys_open+0x20/0x30
14:19:51: [<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
Whamcloud Community JIRA

[LU-1772] Test failure on test suite racer, subtest test_1
