Console [hyperion-agb15] log at 2014-01-07 18:00:00 PST. 2014-01-07 18:24:45 LustreError: 7182:0:(ofd_grant.c:163:ofd_grant_sanity_check()) ofd_obd_disconnect: tot_granted 26347470848 != fo_tot_granted 27521875968 2014-01-07 18:24:45 LustreError: 7229:0:(ofd_grant.c:163:ofd_grant_sanity_check()) ofd_obd_disconnect: tot_granted 16113369088 != fo_tot_granted 17220665344 2014-01-07 18:58:45 INFO: task ll_ost_io02_076:10402 blocked for more than 120 seconds. 2014-01-07 18:58:45 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 2014-01-07 18:58:45 ll_ost_io02_0 D 0000000000000008 0 10402 2 0x00000000 2014-01-07 18:58:45 ffff880e7d6f14b0 0000000000000046 ffff880e7d6f1478 ffff880e7d6f1474 2014-01-07 18:58:45 0000000000000008 ffff88083fe82000 ffff88085c436740 0000000000000400 2014-01-07 18:58:45 ffff880e7ebfd058 ffff880e7d6f1fd8 000000000000fb88 ffff880e7ebfd058 2014-01-07 18:58:45 Call Trace: 2014-01-07 18:58:45 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 18:58:45 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 18:58:45 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 18:58:45 [] ? down_write+0x32/0x40 2014-01-07 18:58:45 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 18:58:45 [] dbuf_read+0x6a1/0x750 [zfs] 2014-01-07 18:58:45 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 18:58:45 [] dmu_read+0x97/0x180 [zfs] 2014-01-07 18:58:45 [] osd_read+0x18f/0x240 [osd_zfs] 2014-01-07 18:58:45 [] osd_read_prep+0x183/0x240 [osd_zfs] 2014-01-07 18:58:45 [] ofd_preprw_read+0x253/0x7f0 [ofd] 2014-01-07 18:58:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 18:58:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 18:58:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 18:58:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 18:58:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 18:58:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 18:58:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 18:58:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 18:58:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 18:58:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 18:58:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 18:58:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 18:58:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 18:58:45 [] kthread+0x96/0xa0 2014-01-07 18:58:45 [] child_rip+0xa/0x20 2014-01-07 18:58:45 [] ? kthread+0x0/0xa0 2014-01-07 18:58:45 [] ? child_rip+0x0/0x20 2014-01-07 18:58:45 INFO: task ll_ost_io02_089:10425 blocked for more than 120 seconds. 2014-01-07 18:58:45 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 2014-01-07 18:58:45 ll_ost_io02_0 D 0000000000000009 0 10425 2 0x00000000 2014-01-07 18:58:45 ffff880e803ad4a8 0000000000000046 0000000000000800 0000000000000009 2014-01-07 18:58:45 0000000000000000 0000000000000008 ffff88085c4167a8 ffff88085c4167d8 2014-01-07 18:58:45 ffff880e803abab8 ffff880e803adfd8 000000000000fb88 ffff880e803abab8 2014-01-07 18:58:45 Call Trace: 2014-01-07 18:58:45 [] ? enqueue_entity+0x125/0x410 2014-01-07 18:58:45 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 18:58:45 [] ? enqueue_task+0x66/0x80 2014-01-07 18:58:45 [] rwsem_down_read_failed+0x26/0x30 2014-01-07 18:58:45 [] call_rwsem_down_read_failed+0x14/0x30 2014-01-07 18:58:45 [] ? down_read+0x24/0x30 2014-01-07 18:58:45 [] dmu_zfetch+0xb9/0xd70 [zfs] 2014-01-07 18:58:45 [] dbuf_read+0x6a1/0x750 [zfs] 2014-01-07 18:58:45 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 18:58:45 [] dmu_read+0x97/0x180 [zfs] 2014-01-07 18:58:45 [] osd_read+0x18f/0x240 [osd_zfs] 2014-01-07 18:58:45 [] osd_read_prep+0x183/0x240 [osd_zfs] 2014-01-07 18:58:45 [] ofd_preprw_read+0x253/0x7f0 [ofd] 2014-01-07 18:58:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 18:58:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 18:58:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 18:58:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 18:58:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 18:58:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 18:58:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 18:58:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 18:58:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 18:58:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 18:58:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 18:58:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 18:58:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 18:58:45 [] kthread+0x96/0xa0 2014-01-07 18:58:45 [] child_rip+0xa/0x20 2014-01-07 18:58:45 [] ? kthread+0x0/0xa0 2014-01-07 18:58:45 [] ? child_rip+0x0/0x20 2014-01-07 18:58:45 INFO: task ll_ost_io02_094:10437 blocked for more than 120 seconds. 2014-01-07 18:58:45 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 2014-01-07 18:58:45 ll_ost_io02_0 D 000000000000000a 0 10437 2 0x00000000 2014-01-07 18:58:45 ffff880e7c39d4d8 0000000000000046 0000000000000000 ffff88085c4767a8 2014-01-07 18:58:45 ffff88085c476740 000000000000000a 000000000000000b ffff880e7c39d480 2014-01-07 18:58:45 ffff880e7c39bab8 ffff880e7c39dfd8 000000000000fb88 ffff880e7c39bab8 2014-01-07 18:58:45 Call Trace: 2014-01-07 18:58:45 [] ? enqueue_task+0x66/0x80 2014-01-07 18:58:45 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 18:58:45 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 18:58:45 [] rwsem_down_read_failed+0x26/0x30 2014-01-07 18:58:46 [] call_rwsem_down_read_failed+0x14/0x30 2014-01-07 18:58:46 [] ? down_read+0x24/0x30 2014-01-07 18:58:46 [] dmu_zfetch+0xb9/0xd70 [zfs] 2014-01-07 18:58:46 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 18:58:46 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 18:58:46 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 18:58:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 18:58:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 18:58:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 18:58:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 18:58:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 18:58:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 18:58:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 18:58:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 18:58:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 18:58:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 18:58:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 18:58:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 18:58:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 18:58:46 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 18:58:46 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 18:58:46 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 18:58:46 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 18:58:46 [] kthread+0x96/0xa0 2014-01-07 18:58:46 [] child_rip+0xa/0x20 2014-01-07 18:58:46 [] ? kthread+0x0/0xa0 2014-01-07 18:58:46 [] ? child_rip+0x0/0x20 Console [hyperion-agb15] log at 2014-01-07 19:00:00 PST. 2014-01-07 19:03:19 SysRq : Changing Loglevel 2014-01-07 19:03:19 Loglevel set to 5 2014-01-07 19:05:30 SysRq : Show State 2014-01-07 19:05:30 ffff8808344b5908 0000000000000086 0000000000000000 ffff8808344b58cc 2014-01-07 19:05:30 ffff880000000000 ffff88083fe81400 ffff88085c496740 0000000000000406 2014-01-07 19:05:30 ffff881034f6c5f8 ffff8808344b5fd8 000000000000fb88 ffff881034f6c5f8 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:30 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:30 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:30 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:30 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:30 [] do_select+0x57c/0x6c0 2014-01-07 19:05:30 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:05:30 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:30 [] ? pollwake+0x0/0x60 2014-01-07 19:05:30 [] ? pollwake+0x0/0x60 2014-01-07 19:05:30 [] ? pollwake+0x0/0x60 2014-01-07 19:05:30 [] ? pollwake+0x0/0x60 2014-01-07 19:05:30 [] ? pollwake+0x0/0x60 2014-01-07 19:05:30 [] ? d_lookup+0x35/0x60 2014-01-07 19:05:30 [] ? d_hash_and_lookup+0x83/0xb0 2014-01-07 19:05:30 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:05:30 [] ? security_task_wait+0x16/0x20 2014-01-07 19:05:30 [] ? wait_consider_task+0x9d/0xb20 2014-01-07 19:05:30 [] ? remove_wait_queue+0x3c/0x50 2014-01-07 19:05:30 [] ? do_wait+0x17f/0x240 2014-01-07 19:05:30 [] sys_select+0x47/0x110 2014-01-07 19:05:30 [] ? child_wait_callback+0x0/0x70 2014-01-07 19:05:30 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:30 ffff8808344bbed0 0000000000000046 0000000000000000 ffff8808344bbe94 2014-01-07 19:05:30 ffff880800000000 ffff88083fe82400 ffff88085c4b6740 0000000000000207 2014-01-07 19:05:30 ffff8808344b9ab8 ffff8808344bbfd8 000000000000fb88 ffff8808344b9ab8 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] kthreadd+0x1b5/0x1c0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthreadd+0x0/0x1c0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff8808344ffe70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:30 ffff8808344ffdf0 ffff8800bbbeeaa0 ffff880044636740 0000000000000000 2014-01-07 19:05:30 ffff8808344b9058 ffff8808344fffd8 000000000000fb88 ffff8808344b9058 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:30 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:30 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff880834501ea0 0000000000000046 0000000000000000 ffff880834501e64 2014-01-07 19:05:30 ffff880800000000 ffff88083fe81000 ffff88085c496740 0000000000000400 2014-01-07 19:05:30 ffff8808344b85f8 ffff880834501fd8 000000000000fb88 ffff8808344b85f8 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:30 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff880834505df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:30 0000000000000000 00000000ffffffff ffff880834504000 0000000000000000 2014-01-07 19:05:30 ffff880834503af8 ffff880834505fd8 000000000000fb88 ffff880834503af8 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:30 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:30 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:30 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:30 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff880834509ea0 0000000000000046 0000000000000000 ffff880834509e64 2014-01-07 19:05:30 ffff880800000000 ffff88083fe81000 ffff88085c416740 0000000000000400 2014-01-07 19:05:30 ffff880834503098 ffff880834509fd8 000000000000fb88 ffff880834503098 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] watchdog+0x9a/0xd0 2014-01-07 19:05:30 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff88083450be70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:30 ffff88083450bdf0 ffff880e76b60ae0 ffff88085c436740 0000000000000000 2014-01-07 19:05:30 ffff880834502638 ffff88083450bfd8 000000000000fb88 ffff880834502638 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:30 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:30 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff88083450fdf0 0000000000000046 0000000000000000 ffff88083450fdb4 2014-01-07 19:05:30 0000000000000000 ffff88083fe81200 ffff880044616740 0000000000000632 2014-01-07 19:05:30 ffff88083450dab8 ffff88083450ffd8 000000000000fb88 ffff88083450dab8 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:30 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:30 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:30 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:30 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff880834103ea0 0000000000000046 0000000000000000 ffff880834103e64 2014-01-07 19:05:30 ffff880800000000 ffff88083fe81200 ffff8800446b6740 0000000000000400 2014-01-07 19:05:30 ffff88083450d058 ffff880834103fd8 000000000000fb88 ffff88083450d058 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:30 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff88083410dea0 0000000000000046 0000000000000000 ffff88083410de64 2014-01-07 19:05:30 ffff880800000000 ffff88083fe81200 ffff88085c496740 0000000000000400 2014-01-07 19:05:30 ffff88083410baf8 ffff88083410dfd8 000000000000fb88 ffff88083410baf8 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] watchdog+0x9a/0xd0 2014-01-07 19:05:30 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:30 [] child_rip+0xa/0x20 2014-01-07 19:05:30 [] ? kthread+0x0/0xa0 2014-01-07 19:05:30 [] ? child_rip+0x0/0x20 2014-01-07 19:05:30 ffff88083410fe70 0000000000000046 0000000000000000 ffff88083410fe34 2014-01-07 19:05:30 ffff880800000000 ffff88083fe81400 ffff88085c496740 0000000000000400 2014-01-07 19:05:30 ffff88083410b098 ffff88083410ffd8 000000000000fb88 ffff88083410b098 2014-01-07 19:05:30 Call Trace: 2014-01-07 19:05:30 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:30 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:30 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834113df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:31 0000000000000000 00000000ffffffff ffff880834112000 0000000000000000 2014-01-07 19:05:31 ffff88083410a638 ffff880834113fd8 000000000000fb88 ffff88083410a638 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:31 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:31 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:31 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:31 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff88083413bea0 0000000000000046 0000000000000000 ffff88083413be64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81400 ffff8800446f6740 0000000000000400 2014-01-07 19:05:31 ffff880834139ab8 ffff88083413bfd8 000000000000fb88 ffff880834139ab8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:31 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834141ea0 0000000000000046 0000000000000000 ffff880834141e64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81400 ffff8800446d6740 0000000000000400 2014-01-07 19:05:31 ffff880834139058 ffff880834141fd8 000000000000fb88 ffff880834139058 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] watchdog+0x9a/0xd0 2014-01-07 19:05:31 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834143e70 0000000000000046 0000000000000000 ffff880834143e34 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81600 ffff88085c4b6740 00000000000005fe 2014-01-07 19:05:31 ffff8808341385f8 ffff880834143fd8 000000000000fb88 ffff8808341385f8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:31 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834149df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:31 0000000000000000 00000000ffffffff ffff880834148000 0000000000000000 2014-01-07 19:05:31 ffff880834147af8 ffff880834149fd8 000000000000fb88 ffff880834147af8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:31 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:31 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:31 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:31 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834151ea0 0000000000000046 0000000000000000 ffff880834151e64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81600 ffff8800446d6740 0000000000000207 2014-01-07 19:05:31 ffff880834147098 ffff880834151fd8 000000000000fb88 ffff880834147098 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:31 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834155ea0 0000000000000046 0000000000000000 ffff880834155e64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81600 ffff88085c456740 0000000000000400 2014-01-07 19:05:31 ffff880834153ab8 ffff880834155fd8 000000000000fb88 ffff880834153ab8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] watchdog+0x9a/0xd0 2014-01-07 19:05:31 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834157e70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:31 ffff880834157df0 ffff8800bba80080 ffff8800446b6740 0000000000000000 2014-01-07 19:05:31 ffff880834153058 ffff880834157fd8 000000000000fb88 ffff880834153058 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:31 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:31 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff88083415bdf0 0000000000000046 0000000000000000 ffff881031047d28 2014-01-07 19:05:31 0000000000000000 0000000000000000 ffff88083415bd70 ffffffff81063422 2014-01-07 19:05:31 ffff8808341525f8 ffff88083415bfd8 000000000000fb88 ffff8808341525f8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:31 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:31 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:31 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:31 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:31 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834181ea0 0000000000000046 0000000000000000 ffff880834181e64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81800 ffff880044656740 0000000000000207 2014-01-07 19:05:31 ffff88083417faf8 ffff880834181fd8 000000000000fb88 ffff88083417faf8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:31 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834189ea0 0000000000000046 0000000000000000 ffff880834189e64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81800 ffff88085c416740 0000000000000400 2014-01-07 19:05:31 ffff88083417f098 ffff880834189fd8 000000000000fb88 ffff88083417f098 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] watchdog+0x9a/0xd0 2014-01-07 19:05:31 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff88083418be70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:31 ffff88083418bdf0 ffff8800bba0eaa0 ffff8800446d6740 0000000000000000 2014-01-07 19:05:31 ffff88083417e638 ffff88083418bfd8 000000000000fb88 ffff88083417e638 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:31 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:31 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff88083418fdf0 0000000000000046 0000000000000000 ffff88083418fdb4 2014-01-07 19:05:31 0000000000000000 ffff88083fe81a00 ffff880044616740 0000000000000632 2014-01-07 19:05:31 ffff88083418dab8 ffff88083418ffd8 000000000000fb88 ffff88083418dab8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:31 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:31 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:31 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:31 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff880834193ea0 0000000000000046 0000000000000000 ffff880834193e64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81a00 ffff8800446f6740 0000000000000207 2014-01-07 19:05:31 ffff88083418d058 ffff880834193fd8 000000000000fb88 ffff88083418d058 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:31 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff88083419bea0 0000000000000046 0000000000000000 ffff88083419be64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81a00 ffff88085c4b6740 0000000000000200 2014-01-07 19:05:31 ffff880834199af8 ffff88083419bfd8 000000000000fb88 ffff880834199af8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] watchdog+0x9a/0xd0 2014-01-07 19:05:31 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff88083419de70 0000000000000046 ffff88083419ddf0 ffffffff81065d54 2014-01-07 19:05:31 ffff88083419ddf0 ffff880789ab6aa0 ffff88085c436740 0000000000000000 2014-01-07 19:05:31 ffff880834199098 ffff88083419dfd8 000000000000fb88 ffff880834199098 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:31 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:31 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff8808341a3df0 0000000000000046 0000000000000000 ffff8808341a3db4 2014-01-07 19:05:31 0000000000000000 ffff88083fe81c00 ffff880044616740 0000000000000632 2014-01-07 19:05:31 ffff880834198638 ffff8808341a3fd8 000000000000fb88 ffff880834198638 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:31 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:31 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:31 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:31 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff8808341cbea0 0000000000000046 ffff8808341cbe68 ffff8808341cbe64 2014-01-07 19:05:31 ffff880800000000 ffff88083fe81c00 ffff880044696740 0000000000000400 2014-01-07 19:05:31 ffff8808341c9ab8 ffff8808341cbfd8 000000000000fb88 ffff8808341c9ab8 2014-01-07 19:05:31 Call Trace: 2014-01-07 19:05:31 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:31 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:31 [] kthread+0x96/0xa0 2014-01-07 19:05:31 [] child_rip+0xa/0x20 2014-01-07 19:05:31 [] ? kthread+0x0/0xa0 2014-01-07 19:05:31 [] ? child_rip+0x0/0x20 2014-01-07 19:05:31 ffff8808341d1ea0 0000000000000046 0000000000000000 ffff8808341d1e64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe81c00 ffff880044636740 0000000000000207 2014-01-07 19:05:32 ffff8808341c9058 ffff8808341d1fd8 000000000000fb88 ffff8808341c9058 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] watchdog+0x9a/0xd0 2014-01-07 19:05:32 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341d3e70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:32 ffff8808341d3df0 ffff880789ab6040 ffff88085c436740 0000000000000000 2014-01-07 19:05:32 ffff8808341c85f8 ffff8808341d3fd8 000000000000fb88 ffff8808341c85f8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:32 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:32 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341d7df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:32 0000000000000000 00000000ffffffff ffff8808341d6000 0000000000000000 2014-01-07 19:05:32 ffff8808341d5af8 ffff8808341d7fd8 000000000000fb88 ffff8808341d5af8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:32 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:32 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:32 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:32 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341dbea0 0000000000000046 0000000000000000 ffff8808341dbe64 2014-01-07 19:05:32 0000000000000000 ffff88083fe81e00 ffff8800446b6740 0000000000000400 2014-01-07 19:05:32 ffff8808341d5098 ffff8808341dbfd8 000000000000fb88 ffff8808341d5098 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:32 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341e5ea0 0000000000000046 0000000000000000 ffff8808341e5e64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe81e00 ffff880044616740 000000000000015a 2014-01-07 19:05:32 ffff8808341e3ab8 ffff8808341e5fd8 000000000000fb88 ffff8808341e3ab8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] watchdog+0x9a/0xd0 2014-01-07 19:05:32 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341e7e70 0000000000000046 ffff8808341e7dd0 ffff881030b8aaa0 2014-01-07 19:05:32 ffff8808341e7e00 ffffffff81062a2e ffff88085c436740 ffff881030b8aaa0 2014-01-07 19:05:32 ffff8808341e3058 ffff8808341e7fd8 000000000000fb88 ffff8808341e3058 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? pull_task+0x4e/0x60 2014-01-07 19:05:32 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:32 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341ebdf0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:32 0000000000000000 00000000ffffffff ffff8808341ea000 0000000000000005 2014-01-07 19:05:32 ffff8808341e25f8 ffff8808341ebfd8 000000000000fb88 ffff8808341e25f8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:32 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:32 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:32 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:32 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff8808341efea0 0000000000000046 0000000000000000 ffff8808341efe64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe82000 ffff88085c456740 00000000000002af 2014-01-07 19:05:32 ffff8808341edaf8 ffff8808341effd8 000000000000fb88 ffff8808341edaf8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:32 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834213ea0 0000000000000046 0000000000000000 ffff880834213e64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe82000 ffff880044616740 00000000000001ff 2014-01-07 19:05:32 ffff8808341ed098 ffff880834213fd8 000000000000fb88 ffff8808341ed098 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] watchdog+0x9a/0xd0 2014-01-07 19:05:32 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834215e70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:32 ffff880834215df0 ffff8800bd23eae0 ffff880044636740 0000000000000000 2014-01-07 19:05:32 ffff8808341ec638 ffff880834215fd8 000000000000fb88 ffff8808341ec638 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:32 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:32 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834219df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:32 0000000000000000 00000000ffffffff ffff880834218000 0000000000000000 2014-01-07 19:05:32 ffff880834217ab8 ffff880834219fd8 000000000000fb88 ffff880834217ab8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:32 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:32 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:32 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:32 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff88083421fea0 0000000000000046 0000000000000000 ffff88083421fe64 2014-01-07 19:05:32 ffff880800000000 ffffffff8100bb8e ffff88083421fea0 0000000000000000 2014-01-07 19:05:32 ffff880834217058 ffff88083421ffd8 000000000000fb88 ffff880834217058 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? apic_timer_interrupt+0xe/0x20 2014-01-07 19:05:32 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:32 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834223ea0 0000000000000046 0000000000000000 ffff880834223e64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe82200 ffff880044616740 00000000000001ff 2014-01-07 19:05:32 ffff880834221af8 ffff880834223fd8 000000000000fb88 ffff880834221af8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] watchdog+0x9a/0xd0 2014-01-07 19:05:32 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834225e70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:32 ffff880834225df0 ffff880e76007500 ffff88085c476740 0000000000000000 2014-01-07 19:05:32 ffff880834221098 ffff880834225fd8 000000000000fb88 ffff880834221098 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:32 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:32 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834229df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:32 0000000000000000 00000000ffffffff ffff880834228000 0000000000000000 2014-01-07 19:05:32 ffff880834220638 ffff880834229fd8 000000000000fb88 ffff880834220638 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:32 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:32 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:32 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:32 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff88083422dea0 0000000000000046 0000000000000000 ffff88083422de64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe82400 ffff88085c436740 0000000000000400 2014-01-07 19:05:32 ffff88083422bab8 ffff88083422dfd8 000000000000fb88 ffff88083422bab8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:32 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834233ea0 0000000000000046 0000000000000000 ffff880834233e64 2014-01-07 19:05:32 ffff880800000000 ffff88083fe82400 ffff880044616740 00000000000001ff 2014-01-07 19:05:32 ffff88083422b058 ffff880834233fd8 000000000000fb88 ffff88083422b058 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] watchdog+0x9a/0xd0 2014-01-07 19:05:32 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff880834237e70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:32 ffff880834237df0 ffff880e76f30aa0 ffff88085c496740 0000000000000000 2014-01-07 19:05:32 ffff88083422a5f8 ffff880834237fd8 000000000000fb88 ffff88083422a5f8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:32 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:32 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:32 [] kthread+0x96/0xa0 2014-01-07 19:05:32 [] child_rip+0xa/0x20 2014-01-07 19:05:32 [] ? kthread+0x0/0xa0 2014-01-07 19:05:32 [] ? child_rip+0x0/0x20 2014-01-07 19:05:32 ffff88083423bdf0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:32 0000000000000000 00000000ffffffff ffff88083423a000 0000000000000000 2014-01-07 19:05:32 ffff880834239af8 ffff88083423bfd8 000000000000fb88 ffff880834239af8 2014-01-07 19:05:32 Call Trace: 2014-01-07 19:05:32 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:32 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:33 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083423fea0 0000000000000046 ffff88083423fe68 ffff88083423fe64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82600 ffff88085c416740 00000000000002af 2014-01-07 19:05:33 ffff880834239098 ffff88083423ffd8 000000000000fb88 ffff880834239098 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:33 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834243ea0 0000000000000046 0000000000000000 ffff880834243e64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82600 ffff880044616740 00000000000001ff 2014-01-07 19:05:33 ffff880834241ab8 ffff880834243fd8 000000000000fb88 ffff880834241ab8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] watchdog+0x9a/0xd0 2014-01-07 19:05:33 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834245e70 0000000000000046 0000000000000000 ffffffff81065d54 2014-01-07 19:05:33 ffff880834245df0 ffff880e7e5c8ae0 ffff880044636740 0000000000000000 2014-01-07 19:05:33 ffff880834241058 ffff880834245fd8 000000000000fb88 ffff880834241058 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:33 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:33 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834249df0 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:33 0000000000000000 00000000ffffffff ffff880834248000 0000000000000000 2014-01-07 19:05:33 ffff8808342405f8 ffff880834249fd8 000000000000fb88 ffff8808342405f8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:33 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:33 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083424fea0 0000000000000046 0000000000000000 ffff88083424fe64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82800 ffff88085c436740 0000000000000400 2014-01-07 19:05:33 ffff88083424daf8 ffff88083424ffd8 000000000000fb88 ffff88083424daf8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:33 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834255ea0 0000000000000046 0000000000000000 ffff880834255e64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82800 ffff880044616740 00000000000001ff 2014-01-07 19:05:33 ffff88083424d098 ffff880834255fd8 000000000000fb88 ffff88083424d098 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] watchdog+0x9a/0xd0 2014-01-07 19:05:33 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834257e70 0000000000000046 0000000000000000 ffff880834257e34 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82a00 ffff88085c476740 0000000000000400 2014-01-07 19:05:33 ffff88083424c638 ffff880834257fd8 000000000000fb88 ffff88083424c638 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:33 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083425bdf0 0000000000000046 0000000000000000 ffff881032447e38 2014-01-07 19:05:33 0000000000000000 0000000000000000 ffff88083425bd70 ffffffff81063422 2014-01-07 19:05:33 ffff880834259ab8 ffff88083425bfd8 000000000000fb88 ffff880834259ab8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:33 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:33 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083425fea0 0000000000000046 0000000000000000 ffff88083425fe64 2014-01-07 19:05:33 0000000000000000 ffff88083fe82a00 ffff88085c496740 0000000000000207 2014-01-07 19:05:33 ffff880834259058 ffff88083425ffd8 000000000000fb88 ffff880834259058 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:33 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834263ea0 0000000000000046 0000000000000000 ffff880834263e64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82a00 ffff880044616740 00000000000001ff 2014-01-07 19:05:33 ffff880834261af8 ffff880834263fd8 000000000000fb88 ffff880834261af8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] watchdog+0x9a/0xd0 2014-01-07 19:05:33 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834267e70 0000000000000046 ffff880834267dd0 ffff88102f35d500 2014-01-07 19:05:33 ffff880834267e00 ffffffff81062a2e ffff880044616740 ffff88102f35d500 2014-01-07 19:05:33 ffff880834261098 ffff880834267fd8 000000000000fb88 ffff880834261098 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? pull_task+0x4e/0x60 2014-01-07 19:05:33 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:33 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083426bdf0 0000000000000046 0000000000000000 ffff88083426bdb4 2014-01-07 19:05:33 0000000000000000 ffff88083fe82c00 ffff880044616740 000000000000037d 2014-01-07 19:05:33 ffff880834260638 ffff88083426bfd8 000000000000fb88 ffff880834260638 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:33 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:33 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083426fea0 0000000000000046 0000000000000000 ffff88083426fe64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82c00 ffff88085c4b6740 0000000000000400 2014-01-07 19:05:33 ffff88083426dab8 ffff88083426ffd8 000000000000fb88 ffff88083426dab8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:33 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834275ea0 0000000000000046 0000000000000000 ffff880834275e64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82c00 ffff880044616740 00000000000001ff 2014-01-07 19:05:33 ffff88083426d058 ffff880834275fd8 000000000000fb88 ffff88083426d058 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] watchdog+0x9a/0xd0 2014-01-07 19:05:33 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834277e70 0000000000000046 ffff880834277dd0 ffff88102f35d500 2014-01-07 19:05:33 ffff880834277e00 ffffffff81062a2e ffff8800446d6740 ffff88102f35d500 2014-01-07 19:05:33 ffff88083426c5f8 ffff880834277fd8 000000000000fb88 ffff88083426c5f8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? pull_task+0x4e/0x60 2014-01-07 19:05:33 [] migration_thread+0x265/0x2e0 2014-01-07 19:05:33 [] ? migration_thread+0x0/0x2e0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083427bdf0 0000000000000046 0000000000000000 ffff880816e71e38 2014-01-07 19:05:33 0000000000000000 0000000000000000 ffff88083427bd70 ffffffff81063422 2014-01-07 19:05:33 ffff880834279af8 ffff88083427bfd8 000000000000fb88 ffff880834279af8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? stop_machine_cpu_stop+0x0/0xf0 2014-01-07 19:05:33 [] cpu_stopper_thread+0x125/0x1b0 2014-01-07 19:05:33 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:33 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:33 [] ? cpu_stopper_thread+0x0/0x1b0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff88083427fea0 0000000000000046 0000000000000000 ffff88083427fe64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82e00 ffff88085c456740 ffffffff8100bb8e 2014-01-07 19:05:33 ffff880834279098 ffff88083427ffd8 000000000000fb88 ffff880834279098 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] ? apic_timer_interrupt+0xe/0x20 2014-01-07 19:05:33 [] ksoftirqd+0xd5/0x110 2014-01-07 19:05:33 [] ? ksoftirqd+0x0/0x110 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:33 [] ? child_rip+0x0/0x20 2014-01-07 19:05:33 ffff880834285ea0 0000000000000046 0000000000000000 ffff880834285e64 2014-01-07 19:05:33 ffff880800000000 ffff88083fe82e00 ffff880044616740 00000000000001ff 2014-01-07 19:05:33 ffff880834283ab8 ffff880834285fd8 000000000000fb88 ffff880834283ab8 2014-01-07 19:05:33 Call Trace: 2014-01-07 19:05:33 [] watchdog+0x9a/0xd0 2014-01-07 19:05:33 [] ? watchdog+0x0/0xd0 2014-01-07 19:05:33 [] kthread+0x96/0xa0 2014-01-07 19:05:33 [] child_rip+0xa/0x20 2014-01-07 19:05:33 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833c71e30 0000000000000046 ffff880833c71d90 0000000000000282 2014-01-07 19:05:34 ffff880833c71de0 ffffffff81082134 ffff88083116c020 0000000000000282 2014-01-07 19:05:34 ffff880833c6faf8 ffff880833c71fd8 000000000000fb88 ffff880833c6faf8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? mod_timer+0x144/0x220 2014-01-07 19:05:34 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:34 [] ? igb_watchdog_task+0x0/0x590 [igb] 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833c97e30 0000000000000046 0000000000000000 ffff880833c97df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe81200 ffff880044616740 000000000000015a 2014-01-07 19:05:34 ffff880833c6f098 ffff880833c97fd8 000000000000fb88 ffff880833c6f098 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833c99e30 0000000000000046 ffff880833c99df8 ffff880833c99df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe81400 ffff88085c476740 0000000000000400 2014-01-07 19:05:34 ffff880833c6e638 ffff880833c99fd8 000000000000fb88 ffff880833c6e638 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833c9de30 0000000000000046 0000000000000000 ffff880833c9ddf4 2014-01-07 19:05:34 0000000000000000 ffff88083fe81600 ffff880044616740 000000000000015a 2014-01-07 19:05:34 ffff880833c9bab8 ffff880833c9dfd8 000000000000fb88 ffff880833c9bab8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833ca1e30 0000000000000046 ffff880833ca1df8 ffff880833ca1df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe81800 ffff88085c476740 0000000000000400 2014-01-07 19:05:34 ffff880833c9b058 ffff880833ca1fd8 000000000000fb88 ffff880833c9b058 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833ca3e30 0000000000000046 0000000000000000 ffff8800446b9480 2014-01-07 19:05:34 00000000ffffffff ffff8800446b3420 ffff880833ca3fd8 ffff8800446b9488 2014-01-07 19:05:34 ffff880833c9a5f8 ffff880833ca3fd8 000000000000fb88 ffff880833c9a5f8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833ca7e30 0000000000000046 0000000000000000 ffff880833ca7df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe81c00 ffff880044616740 000000000000015a 2014-01-07 19:05:34 ffff880833ca5af8 ffff880833ca7fd8 000000000000fb88 ffff880833ca5af8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? cache_reap+0x0/0x250 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cabe30 0000000000000046 0000000000000000 ffff880833cabdf4 2014-01-07 19:05:34 0000000000000000 ffff88083fe81e00 ffff88085c4f6740 00000000000007f6 2014-01-07 19:05:34 ffff880833ca5098 ffff880833cabfd8 000000000000fb88 ffff880833ca5098 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cafe30 0000000000000046 0000000000000000 ffff880833cafdf4 2014-01-07 19:05:34 0000000000000000 ffff88083fe82000 ffff880044616740 00000000000001ff 2014-01-07 19:05:34 ffff880833ca4638 ffff880833caffd8 000000000000fb88 ffff880833ca4638 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cb3e30 0000000000000046 0000000000000000 ffff88085c439480 2014-01-07 19:05:34 00000000ffffffff ffff88085c433420 ffff880833cb3fd8 ffff88085c439488 2014-01-07 19:05:34 ffff880833cb1ab8 ffff880833cb3fd8 000000000000fb88 ffff880833cb1ab8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cb7e30 0000000000000046 0000000000000000 ffff880833cb7df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe82400 ffff880044616740 00000000000001ff 2014-01-07 19:05:34 ffff880833cb1058 ffff880833cb7fd8 000000000000fb88 ffff880833cb1058 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? cache_reap+0x0/0x250 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cb9e30 0000000000000046 0000000000000000 ffff880833cb9df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe82600 ffff880044616740 00000000000001ff 2014-01-07 19:05:34 ffff880833cb05f8 ffff880833cb9fd8 000000000000fb88 ffff880833cb05f8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? cache_reap+0x0/0x250 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cbde30 0000000000000046 0000000000000000 ffff880833cbddf4 2014-01-07 19:05:34 0000000000000000 ffff88083fe82800 ffff880044616740 00000000000001ff 2014-01-07 19:05:34 ffff880833cbbaf8 ffff880833cbdfd8 000000000000fb88 ffff880833cbbaf8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cc1e30 0000000000000046 0000000000000000 ffff88085c4b9480 2014-01-07 19:05:34 00000000ffffffff ffff88085c4b3420 ffff880833cc1fd8 ffff88085c4b9488 2014-01-07 19:05:34 ffff880833cbb098 ffff880833cc1fd8 000000000000fb88 ffff880833cbb098 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:34 [] ? vmstat_update+0x0/0x40 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cc3e30 0000000000000046 0000000000000000 ffff880833cc3df4 2014-01-07 19:05:34 0000000000000000 ffff88083fe82c00 ffff880044616740 00000000000001ff 2014-01-07 19:05:34 ffff880833cba638 ffff880833cc3fd8 000000000000fb88 ffff880833cba638 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? cache_reap+0x0/0x250 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833cc9e30 0000000000000046 0000000000000000 ffff880833cc9df4 2014-01-07 19:05:34 ffff880e00000000 ffff88083fe82e00 ffff880044616740 00000000000001ff 2014-01-07 19:05:34 ffff880833cc7ab8 ffff880833cc9fd8 000000000000fb88 ffff880833cc7ab8 2014-01-07 19:05:34 Call Trace: 2014-01-07 19:05:34 [] ? cache_reap+0x0/0x250 2014-01-07 19:05:34 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:34 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:34 [] kthread+0x96/0xa0 2014-01-07 19:05:34 [] child_rip+0xa/0x20 2014-01-07 19:05:34 [] ? kthread+0x0/0xa0 2014-01-07 19:05:34 [] ? child_rip+0x0/0x20 2014-01-07 19:05:34 ffff880833d05e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:34 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:34 ffff880833cfc638 ffff880833d05fd8 000000000000fb88 ffff880833cfc638 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833d09e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:35 ffff880833d09e30 ffff8807cfd8e5c0 0000000000000000 0000000000000000 2014-01-07 19:05:35 ffff880833d07ab8 ffff880833d09fd8 000000000000fb88 ffff880833d07ab8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? __call_usermodehelper+0x0/0xd0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833d79e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 ffff880833d79db0 ffffffff81057310 ffff880833d06ad8 ffff88085c5367a8 2014-01-07 19:05:35 ffff880833d07058 ffff880833d79fd8 000000000000fb88 ffff880833d07058 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833d7be70 0000000000000046 000000000000000d 0000000000000000 2014-01-07 19:05:35 ffff880833d7bdf0 ffffffff8105232c ffff880833d7bdf0 0000000000000282 2014-01-07 19:05:35 ffff880833d065f8 ffff880833d7bfd8 000000000000fb88 ffff880833d065f8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? check_preempt_curr+0x7c/0x90 2014-01-07 19:05:35 [] async_manager_thread+0xc5/0x100 2014-01-07 19:05:35 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:35 [] ? async_manager_thread+0x0/0x100 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833d91e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:35 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:35 ffff880833d7faf8 ffff880833d91fd8 000000000000fb88 ffff880833d7faf8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e33ec0 0000000000000046 0000000000000000 ffff880833e33e84 2014-01-07 19:05:35 ffff880800000000 ffff88083fe81a00 ffff880044616740 0000000000000400 2014-01-07 19:05:35 ffff880833d7f098 ffff880833e33fd8 000000000000fb88 ffff880833d7f098 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? bdi_sync_supers+0x0/0x60 2014-01-07 19:05:35 [] bdi_sync_supers+0x3b/0x60 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e53dd0 0000000000000046 0000000000000000 ffff880833e53d94 2014-01-07 19:05:35 ffffffff81ac1710 ffffffff81ac1700 0000000000000000 ffff880833e53db8 2014-01-07 19:05:35 ffff880833d7e638 ffff880833e53fd8 000000000000fb88 ffff880833d7e638 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:05:35 [] ? process_timeout+0x0/0x10 2014-01-07 19:05:35 [] bdi_forker_task+0x263/0x310 2014-01-07 19:05:35 [] ? bdi_forker_task+0x0/0x310 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e57e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e57de0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e55ab8 ffff880833e57fd8 000000000000fb88 ffff880833e55ab8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e5be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e5bde0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e55058 ffff880833e5bfd8 000000000000fb88 ffff880833e55058 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e5de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e5dde0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e545f8 ffff880833e5dfd8 000000000000fb88 ffff880833e545f8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e61e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e61de0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e5faf8 ffff880833e61fd8 000000000000fb88 ffff880833e5faf8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e67e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e67de0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e5f098 ffff880833e67fd8 000000000000fb88 ffff880833e5f098 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e69e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e69de0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e5e638 ffff880833e69fd8 000000000000fb88 ffff880833e5e638 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e6de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e6dde0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e6bab8 ffff880833e6dfd8 000000000000fb88 ffff880833e6bab8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e71e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e71de0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e6b058 ffff880833e71fd8 000000000000fb88 ffff880833e6b058 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e73e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e73de0 ffffffff8106669b 2014-01-07 19:05:35 ffff880833e6a5f8 ffff880833e73fd8 000000000000fb88 ffff880833e6a5f8 2014-01-07 19:05:35 Call Trace: 2014-01-07 19:05:35 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:35 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:35 [] kthread+0x96/0xa0 2014-01-07 19:05:35 [] child_rip+0xa/0x20 2014-01-07 19:05:35 [] ? kthread+0x0/0xa0 2014-01-07 19:05:35 [] ? child_rip+0x0/0x20 2014-01-07 19:05:35 ffff880833e77e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:35 0000000000000001 ffff88085c536740 ffff880833e77de0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e75af8 ffff880833e77fd8 000000000000fb88 ffff880833e75af8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833e7be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:36 0000000000000001 ffff88085c536740 ffff880833e7bde0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e75098 ffff880833e7bfd8 000000000000fb88 ffff880833e75098 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833e7fe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:36 0000000000000001 ffff88085c536740 ffff880833e7fde0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e74638 ffff880833e7ffd8 000000000000fb88 ffff880833e74638 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833e83e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:36 0000000000000001 ffff88085c536740 ffff880833e83de0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e81ab8 ffff880833e83fd8 000000000000fb88 ffff880833e81ab8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833e87e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:36 0000000000000001 ffff88085c536740 ffff880833e87de0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e81058 ffff880833e87fd8 000000000000fb88 ffff880833e81058 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833e89e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:36 0000000000000001 ffff88085c536740 ffff880833e89de0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e805f8 ffff880833e89fd8 000000000000fb88 ffff880833e805f8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833e8de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:36 0000000000000001 ffff88085c536740 ffff880833e8dde0 ffffffff8106669b 2014-01-07 19:05:36 ffff880833e8baf8 ffff880833e8dfd8 000000000000fb88 ffff880833e8baf8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833f8de30 0000000000000046 0000000000000000 ffff880044619908 2014-01-07 19:05:36 ffff880833f8ddb0 ffffffff8125bd22 ffff880833f8ddd0 000000001275e3cc 2014-01-07 19:05:36 ffff880833ec05f8 ffff880833f8dfd8 000000000000fb88 ffff880833ec05f8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833f91e30 0000000000000046 0000000000000000 ffff880044639908 2014-01-07 19:05:36 ffff880833f91db0 ffffffff8125bd22 ffff880833f91dd0 000000000b8367f6 2014-01-07 19:05:36 ffff880833f8faf8 ffff880833f91fd8 000000000000fb88 ffff880833f8faf8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833f95e30 0000000000000046 0000000000000000 ffff880044659908 2014-01-07 19:05:36 ffff880833f95db0 ffffffff8125bd22 ffff880833f95dd0 000000001dad49c3 2014-01-07 19:05:36 ffff880833f8f098 ffff880833f95fd8 000000000000fb88 ffff880833f8f098 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833f97e30 0000000000000046 0000000000000000 ffff880044679908 2014-01-07 19:05:36 ffff880833f97db0 ffffffff8125bd22 ffff880833f97dd0 000000008e187c13 2014-01-07 19:05:36 ffff880833f8e638 ffff880833f97fd8 000000000000fb88 ffff880833f8e638 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833f9be30 0000000000000046 0000000000000000 ffff880044699908 2014-01-07 19:05:36 ffff880833f9bdb0 ffffffff8125bd22 ffff880833f9bdd0 000000000229f1d3 2014-01-07 19:05:36 ffff880833f99ab8 ffff880833f9bfd8 000000000000fb88 ffff880833f99ab8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833f9fe30 0000000000000046 0000000000000000 ffff8800446b9908 2014-01-07 19:05:36 ffff880833f9fdb0 ffffffff8125bd22 ffff880833f9fdd0 00000000a0939c07 2014-01-07 19:05:36 ffff880833f99058 ffff880833f9ffd8 000000000000fb88 ffff880833f99058 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833fa1e30 0000000000000046 0000000000000000 ffff8800446d9908 2014-01-07 19:05:36 ffff880833fa1db0 ffffffff8125bd22 ffff880833fa1dd0 00000000b3fd457f 2014-01-07 19:05:36 ffff880833f985f8 ffff880833fa1fd8 000000000000fb88 ffff880833f985f8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833fa7e30 0000000000000046 0000000000000000 ffff8800446f9908 2014-01-07 19:05:36 ffff880833fa7db0 ffffffff8125bd22 ffff880833fa7dd0 0000000034c1f607 2014-01-07 19:05:36 ffff880833fa5af8 ffff880833fa7fd8 000000000000fb88 ffff880833fa5af8 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:36 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:36 [] kthread+0x96/0xa0 2014-01-07 19:05:36 [] child_rip+0xa/0x20 2014-01-07 19:05:36 [] ? kthread+0x0/0xa0 2014-01-07 19:05:36 [] ? child_rip+0x0/0x20 2014-01-07 19:05:36 ffff880833fabe30 0000000000000046 0000000000000000 ffff88085c419908 2014-01-07 19:05:36 ffff880833fabdb0 ffffffff8125bd22 ffff880833fabdd0 000000008435f7da 2014-01-07 19:05:36 ffff880833fa5098 ffff880833fabfd8 000000000000fb88 ffff880833fa5098 2014-01-07 19:05:36 Call Trace: 2014-01-07 19:05:36 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:36 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:36 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fade30 0000000000000046 0000000000000000 ffff88085c439908 2014-01-07 19:05:37 ffff880833faddb0 ffffffff8125bd22 ffff880833faddd0 000000005dadcaa2 2014-01-07 19:05:37 ffff880833fa4638 ffff880833fadfd8 000000000000fb88 ffff880833fa4638 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fb1e30 0000000000000046 0000000000000000 ffff88085c459908 2014-01-07 19:05:37 ffff880833fb1db0 ffffffff8125bd22 ffff880833fb1dd0 00000000e1dcb622 2014-01-07 19:05:37 ffff880833fafab8 ffff880833fb1fd8 000000000000fb88 ffff880833fafab8 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fb5e30 0000000000000046 0000000000000000 ffff88085c479908 2014-01-07 19:05:37 ffff880833fb5db0 ffffffff8125bd22 ffff880833fb5dd0 00000000ed31694f 2014-01-07 19:05:37 ffff880833faf058 ffff880833fb5fd8 000000000000fb88 ffff880833faf058 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fb7e30 0000000000000046 0000000000000000 ffff88085c499908 2014-01-07 19:05:37 ffff880833fb7db0 ffffffff8125bd22 ffff880833fb7dd0 000000009af18c6b 2014-01-07 19:05:37 ffff880833fae5f8 ffff880833fb7fd8 000000000000fb88 ffff880833fae5f8 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fbbe30 0000000000000046 0000000000000000 ffff88085c4b9908 2014-01-07 19:05:37 ffff880833fbbdb0 ffffffff8125bd22 ffff880833fbbdd0 0000000046d98e9d 2014-01-07 19:05:37 ffff880833fb9af8 ffff880833fbbfd8 000000000000fb88 ffff880833fb9af8 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fc1e30 0000000000000046 0000000000000000 ffff88085c4d9908 2014-01-07 19:05:37 ffff880833fc1db0 ffffffff8125bd22 ffff880833fc1dd0 00000000a4ebeba0 2014-01-07 19:05:37 ffff880833fb9098 ffff880833fc1fd8 000000000000fb88 ffff880833fb9098 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833fc3e30 0000000000000046 0000000000000000 ffff88085c4f9908 2014-01-07 19:05:37 ffff880833fc3db0 ffffffff8125bd22 ffff880833fc3dd0 000000009712cd08 2014-01-07 19:05:37 ffff880833fb8638 ffff880833fc3fd8 000000000000fb88 ffff880833fb8638 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? __generic_unplug_device+0x32/0x40 2014-01-07 19:05:37 [] ? blk_unplug_work+0x0/0x70 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833821e30 0000000000000046 ffff8808344778f8 ffff880833f87b60 2014-01-07 19:05:37 0000000000000000 ffff880833b7a780 ffff880833821e10 0000000000000282 2014-01-07 19:05:37 ffff880833ffb098 ffff880833821fd8 000000000000fb88 ffff880833ffb098 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:37 [] ? acpi_os_execute_deferred+0x0/0x36 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833823e30 0000000000000046 ffff880833823db0 ffffffff812f7c4e 2014-01-07 19:05:37 ffff8810343b6df8 0000000000000010 ffff880833823e10 0000000000000282 2014-01-07 19:05:37 ffff880833ffa638 ffff880833823fd8 000000000000fb88 ffff880833ffa638 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? acpi_hw_write_port+0x43/0x98 2014-01-07 19:05:37 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:37 [] ? acpi_os_execute_deferred+0x0/0x36 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff880833827e30 0000000000000046 0000000000000000 ffffffff8150f17d 2014-01-07 19:05:37 ffff880833827e10 ffffffff8106a703 ffff880833827e10 0000000000000286 2014-01-07 19:05:37 ffff880833825ab8 ffff880833827fd8 000000000000fb88 ffff880833825ab8 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? wait_for_completion+0x1d/0x20 2014-01-07 19:05:37 [] ? set_cpus_allowed_ptr+0x133/0x1d0 2014-01-07 19:05:37 [] ? bind_to_cpu0+0x0/0x32 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff8808334a9e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:37 0000000000000001 ffff88085c536740 ffff8808334a9de0 ffffffff8106669b 2014-01-07 19:05:37 ffff880833825058 ffff8808334a9fd8 000000000000fb88 ffff880833825058 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff8808334abe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:37 0000000000000001 ffff88085c536740 ffff8808334abde0 ffffffff8106669b 2014-01-07 19:05:37 ffff8808338245f8 ffff8808334abfd8 000000000000fb88 ffff8808338245f8 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff8808334afe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:37 0000000000000001 ffff88085c536740 ffff8808334afde0 ffffffff8106669b 2014-01-07 19:05:37 ffff8808334adaf8 ffff8808334affd8 000000000000fb88 ffff8808334adaf8 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff8808334b3e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:37 0000000000000001 ffff88085c536740 ffff8808334b3de0 ffffffff8106669b 2014-01-07 19:05:37 ffff8808334ad098 ffff8808334b3fd8 000000000000fb88 ffff8808334ad098 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] kthread+0x96/0xa0 2014-01-07 19:05:37 [] child_rip+0xa/0x20 2014-01-07 19:05:37 [] ? kthread+0x0/0xa0 2014-01-07 19:05:37 [] ? child_rip+0x0/0x20 2014-01-07 19:05:37 ffff8808334b5e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:37 0000000000000001 ffff88085c536740 ffff8808334b5de0 ffffffff8106669b 2014-01-07 19:05:37 ffff8808334ac638 ffff8808334b5fd8 000000000000fb88 ffff8808334ac638 2014-01-07 19:05:37 Call Trace: 2014-01-07 19:05:37 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:37 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:37 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334b9e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334b9de0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334b7ab8 ffff8808334b9fd8 000000000000fb88 ffff8808334b7ab8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334bde30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334bdde0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334b7058 ffff8808334bdfd8 000000000000fb88 ffff8808334b7058 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334c1e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334c1de0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334b65f8 ffff8808334c1fd8 000000000000fb88 ffff8808334b65f8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334c5e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334c5de0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334c3af8 ffff8808334c5fd8 000000000000fb88 ffff8808334c3af8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334c9e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334c9de0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334c3098 ffff8808334c9fd8 000000000000fb88 ffff8808334c3098 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334cbe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334cbde0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334c2638 ffff8808334cbfd8 000000000000fb88 ffff8808334c2638 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334cfe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334cfde0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334cdab8 ffff8808334cffd8 000000000000fb88 ffff8808334cdab8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334d3e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334d3de0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334cd058 ffff8808334d3fd8 000000000000fb88 ffff8808334cd058 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334d5e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334d5de0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334cc5f8 ffff8808334d5fd8 000000000000fb88 ffff8808334cc5f8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334dbe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334dbde0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334d9af8 ffff8808334dbfd8 000000000000fb88 ffff8808334d9af8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff8808334dfe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff8808334dfde0 ffffffff8106669b 2014-01-07 19:05:38 ffff8808334d9098 ffff8808334dffd8 000000000000fb88 ffff8808334d9098 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff88083351be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:38 0000000000000001 ffff88085c536740 ffff88083351bde0 ffffffff8106669b 2014-01-07 19:05:38 ffff880833519af8 ffff88083351bfd8 000000000000fb88 ffff880833519af8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff88083351fe30 0000000000000046 0000000000000000 0000000000000402 2014-01-07 19:05:38 ffff88083351fdf0 ffffffff813bb41c ffff88083351fde0 ffffffff8106669b 2014-01-07 19:05:38 ffff880833519098 ffff88083351ffd8 000000000000fb88 ffff880833519098 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? usb_suspend_both+0x1bc/0x340 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:38 [] ? usb_autosuspend_work+0x0/0x20 2014-01-07 19:05:38 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff880833521d60 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:38 ffff880831fa1000 00000400ffffffff ffff880800000000 ffff88083160f800 2014-01-07 19:05:38 ffff880833518638 ffff880833521fd8 000000000000fb88 ffff880833518638 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] hub_thread+0x379/0x1a00 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? hub_thread+0x0/0x1a00 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:38 [] ? kthread+0x0/0xa0 2014-01-07 19:05:38 [] ? child_rip+0x0/0x20 2014-01-07 19:05:38 ffff880833527e50 0000000000000046 0000000000000000 ffffffff8106669b 2014-01-07 19:05:38 ffff880833527e10 ffffffff810096f0 ffff880833527e30 0000000000000286 2014-01-07 19:05:38 ffff880833525ab8 ffff880833527fd8 000000000000fb88 ffff880833525ab8 2014-01-07 19:05:38 Call Trace: 2014-01-07 19:05:38 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:38 [] ? __switch_to+0xd0/0x320 2014-01-07 19:05:38 [] serio_thread+0x39a/0x450 2014-01-07 19:05:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:38 [] ? serio_thread+0x0/0x450 2014-01-07 19:05:38 [] kthread+0x96/0xa0 2014-01-07 19:05:38 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff88083352be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff88083352bde0 ffffffff8106669b 2014-01-07 19:05:39 ffff880833525058 ffff88083352bfd8 000000000000fb88 ffff880833525058 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff88083352de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff88083352dde0 ffffffff8106669b 2014-01-07 19:05:39 ffff8808335245f8 ffff88083352dfd8 000000000000fb88 ffff8808335245f8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833531e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833531de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083352faf8 ffff880833531fd8 000000000000fb88 ffff88083352faf8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833535e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833535de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083352f098 ffff880833535fd8 000000000000fb88 ffff88083352f098 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833537e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833537de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083352e638 ffff880833537fd8 000000000000fb88 ffff88083352e638 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff88083353be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff88083353bde0 ffffffff8106669b 2014-01-07 19:05:39 ffff880833539ab8 ffff88083353bfd8 000000000000fb88 ffff880833539ab8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833541e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833541de0 ffffffff8106669b 2014-01-07 19:05:39 ffff880833539058 ffff880833541fd8 000000000000fb88 ffff880833539058 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833543e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833543de0 ffffffff8106669b 2014-01-07 19:05:39 ffff8808335385f8 ffff880833543fd8 000000000000fb88 ffff8808335385f8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833547e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833547de0 ffffffff8106669b 2014-01-07 19:05:39 ffff880833545af8 ffff880833547fd8 000000000000fb88 ffff880833545af8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff88083354be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff88083354bde0 ffffffff8106669b 2014-01-07 19:05:39 ffff880833545098 ffff88083354bfd8 000000000000fb88 ffff880833545098 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff88083354de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff88083354dde0 ffffffff8106669b 2014-01-07 19:05:39 ffff880833544638 ffff88083354dfd8 000000000000fb88 ffff880833544638 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833551e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833551de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083354fab8 ffff880833551fd8 000000000000fb88 ffff88083354fab8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833555e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833555de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083354f058 ffff880833555fd8 000000000000fb88 ffff88083354f058 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833559e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833559de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083354e5f8 ffff880833559fd8 000000000000fb88 ffff88083354e5f8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff88083355de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff88083355dde0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083355baf8 ffff88083355dfd8 000000000000fb88 ffff88083355baf8 2014-01-07 19:05:39 Call Trace: 2014-01-07 19:05:39 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:39 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:39 [] kthread+0x96/0xa0 2014-01-07 19:05:39 [] child_rip+0xa/0x20 2014-01-07 19:05:39 [] ? kthread+0x0/0xa0 2014-01-07 19:05:39 [] ? child_rip+0x0/0x20 2014-01-07 19:05:39 ffff880833561e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:39 0000000000000001 ffff88085c536740 ffff880833561de0 ffffffff8106669b 2014-01-07 19:05:39 ffff88083355b098 ffff880833561fd8 000000000000fb88 ffff88083355b098 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff88083359de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff88083359dde0 ffffffff8106669b 2014-01-07 19:05:40 ffff88083359baf8 ffff88083359dfd8 000000000000fb88 ffff88083359baf8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335a1e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335a1de0 ffffffff8106669b 2014-01-07 19:05:40 ffff88083359b098 ffff8808335a1fd8 000000000000fb88 ffff88083359b098 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335a5e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335a5de0 ffffffff8106669b 2014-01-07 19:05:40 ffff88083359a638 ffff8808335a5fd8 000000000000fb88 ffff88083359a638 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335a9e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335a9de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335a7ab8 ffff8808335a9fd8 000000000000fb88 ffff8808335a7ab8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335ade30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335adde0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335a7058 ffff8808335adfd8 000000000000fb88 ffff8808335a7058 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335afe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335afde0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335a65f8 ffff8808335affd8 000000000000fb88 ffff8808335a65f8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335b3e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335b3de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335b1af8 ffff8808335b3fd8 000000000000fb88 ffff8808335b1af8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335b7e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335b7de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335b1098 ffff8808335b7fd8 000000000000fb88 ffff8808335b1098 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335b9e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335b9de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335b0638 ffff8808335b9fd8 000000000000fb88 ffff8808335b0638 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335bfe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335bfde0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335bdab8 ffff8808335bffd8 000000000000fb88 ffff8808335bdab8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335c3e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335c3de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335bd058 ffff8808335c3fd8 000000000000fb88 ffff8808335bd058 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335c5e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335c5de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335bc5f8 ffff8808335c5fd8 000000000000fb88 ffff8808335bc5f8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335c9e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335c9de0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335c7af8 ffff8808335c9fd8 000000000000fb88 ffff8808335c7af8 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335cde30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335cdde0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335c7098 ffff8808335cdfd8 000000000000fb88 ffff8808335c7098 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] kthread+0x96/0xa0 2014-01-07 19:05:40 [] child_rip+0xa/0x20 2014-01-07 19:05:40 [] ? kthread+0x0/0xa0 2014-01-07 19:05:40 [] ? child_rip+0x0/0x20 2014-01-07 19:05:40 ffff8808335cfe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:40 0000000000000001 ffff88085c536740 ffff8808335cfde0 ffffffff8106669b 2014-01-07 19:05:40 ffff8808335c6638 ffff8808335cffd8 000000000000fb88 ffff8808335c6638 2014-01-07 19:05:40 Call Trace: 2014-01-07 19:05:40 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:40 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:40 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808335d3e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:41 0000000000000001 ffff88085c536740 ffff8808335d3de0 ffffffff8106669b 2014-01-07 19:05:41 ffff8808335d1ab8 ffff8808335d3fd8 000000000000fb88 ffff8808335d1ab8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff880831fe1dd0 0000000000000046 0000000000000000 ffff880831fe1d94 2014-01-07 19:05:41 ffff880831fe1dd0 0000000000000286 ffff880831fe1d70 ffffffff810810cc 2014-01-07 19:05:41 ffff880833608638 ffff880831fe1fd8 000000000000fb88 ffff880833608638 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:05:41 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:05:41 [] ? process_timeout+0x0/0x10 2014-01-07 19:05:41 [] schedule_timeout_interruptible+0x1e/0x20 2014-01-07 19:05:41 [] watchdog+0x52/0x220 2014-01-07 19:05:41 [] ? watchdog+0x0/0x220 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff880831fe5e20 0000000000000046 0000000000000000 000000808150f36a 2014-01-07 19:05:41 ffff88085c536740 00000000000000e4 0000000000000002 ffffffff81c07400 2014-01-07 19:05:41 ffff880831fe3ab8 ffff880831fe5fd8 000000000000fb88 ffff880831fe3ab8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] kswapd+0x311/0x3c0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? kswapd+0x0/0x3c0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff880831fe9e20 0000000000000046 0000000000000000 000000808150f36a 2014-01-07 19:05:41 ffff880028052200 00000000000000fc 0000000000000002 ffffffff81c07400 2014-01-07 19:05:41 ffff880831fe3058 ffff880831fe9fd8 000000000000fb88 ffff880831fe3058 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] kswapd+0x311/0x3c0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? kswapd+0x0/0x3c0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff880831febe20 0000000000000046 0000000000000000 ffff880831fe2040 2014-01-07 19:05:41 ffff880831febdb0 ffffffff81065deb ffff880831febdb0 ffff880831fe2040 2014-01-07 19:05:41 ffff880831fe25f8 ffff880831febfd8 000000000000fb88 ffff880831fe25f8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? enqueue_task_fair+0xfb/0x100 2014-01-07 19:05:41 [] ksm_scan_thread+0x81b/0xd80 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? ksm_scan_thread+0x0/0xd80 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff880831fefce0 0000000000000046 0000000000000000 ffff880831fefca4 2014-01-07 19:05:41 ffff880800000000 0000000000000286 ffff880831fefc80 ffffffff810810cc 2014-01-07 19:05:41 ffff880831fedaf8 ffff880831feffd8 000000000000fb88 ffff880831fedaf8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:05:41 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:05:41 [] ? process_timeout+0x0/0x10 2014-01-07 19:05:41 [] khugepaged+0x4ec/0x1310 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? khugepaged+0x0/0x1310 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318d3e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff880831fed098 ffff8808318d3fd8 000000000000fb88 ffff880831fed098 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318d5e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff880831fec638 ffff8808318d5fd8 000000000000fb88 ffff880831fec638 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318d9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318d7ab8 ffff8808318d9fd8 000000000000fb88 ffff8808318d7ab8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318dde30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318d7058 ffff8808318ddfd8 000000000000fb88 ffff8808318d7058 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318dfe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318d65f8 ffff8808318dffd8 000000000000fb88 ffff8808318d65f8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318e3e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318e1af8 ffff8808318e3fd8 000000000000fb88 ffff8808318e1af8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318e7e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318e1098 ffff8808318e7fd8 000000000000fb88 ffff8808318e1098 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318ebe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318e0638 ffff8808318ebfd8 000000000000fb88 ffff8808318e0638 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318efe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318edab8 ffff8808318effd8 000000000000fb88 ffff8808318edab8 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318f3e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:41 ffff8808318ed058 ffff8808318f3fd8 000000000000fb88 ffff8808318ed058 2014-01-07 19:05:41 Call Trace: 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:41 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:41 [] kthread+0x96/0xa0 2014-01-07 19:05:41 [] child_rip+0xa/0x20 2014-01-07 19:05:41 [] ? kthread+0x0/0xa0 2014-01-07 19:05:41 [] ? child_rip+0x0/0x20 2014-01-07 19:05:41 ffff8808318f5e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:41 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:42 ffff8808318ec5f8 ffff8808318f5fd8 000000000000fb88 ffff8808318ec5f8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff8808318f9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:42 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:42 ffff8808318f7af8 ffff8808318f9fd8 000000000000fb88 ffff8808318f7af8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff8808318fde30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:42 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:42 ffff8808318f7098 ffff8808318fdfd8 000000000000fb88 ffff8808318f7098 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff8808318ffe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:42 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:42 ffff8808318f6638 ffff8808318fffd8 000000000000fb88 ffff8808318f6638 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831905e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:42 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:42 ffff880831903ab8 ffff880831905fd8 000000000000fb88 ffff880831903ab8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831909e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:42 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:42 ffff880831903058 ffff880831909fd8 000000000000fb88 ffff880831903058 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831945e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831945de0 ffffffff8106669b 2014-01-07 19:05:42 ffff880831943ab8 ffff880831945fd8 000000000000fb88 ffff880831943ab8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831949e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831949de0 ffffffff8106669b 2014-01-07 19:05:42 ffff880831943058 ffff880831949fd8 000000000000fb88 ffff880831943058 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff88083194be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff88083194bde0 ffffffff8106669b 2014-01-07 19:05:42 ffff8808319425f8 ffff88083194bfd8 000000000000fb88 ffff8808319425f8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831971e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831971de0 ffffffff8106669b 2014-01-07 19:05:42 ffff88083194faf8 ffff880831971fd8 000000000000fb88 ffff88083194faf8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831975e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831975de0 ffffffff8106669b 2014-01-07 19:05:42 ffff88083194f098 ffff880831975fd8 000000000000fb88 ffff88083194f098 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831977e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831977de0 ffffffff8106669b 2014-01-07 19:05:42 ffff88083194e638 ffff880831977fd8 000000000000fb88 ffff88083194e638 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff88083197be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff88083197bde0 ffffffff8106669b 2014-01-07 19:05:42 ffff880831979ab8 ffff88083197bfd8 000000000000fb88 ffff880831979ab8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff88083197fe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff88083197fde0 ffffffff8106669b 2014-01-07 19:05:42 ffff880831979058 ffff88083197ffd8 000000000000fb88 ffff880831979058 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831981e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831981de0 ffffffff8106669b 2014-01-07 19:05:42 ffff8808319785f8 ffff880831981fd8 000000000000fb88 ffff8808319785f8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:42 ffff880831985e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:42 0000000000000001 ffff88085c536740 ffff880831985de0 ffffffff8106669b 2014-01-07 19:05:42 ffff880831983af8 ffff880831985fd8 000000000000fb88 ffff880831983af8 2014-01-07 19:05:42 Call Trace: 2014-01-07 19:05:42 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:42 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:42 [] kthread+0x96/0xa0 2014-01-07 19:05:42 [] child_rip+0xa/0x20 2014-01-07 19:05:42 [] ? kthread+0x0/0xa0 2014-01-07 19:05:42 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff88083198be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff88083198bde0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831983098 ffff88083198bfd8 000000000000fb88 ffff880831983098 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff88083198de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff88083198dde0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831982638 ffff88083198dfd8 000000000000fb88 ffff880831982638 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831991e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831991de0 ffffffff8106669b 2014-01-07 19:05:43 ffff88083198fab8 ffff880831991fd8 000000000000fb88 ffff88083198fab8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831995e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831995de0 ffffffff8106669b 2014-01-07 19:05:43 ffff88083198f058 ffff880831995fd8 000000000000fb88 ffff88083198f058 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831997e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831997de0 ffffffff8106669b 2014-01-07 19:05:43 ffff88083198e5f8 ffff880831997fd8 000000000000fb88 ffff88083198e5f8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff88083199be30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff88083199bde0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831999af8 ffff88083199bfd8 000000000000fb88 ffff880831999af8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff8808319e7e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff8808319e7de0 ffffffff8106669b 2014-01-07 19:05:43 ffff8808319e5ab8 ffff8808319e7fd8 000000000000fb88 ffff8808319e5ab8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff8808319ebe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff8808319ebde0 ffffffff8106669b 2014-01-07 19:05:43 ffff8808319e5058 ffff8808319ebfd8 000000000000fb88 ffff8808319e5058 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff8808319efe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff8808319efde0 ffffffff8106669b 2014-01-07 19:05:43 ffff8808319e45f8 ffff8808319effd8 000000000000fb88 ffff8808319e45f8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a03e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a03de0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a01af8 ffff880831a03fd8 000000000000fb88 ffff880831a01af8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a07e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a07de0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a01098 ffff880831a07fd8 000000000000fb88 ffff880831a01098 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a09e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a09de0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a00638 ffff880831a09fd8 000000000000fb88 ffff880831a00638 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a0de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a0dde0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a0bab8 ffff880831a0dfd8 000000000000fb88 ffff880831a0bab8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a11e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a11de0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a0b058 ffff880831a11fd8 000000000000fb88 ffff880831a0b058 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a13e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a13de0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a0a5f8 ffff880831a13fd8 000000000000fb88 ffff880831a0a5f8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:43 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:43 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:43 [] kthread+0x96/0xa0 2014-01-07 19:05:43 [] child_rip+0xa/0x20 2014-01-07 19:05:43 [] ? kthread+0x0/0xa0 2014-01-07 19:05:43 [] ? child_rip+0x0/0x20 2014-01-07 19:05:43 ffff880831a19e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:43 0000000000000001 ffff88085c536740 ffff880831a19de0 ffffffff8106669b 2014-01-07 19:05:43 ffff880831a17af8 ffff880831a19fd8 000000000000fb88 ffff880831a17af8 2014-01-07 19:05:43 Call Trace: 2014-01-07 19:05:44 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831a1de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 0000000000000001 ffff88085c536740 ffff880831a1dde0 ffffffff8106669b 2014-01-07 19:05:44 ffff880831a17098 ffff880831a1dfd8 000000000000fb88 ffff880831a17098 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831a1fe30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 0000000000000001 ffff88085c536740 ffff880831a1fde0 ffffffff8106669b 2014-01-07 19:05:44 ffff880831a16638 ffff880831a1ffd8 000000000000fb88 ffff880831a16638 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831a23e30 0000000000000046 ffff880831a23df8 ffff880831a23df4 2014-01-07 19:05:44 0000000000000001 ffff88083fe82800 ffff880044716740 0000000000000400 2014-01-07 19:05:44 ffff880831a21ab8 ffff880831a23fd8 000000000000fb88 ffff880831a21ab8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831a27e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 0000000000000001 ffff88085c536740 ffff880831a27de0 ffffffff8106669b 2014-01-07 19:05:44 ffff880831a21058 ffff880831a27fd8 000000000000fb88 ffff880831a21058 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831a29e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 0000000000000001 ffff88085c536740 ffff880831a29de0 ffffffff8106669b 2014-01-07 19:05:44 ffff880831a205f8 ffff880831a29fd8 000000000000fb88 ffff880831a205f8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831a2de30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 0000000000000001 ffff88085c536740 ffff880831a2dde0 ffffffff8106669b 2014-01-07 19:05:44 ffff880831a2baf8 ffff880831a2dfd8 000000000000fb88 ffff880831a2baf8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831acddb0 0000000000000046 0000000000000000 ffff880831acdd74 2014-01-07 19:05:44 ffff8808319dd588 0000000000000282 ffff880831acdd50 ffffffff810810cc 2014-01-07 19:05:44 ffff8808319ddaf8 ffff880831acdfd8 000000000000fb88 ffff8808319ddaf8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:05:44 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:05:44 [] ? process_timeout+0x0/0x10 2014-01-07 19:05:44 [] schedule_timeout_interruptible+0x1e/0x20 2014-01-07 19:05:44 [] ipmi_thread+0x1ba/0x1c0 2014-01-07 19:05:44 [] ? ipmi_thread+0x0/0x1c0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831745e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 ffff880831745db0 ffffffff81057310 ffff8808319da0b8 ffff88085c5367a8 2014-01-07 19:05:44 ffff8808319da638 ffff880831745fd8 000000000000fb88 ffff8808319da638 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831785e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 ffff880831785db0 ffffffff81057310 ffff8808319dab18 ffff88085c5367a8 2014-01-07 19:05:44 ffff8808319db098 ffff880831785fd8 000000000000fb88 ffff8808319db098 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831319e30 0000000000000046 ffff880833d84728 ffffe8f7e7801ac8 2014-01-07 19:05:44 ffff880831319da0 ffffffff81082228 ffff880831319de0 ffffffff81091b89 2014-01-07 19:05:44 ffff8808319dbaf8 ffff880831319fd8 000000000000fb88 ffff8808319dbaf8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? add_timer+0x18/0x30 2014-01-07 19:05:44 [] ? queue_delayed_work_on+0xb9/0x120 2014-01-07 19:05:44 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:44 [] ? mlx4_sense_port+0x0/0xd0 [mlx4_core] 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff88082d633e30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:44 ffff88082d633db0 ffffffff81057310 ffff880831acb578 ffff88085c5367a8 2014-01-07 19:05:44 ffff880831acbaf8 ffff88082d633fd8 000000000000fb88 ffff880831acbaf8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880831255e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:44 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:44 ffff880831a625f8 ffff880831255fd8 000000000000fb88 ffff880831a625f8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff880829389e30 0000000000000046 ffff880829389da0 0000000000000246 2014-01-07 19:05:44 ffff880829389da0 ffffffff8151103b ffff880829389e10 ffffffffa00c19f6 2014-01-07 19:05:44 ffff88083108daf8 ffff880829389fd8 000000000000fb88 ffff88083108daf8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:44 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:44 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:44 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff88083367de30 0000000000000046 ffff88083367dda0 0000000000000246 2014-01-07 19:05:44 ffff88083367dda0 ffffffff8151103b ffff88083367de10 ffffffffa00c19f6 2014-01-07 19:05:44 ffff880829233af8 ffff88083367dfd8 000000000000fb88 ffff880829233af8 2014-01-07 19:05:44 Call Trace: 2014-01-07 19:05:44 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:44 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:44 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:44 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:44 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:44 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:44 [] kthread+0x96/0xa0 2014-01-07 19:05:44 [] child_rip+0xa/0x20 2014-01-07 19:05:44 [] ? kthread+0x0/0xa0 2014-01-07 19:05:44 [] ? child_rip+0x0/0x20 2014-01-07 19:05:44 ffff8808288fbe30 0000000000000046 ffff8808288fbda0 0000000000000246 2014-01-07 19:05:44 ffff8808288fbda0 ffffffff8151103b ffff8808288fbe10 ffffffffa00c19f6 2014-01-07 19:05:44 ffff8808291b8638 ffff8808288fbfd8 000000000000fb88 ffff8808291b8638 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880828813e30 0000000000000046 0000000000000000 ffffffff810914cf 2014-01-07 19:05:45 ffff880828813da0 ffffffffa00c107b ffff880828813e10 ffffffffa00c1acf 2014-01-07 19:05:45 ffff880831163ab8 ffff880828813fd8 000000000000fb88 ffff880831163ab8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? queue_work+0x1f/0x30 2014-01-07 19:05:45 [] ? rpc_final_put_task+0x4b/0x60 [sunrpc] 2014-01-07 19:05:45 [] ? __rpc_execute+0x19f/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff8808288cfe30 0000000000000046 ffff8808288cfd90 ffffffff810914cf 2014-01-07 19:05:45 ffff8808288cfda0 ffffffffa00c107b ffff8808288cfe10 ffffffffa00c1acf 2014-01-07 19:05:45 ffff88082d631af8 ffff8808288cffd8 000000000000fb88 ffff88082d631af8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? queue_work+0x1f/0x30 2014-01-07 19:05:45 [] ? rpc_final_put_task+0x4b/0x60 [sunrpc] 2014-01-07 19:05:45 [] ? __rpc_execute+0x19f/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880828943e30 0000000000000046 ffff880828943da0 0000000000000246 2014-01-07 19:05:45 ffff880828943da0 ffffffff8151103b ffff880828943e10 ffffffffa00c19f6 2014-01-07 19:05:45 ffff880829232638 ffff880828943fd8 000000000000fb88 ffff880829232638 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880831b61e30 0000000000000046 0000000000000000 0000000000000246 2014-01-07 19:05:45 ffff880831b61da0 ffffffff8151103b ffff880831b61dd0 ffffffffa00c1ea1 2014-01-07 19:05:45 ffff880831b5f098 ffff880831b61fd8 000000000000fb88 ffff880831b5f098 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? rpc_wake_up_first+0xc1/0x1e0 [sunrpc] 2014-01-07 19:05:45 [] ? xprt_autoclose+0x0/0x70 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff88082890de30 0000000000000046 ffff88082890dd90 ffffffff810914cf 2014-01-07 19:05:45 ffff88082890dda0 ffffffffa00c107b ffff88082890de10 ffffffffa00c1acf 2014-01-07 19:05:45 ffff8808288c5ab8 ffff88082890dfd8 000000000000fb88 ffff8808288c5ab8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? queue_work+0x1f/0x30 2014-01-07 19:05:45 [] ? rpc_final_put_task+0x4b/0x60 [sunrpc] 2014-01-07 19:05:45 [] ? __rpc_execute+0x19f/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880828877e30 0000000000000046 0000000000000000 0000000000000246 2014-01-07 19:05:45 ffff880828877da0 ffffffff8151103b ffff880828877e10 ffffffffa00c19f6 2014-01-07 19:05:45 ffff8808288e5ab8 ffff880828877fd8 000000000000fb88 ffff8808288e5ab8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff88082891be30 0000000000000046 0000000000000000 ffffe8ffff621c48 2014-01-07 19:05:45 ffff88082891bdd0 ffff88080ed35000 ffff88080ed355d0 00000000ffffff95 2014-01-07 19:05:45 ffff8808293b9af8 ffff88082891bfd8 000000000000fb88 ffff8808293b9af8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? xs_tcp_setup_socket+0x0/0x4c0 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff8808288f5e30 0000000000000046 ffff8808288f5da0 0000000000000246 2014-01-07 19:05:45 ffff8808288f5da0 ffffffff8151103b ffff8808288f5e10 ffffffffa00c19f6 2014-01-07 19:05:45 ffff880831b5e638 ffff8808288f5fd8 000000000000fb88 ffff880831b5e638 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880829305e30 0000000000000046 ffff880829305da0 0000000000000246 2014-01-07 19:05:45 ffff880829305da0 ffffffff8151103b ffff880829305e10 ffffffffa00c19f6 2014-01-07 19:05:45 ffff8808310885f8 ffff880829305fd8 000000000000fb88 ffff8808310885f8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880828929e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:45 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:45 ffff88083108d098 ffff880828929fd8 000000000000fb88 ffff88083108d098 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff880831049e30 0000000000000046 ffff880831049da0 0000000000000246 2014-01-07 19:05:45 ffff880831049da0 ffffffff8151103b ffff880831049e10 ffffffffa00c19f6 2014-01-07 19:05:45 ffff8808319ce5f8 ffff880831049fd8 000000000000fb88 ffff8808319ce5f8 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff88082931be30 0000000000000046 0000000000000000 0000000000000246 2014-01-07 19:05:45 ffff88082931bda0 ffffffff8151103b ffff88082931be10 ffffffffa00c19f6 2014-01-07 19:05:45 ffff880829233098 ffff88082931bfd8 000000000000fb88 ffff880829233098 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:45 [] ? __rpc_execute+0xc6/0x350 [sunrpc] 2014-01-07 19:05:45 [] ? rpc_async_schedule+0x0/0x40 [sunrpc] 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:45 ffff8808288bde30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:45 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:45 ffff880831acb098 ffff8808288bdfd8 000000000000fb88 ffff880831acb098 2014-01-07 19:05:45 Call Trace: 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:45 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:45 [] kthread+0x96/0xa0 2014-01-07 19:05:45 [] child_rip+0xa/0x20 2014-01-07 19:05:45 [] ? kthread+0x0/0xa0 2014-01-07 19:05:45 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff8808288dbe60 0000000000000046 0000000000000000 0000000a00000003 2014-01-07 19:05:46 ffffffffffffffff ffffffff81065deb ffff8808288dbdf0 ffff8808288dbe80 2014-01-07 19:05:46 ffff880833c45058 ffff8808288dbfd8 000000000000fb88 ffff880833c45058 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? enqueue_task_fair+0xfb/0x100 2014-01-07 19:05:46 [] slow_work_thread+0x32b/0x360 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? slow_work_thread+0x0/0x360 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880828889e60 0000000000000046 0000000000000000 0000000a00000003 2014-01-07 19:05:46 ffffffffffffffff ffffffff81065deb ffff880828889df0 ffff880828889e80 2014-01-07 19:05:46 ffff8808293bdab8 ffff880828889fd8 000000000000fb88 ffff8808293bdab8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? enqueue_task_fair+0xfb/0x100 2014-01-07 19:05:46 [] slow_work_thread+0x32b/0x360 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? slow_work_thread+0x0/0x360 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff88082888be30 0000000000000046 0000000000000000 ffff88082888a000 2014-01-07 19:05:46 ffff8800bba812c0 0000000000000000 ffff8800bba812c0 ffffffffa00c1110 2014-01-07 19:05:46 ffff8808288c45f8 ffff88082888bfd8 000000000000fb88 ffff8808288c45f8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? rpc_async_release+0x0/0x20 [sunrpc] 2014-01-07 19:05:46 [] ? rpc_async_release+0x0/0x20 [sunrpc] 2014-01-07 19:05:46 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880827e7fe70 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:46 ffff880827e7fe20 ffffffff81064b00 ffff88085c5367a8 ffff88085c536740 2014-01-07 19:05:46 ffff8808288c5058 ffff880827e7ffd8 000000000000fb88 ffff8808288c5058 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? pick_next_task_fair+0xd0/0x130 2014-01-07 19:05:46 [] kauditd_thread+0x149/0x180 2014-01-07 19:05:46 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:46 [] ? kauditd_thread+0x0/0x180 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff8808320a1a58 0000000000000082 0000000000000000 ffffffff81063422 2014-01-07 19:05:46 ffff8808320a19f8 ffffffff81197726 0000000000000000 ffff880833cd0080 2014-01-07 19:05:46 ffff88083106dab8 ffff8808320a1fd8 000000000000fb88 ffff88083106dab8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? pollwake+0x56/0x60 2014-01-07 19:05:46 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:46 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:46 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:46 [] ? unix_dgram_poll+0x127/0x1c0 2014-01-07 19:05:46 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:46 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:46 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:46 [] ? pollwake+0x0/0x60 2014-01-07 19:05:46 [] ? pollwake+0x0/0x60 2014-01-07 19:05:46 [] ? pollwake+0x0/0x60 2014-01-07 19:05:46 [] ? pollwake+0x0/0x60 2014-01-07 19:05:46 [] ? pollwake+0x0/0x60 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? generic_file_aio_write+0xba/0x100 2014-01-07 19:05:46 [] ? do_sync_write+0xfa/0x140 2014-01-07 19:05:46 [] ? sys_recvfrom+0xee/0x180 2014-01-07 19:05:46 [] ? vfs_write+0x132/0x1a0 2014-01-07 19:05:46 [] sys_poll+0x71/0x100 2014-01-07 19:05:46 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:46 ffff880827f8be30 0000000000000046 0000000000000000 0000000000000282 2014-01-07 19:05:46 ffff880827f8bdf0 ffffffff81393e68 ffff880827f8bdf0 ffffffff8139436a 2014-01-07 19:05:46 ffff8808310e2638 ffff880827f8bfd8 000000000000fb88 ffff8808310e2638 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? ata_scsi_port_error_handler+0x348/0x710 2014-01-07 19:05:46 [] ? ata_scsi_cmd_error_handler+0x13a/0x190 2014-01-07 19:05:46 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff8808328a3e30 0000000000000046 0000000000000000 0000000000000282 2014-01-07 19:05:46 ffff8808328a3df0 ffffffff81393e68 ffff8808328a3df0 ffffffff8139436a 2014-01-07 19:05:46 ffff880828854638 ffff8808328a3fd8 000000000000fb88 ffff880828854638 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? ata_scsi_port_error_handler+0x348/0x710 2014-01-07 19:05:46 [] ? ata_scsi_cmd_error_handler+0x13a/0x190 2014-01-07 19:05:46 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff88083270de30 0000000000000046 000000000000000f 0000000000000282 2014-01-07 19:05:46 ffff88083270ddf0 ffffffff81393e68 ffff88083270ddf0 ffffffff8139436a 2014-01-07 19:05:46 ffff880818379af8 ffff88083270dfd8 000000000000fb88 ffff880818379af8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? ata_scsi_port_error_handler+0x348/0x710 2014-01-07 19:05:46 [] ? ata_scsi_cmd_error_handler+0x13a/0x190 2014-01-07 19:05:46 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880827f0be30 0000000000000046 ffff880827f0bdf8 ffff880827f0bdf4 2014-01-07 19:05:46 ffff880827f0bdf0 ffff88083fe82400 ffff88085c416740 00000000000002ff 2014-01-07 19:05:46 ffff8808292985f8 ffff880827f0bfd8 000000000000fb88 ffff8808292985f8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880827f7fe30 0000000000000046 0000000000000000 0000000000000282 2014-01-07 19:05:46 ffff880827f7fdf0 ffffffff81393e68 ffff880827f7fdf0 ffffffff8139436a 2014-01-07 19:05:46 ffff8808293965f8 ffff880827f7ffd8 000000000000fb88 ffff8808293965f8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? ata_scsi_port_error_handler+0x348/0x710 2014-01-07 19:05:46 [] ? ata_scsi_cmd_error_handler+0x13a/0x190 2014-01-07 19:05:46 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880827fb1e30 0000000000000046 ffff880827fb1df8 ffff880827fb1df4 2014-01-07 19:05:46 ffff880827fb1df0 ffff88083fe82600 ffff88085c416740 00000000000002ff 2014-01-07 19:05:46 ffff880818164638 ffff880827fb1fd8 000000000000fb88 ffff880818164638 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:46 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:46 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880831d55e30 0000000000000046 0000000000000000 ffffe8f7e780abc0 2014-01-07 19:05:46 00000000ffffffff ffff88083296c168 ffff880831d55fd8 ffffe8f7e780abc8 2014-01-07 19:05:46 ffff88083254a638 ffff880831d55fd8 000000000000fb88 ffff88083254a638 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:46 [] ? edac_mc_workq_function+0x0/0xb0 [edac_core] 2014-01-07 19:05:46 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff880832577e30 0000000000000046 0000000000000000 ffff8800447d67a8 2014-01-07 19:05:46 ffff880832577db0 ffffffff81057310 ffff880832781538 ffff8800447d67a8 2014-01-07 19:05:46 ffff880832781ab8 ffff880832577fd8 000000000000fb88 ffff880832781ab8 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff8808185ade30 0000000000000046 0000000000000000 ffff88085c5367a8 2014-01-07 19:05:46 ffff8808185addb0 ffffffff81057310 ffff880832756b18 ffff88085c5367a8 2014-01-07 19:05:46 ffff880832757098 ffff8808185adfd8 000000000000fb88 ffff880832757098 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] kthread+0x96/0xa0 2014-01-07 19:05:46 [] child_rip+0xa/0x20 2014-01-07 19:05:46 [] ? kthread+0x0/0xa0 2014-01-07 19:05:46 [] ? child_rip+0x0/0x20 2014-01-07 19:05:46 ffff8808178afe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:46 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:46 ffff880832756638 ffff8808178affd8 000000000000fb88 ffff880832756638 2014-01-07 19:05:46 Call Trace: 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:46 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:46 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880818527e30 0000000000000046 ffff880818527df8 ffff880818527df4 2014-01-07 19:05:47 ffff880818527da0 ffff88083fe81200 ffff880044676740 0000000000000519 2014-01-07 19:05:47 ffff880832757af8 ffff880818527fd8 000000000000fb88 ffff880832757af8 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? process_queued_ios+0x0/0x290 [dm_multipath] 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880818523e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:47 ffff880818523da0 ffffffff81091472 ffff880818523db0 ffffffff810914cf 2014-01-07 19:05:47 ffff8808319dd098 ffff880818523fd8 000000000000fb88 ffff8808319dd098 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? queue_work_on+0x42/0x60 2014-01-07 19:05:47 [] ? queue_work+0x1f/0x30 2014-01-07 19:05:47 [] ? process_queued_ios+0x0/0x290 [dm_multipath] 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880832f41e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff880828855af8 ffff880832f41fd8 000000000000fb88 ffff880828855af8 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880827f6fe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff8808326d85f8 ffff880827f6ffd8 000000000000fb88 ffff8808326d85f8 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff88081852de30 0000000000000046 0000000000000000 ffff881030156690 2014-01-07 19:05:47 ffff88081852ddf0 ffff88081852ddf0 ffff88081852ddc0 ffffffffa02ae2dc 2014-01-07 19:05:47 ffff88081838b098 ffff88081852dfd8 000000000000fb88 ffff88081838b098 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? dm_dispatch_request+0x3c/0x70 [dm_mod] 2014-01-07 19:05:47 [] ? process_queued_ios+0x0/0x290 [dm_multipath] 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880818529e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff88081856e638 ffff880818529fd8 000000000000fb88 ffff88081856e638 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880832523e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff880818578638 ffff880832523fd8 000000000000fb88 ffff880818578638 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880832bd3e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff880831e46638 ffff880832bd3fd8 000000000000fb88 ffff880831e46638 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff8808325a9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff880818579af8 ffff8808325a9fd8 000000000000fb88 ffff880818579af8 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880818313e30 0000000000000046 ffff880818313df8 ffff880818313df4 2014-01-07 19:05:47 ffff880818313da0 ffff88083fe82400 ffff880044676740 00000000000005de 2014-01-07 19:05:47 ffff880818579098 ffff880818313fd8 000000000000fb88 ffff880818579098 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? process_queued_ios+0x0/0x290 [dm_multipath] 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff8808183a3e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff8808185385f8 ffff8808183a3fd8 000000000000fb88 ffff8808185385f8 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff88083256fe30 0000000000000046 ffff88083256fdf8 ffff88083256fdf4 2014-01-07 19:05:47 ffff88083256fda0 ffff88083fe82800 ffff880044616740 00000000000006f1 2014-01-07 19:05:47 ffff880818539058 ffff88083256ffd8 000000000000fb88 ffff880818539058 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? process_queued_ios+0x0/0x290 [dm_multipath] 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff8808179b1e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff880832f8d098 ffff8808179b1fd8 000000000000fb88 ffff880832f8d098 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff8808321a9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff88083263daf8 ffff8808321a9fd8 000000000000fb88 ffff88083263daf8 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff8808181fde30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:47 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:47 ffff8808291b9098 ffff8808181fdfd8 000000000000fb88 ffff8808291b9098 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:47 ffff880831bd1e30 0000000000000046 ffff8808183b2148 ffff880818710078 2014-01-07 19:05:47 ffff880831bd1db0 ffffffff812797b7 ffff8808183b2000 ffff8808183b2000 2014-01-07 19:05:47 ffff880818484638 ffff880831bd1fd8 000000000000fb88 ffff880818484638 2014-01-07 19:05:47 Call Trace: 2014-01-07 19:05:47 [] ? kobject_put+0x27/0x60 2014-01-07 19:05:47 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:47 [] ? activate_path+0x0/0x30 [dm_multipath] 2014-01-07 19:05:47 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:47 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:47 [] kthread+0x96/0xa0 2014-01-07 19:05:47 [] child_rip+0xa/0x20 2014-01-07 19:05:47 [] ? kthread+0x0/0xa0 2014-01-07 19:05:47 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff880831b8fe30 0000000000000046 ffff880831b8fda0 ffffffffa02eb2fa 2014-01-07 19:05:48 ffff880831b8ffd8 ffff880833c5a7e0 ffff880831b8fe30 ffffffffa03174ce 2014-01-07 19:05:48 ffff880833ea0638 ffff880831b8ffd8 000000000000fb88 ffff880833ea0638 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? ib_create_ah+0x1a/0x40 [ib_core] 2014-01-07 19:05:48 [] ? update_sm_ah+0x10e/0x1b0 [ib_sa] 2014-01-07 19:05:48 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:48 [] ? update_sm_ah+0x0/0x1b0 [ib_sa] 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808342d9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff88083190daf8 ffff8808342d9fd8 000000000000fb88 ffff88083190daf8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff88082938be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff8808319a45f8 ffff88082938bfd8 000000000000fb88 ffff8808319a45f8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff880827ed1e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff88083109faf8 ffff880827ed1fd8 000000000000fb88 ffff88083109faf8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808326d1e30 0000000000000046 ffff8808326d1da0 ffffffffa02eb2fa 2014-01-07 19:05:48 ffff8808326d1fd8 ffff880831b4fde0 ffff8808326d1e30 ffffffffa03174ce 2014-01-07 19:05:48 ffff8808343ef058 ffff8808326d1fd8 000000000000fb88 ffff8808343ef058 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? ib_create_ah+0x1a/0x40 [ib_core] 2014-01-07 19:05:48 [] ? update_sm_ah+0x10e/0x1b0 [ib_sa] 2014-01-07 19:05:48 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:48 [] ? update_sm_ah+0x0/0x1b0 [ib_sa] 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808186c7e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff880827f11098 ffff8808186c7fd8 000000000000fb88 ffff880827f11098 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff880831a53e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff8808325be638 ffff880831a53fd8 000000000000fb88 ffff8808325be638 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808329a7e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff88083103a5f8 ffff8808329a7fd8 000000000000fb88 ffff88083103a5f8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808186d9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff8808335e65f8 ffff8808186d9fd8 000000000000fb88 ffff8808335e65f8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808183a1e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff880833eb7af8 ffff8808183a1fd8 000000000000fb88 ffff880833eb7af8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff88081879be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff880834341af8 ffff88081879bfd8 000000000000fb88 ffff880834341af8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff880831a3de30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff88081825c638 ffff880831a3dfd8 000000000000fb88 ffff88081825c638 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff880831159e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff8808319a5ab8 ffff880831159fd8 000000000000fb88 ffff8808319a5ab8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808181a1e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff8808335e7ab8 ffff8808181a1fd8 000000000000fb88 ffff8808335e7ab8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff880831121e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff880817965098 ffff880831121fd8 000000000000fb88 ffff880817965098 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808182a9e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:48 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:48 ffff880834395af8 ffff8808182a9fd8 000000000000fb88 ffff880834395af8 2014-01-07 19:05:48 Call Trace: 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:48 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:48 [] kthread+0x96/0xa0 2014-01-07 19:05:48 [] child_rip+0xa/0x20 2014-01-07 19:05:48 [] ? kthread+0x0/0xa0 2014-01-07 19:05:48 [] ? child_rip+0x0/0x20 2014-01-07 19:05:48 ffff8808181a5e30 0000000000000046 ffff8808181a5e30 ffffffffa031973d 2014-01-07 19:05:49 ffff880800000bb8 ffffffff000000d0 ffffffffa0319e80 ffff8808341ad180 2014-01-07 19:05:49 ffff88081818fab8 ffff8808181a5fd8 000000000000fb88 ffff88081818fab8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? mcast_work_handler+0xed/0x830 [ib_sa] 2014-01-07 19:05:49 [] ? join_handler+0x0/0x200 [ib_sa] 2014-01-07 19:05:49 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:49 [] ? mcast_work_handler+0x0/0x830 [ib_sa] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff8808343b9e30 0000000000000046 0000000000000000 ffff88085c4367a8 2014-01-07 19:05:49 ffff8808343b9db0 ffffffff81057310 ffff880834386078 ffff88085c4367a8 2014-01-07 19:05:49 ffff8808343865f8 ffff8808343b9fd8 000000000000fb88 ffff8808343865f8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff8808343c1e30 0000000000000046 0000000000000000 ffff88085c4367a8 2014-01-07 19:05:49 ffff8808343c1db0 ffffffff81057310 ffff880833ce60b8 ffff88085c4367a8 2014-01-07 19:05:49 ffff880833ce6638 ffff8808343c1fd8 000000000000fb88 ffff880833ce6638 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880832bd1e30 0000000000000046 0000000000000000 ffff8808323d4240 2014-01-07 19:05:49 ffff880831c94e98 ffff880800000001 ffff88007f286d00 0000000000000000 2014-01-07 19:05:49 ffff8808180805f8 ffff880832bd1fd8 000000000000fb88 ffff8808180805f8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? ib_mad_completion_handler+0x0/0x8c0 [ib_mad] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff8808180ade30 0000000000000046 0000000000000000 ffff88079f218500 2014-01-07 19:05:49 0000000000000286 ffff880831a47d98 ffff880831a47d80 0000008000000000 2014-01-07 19:05:49 ffff880827f5bab8 ffff8808180adfd8 000000000000fb88 ffff880827f5bab8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:49 [] ? ib_mad_completion_handler+0x0/0x8c0 [ib_mad] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880833cf3e30 0000000000000046 0000000000000000 ffff8800bd199500 2014-01-07 19:05:49 0000000000000286 ffff880831b93e18 ffff880831b93e00 0000008000000000 2014-01-07 19:05:49 ffff8808325ebab8 ffff880833cf3fd8 000000000000fb88 ffff8808325ebab8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? ib_mad_completion_handler+0x0/0x8c0 [ib_mad] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff88081795de30 0000000000000046 ffff88081795ddf0 0000000000000286 2014-01-07 19:05:49 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:49 ffff880831d0c5f8 ffff88081795dfd8 000000000000fb88 ffff880831d0c5f8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:49 [] ? process_req+0x0/0x1a0 [ib_addr] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880818509e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:49 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:49 ffff880834305af8 ffff880818509fd8 000000000000fb88 ffff880834305af8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880832395e30 0000000000000046 0000000000000000 ffff8800bcf16c00 2014-01-07 19:05:49 ffff8807cb979ce8 ffff8800bcf16c00 0000000000000000 ffffffffa01befa0 2014-01-07 19:05:49 ffff8808327ab098 ffff880832395fd8 000000000000fb88 ffff8808327ab098 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff8808182c7e30 0000000000000046 ffff8800bd5290c0 0000000000000000 2014-01-07 19:05:49 ffff8800bd7c5270 ffffe8f7e782b348 ffff8808182c7de0 ffffffffa01bece5 2014-01-07 19:05:49 ffff880833571098 ffff8808182c7fd8 000000000000fb88 ffff880833571098 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? cm_rep_handler+0x345/0x600 [ib_cm] 2014-01-07 19:05:49 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880827edbe30 0000000000000046 ffff880827edbdf8 ffff880827edbdf4 2014-01-07 19:05:49 ffff8800bcfc4ae8 ffff8800bcfc4b38 ffff880044616740 0000000000000400 2014-01-07 19:05:49 ffff8808334f9ab8 ffff880827edbfd8 000000000000fb88 ffff8808334f9ab8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff8808312bbe30 0000000000000046 ffff8807b4da3400 ffff88007f026080 2014-01-07 19:05:49 ffff8800bd7c58e8 ffff8800bd7c5938 0000000000000000 ffff880000000000 2014-01-07 19:05:49 ffff880831a40638 ffff8808312bbfd8 000000000000fb88 ffff880831a40638 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880831b87e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:49 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:49 ffff880833cf1058 ffff880831b87fd8 000000000000fb88 ffff880833cf1058 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff8808311a1e30 0000000000000046 0000000000000000 ffff8808291b4980 2014-01-07 19:05:49 ffff8808311a1de0 ffffffffa01bd9b2 ffff880800001800 ffff880800000000 2014-01-07 19:05:49 ffff880833eb7098 ffff8808311a1fd8 000000000000fb88 ffff880833eb7098 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? cm_process_work+0x32/0x110 [ib_cm] 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff88082925fe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:49 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:49 ffff880831a57af8 ffff88082925ffd8 000000000000fb88 ffff880831a57af8 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:49 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:49 [] kthread+0x96/0xa0 2014-01-07 19:05:49 [] child_rip+0xa/0x20 2014-01-07 19:05:49 [] ? kthread+0x0/0xa0 2014-01-07 19:05:49 [] ? child_rip+0x0/0x20 2014-01-07 19:05:49 ffff880831b9de30 0000000000000046 0000000000000000 ffff8807cb6f9800 2014-01-07 19:05:49 0000000000000000 ffff8807cb6f9800 0000000000000000 ffffffffa01befa0 2014-01-07 19:05:49 ffff880831a2a638 ffff880831b9dfd8 000000000000fb88 ffff880831a2a638 2014-01-07 19:05:49 Call Trace: 2014-01-07 19:05:49 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:50 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:50 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff88081834fe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff88083190c638 ffff88081834ffd8 000000000000fb88 ffff88083190c638 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff880827cd5e30 0000000000000046 0000000000000000 ffff88007f0fac00 2014-01-07 19:05:50 0000000000000000 ffff88007f0fac00 0000000000000000 ffffffffa01befa0 2014-01-07 19:05:50 ffff880818485af8 ffff880827cd5fd8 000000000000fb88 ffff880818485af8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:50 [] ? cm_work_handler+0x0/0x1206 [ib_cm] 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff880818465e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff880833c3daf8 ffff880818465fd8 000000000000fb88 ffff880833c3daf8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff8808323c3e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff8808327abaf8 ffff8808323c3fd8 000000000000fb88 ffff8808327abaf8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff8808186ffe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff880831a365f8 ffff8808186fffd8 000000000000fb88 ffff880831a365f8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff8808327c3e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff880833cdbab8 ffff8808327c3fd8 000000000000fb88 ffff880833cdbab8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff88083234be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff880833ea1af8 ffff88083234bfd8 000000000000fb88 ffff880833ea1af8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff880832351e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:50 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:50 ffff880831aca638 ffff880832351fd8 000000000000fb88 ffff880831aca638 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff88081846be30 0000000000000046 ffff8808342a3bc0 0000060501000038 2014-01-07 19:05:50 ffff88081846be00 0000000000000286 ffff8808325beb18 ffff8807d1326670 2014-01-07 19:05:50 ffff8808325bf098 ffff88081846bfd8 000000000000fb88 ffff8808325bf098 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:50 [] ? cma_work_handler+0x0/0xb0 [rdma_cm] 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff880818533e30 0000000000000046 ffff8810327de020 ffffe8f7e780b440 2014-01-07 19:05:50 00000000ffffffff ffff8810327de9a0 ffff880818533fd8 ffffe8f7e780b448 2014-01-07 19:05:50 ffff88083357bab8 ffff880818533fd8 000000000000fb88 ffff88083357bab8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:50 [] ? ipoib_reap_ah+0x0/0x50 [ib_ipoib] 2014-01-07 19:05:50 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:50 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:50 [] kthread+0x96/0xa0 2014-01-07 19:05:50 [] child_rip+0xa/0x20 2014-01-07 19:05:50 [] ? kthread+0x0/0xa0 2014-01-07 19:05:50 [] ? child_rip+0x0/0x20 2014-01-07 19:05:50 ffff88103116fbf8 0000000000000086 0000000000000246 0000000000000004 2014-01-07 19:05:50 ffffffffffffffff 0000000000000002 ffff88103116fb88 00000000311ec6c0 2014-01-07 19:05:50 ffff88102f87faf8 ffff88103116ffd8 000000000000fb88 ffff88102f87faf8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:50 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:50 [] ? __alloc_pages_nodemask+0x113/0x8d0 2014-01-07 19:05:50 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:50 [] ? cpumask_next_and+0x29/0x50 2014-01-07 19:05:50 [] do_futex+0x121/0xb60 2014-01-07 19:05:50 [] ? check_preempt_curr_rt+0x7d/0xe0 2014-01-07 19:05:50 [] ? check_preempt_curr+0x7c/0x90 2014-01-07 19:05:50 [] ? wake_up_new_task+0xd9/0x130 2014-01-07 19:05:50 [] ? do_fork+0x133/0x460 2014-01-07 19:05:50 [] sys_futex+0x7b/0x170 2014-01-07 19:05:50 [] ? sys_clone+0x28/0x30 2014-01-07 19:05:50 [] ? stub_clone+0x13/0x20 2014-01-07 19:05:50 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:50 ffff881031211bf8 0000000000000086 0000000000000000 0000000000000282 2014-01-07 19:05:50 0000000000000001 0000000000000282 ffff881031211ba8 ffffffff81055a3e 2014-01-07 19:05:50 ffff88102f337058 ffff881031211fd8 000000000000fb88 ffff88102f337058 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] ? __wake_up_sync_key+0x5e/0x80 2014-01-07 19:05:50 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:50 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:50 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:50 [] ? rwsem_down_read_failed+0x26/0x30 2014-01-07 19:05:50 [] do_futex+0x121/0xb60 2014-01-07 19:05:50 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:05:50 [] ? sys_sendto+0x185/0x190 2014-01-07 19:05:50 [] sys_futex+0x7b/0x170 2014-01-07 19:05:50 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:50 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:50 ffff8810313afa58 0000000000000086 ffff8810313afa20 ffff8810313afa1c 2014-01-07 19:05:50 000000000000000a ffff88083fe82400 ffff880044616740 0000000000000406 2014-01-07 19:05:50 ffff881035d85ab8 ffff8810313affd8 000000000000fb88 ffff881035d85ab8 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] schedule_hrtimeout_range+0xc8/0x160 2014-01-07 19:05:50 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:50 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:50 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:50 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:50 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:50 [] ? pollwake+0x0/0x60 2014-01-07 19:05:50 [] ? do_wp_page+0x493/0x920 2014-01-07 19:05:50 [] ? put_rpccred+0x50/0x150 [sunrpc] 2014-01-07 19:05:50 [] ? inode_init_always+0x11e/0x1c0 2014-01-07 19:05:50 [] ? handle_pte_fault+0x2cd/0xb50 2014-01-07 19:05:50 [] ? inotify_d_instantiate+0x2a/0x60 2014-01-07 19:05:50 [] ? __d_instantiate+0xbb/0x110 2014-01-07 19:05:50 [] ? fsnotify_create+0x60/0x80 2014-01-07 19:05:50 [] ? handle_mm_fault+0x23a/0x310 2014-01-07 19:05:50 [] ? read_tsc+0x9/0x20 2014-01-07 19:05:50 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:05:50 [] ? poll_select_set_timeout+0x8d/0xa0 2014-01-07 19:05:50 [] ? do_sys_poll+0x1/0x520 2014-01-07 19:05:50 [] sys_poll+0x71/0x100 2014-01-07 19:05:50 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:50 ffff88103104d968 0000000000000086 ffff88103104d930 ffff88103104d92c 2014-01-07 19:05:50 ffff88103104d8d8 ffff88083fe82000 ffff88085c4b6740 0000000000000400 2014-01-07 19:05:50 ffff8810313eb058 ffff88103104dfd8 000000000000fb88 ffff8810313eb058 2014-01-07 19:05:50 Call Trace: 2014-01-07 19:05:50 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:05:50 [] ? del_timer+0x7d/0xe0 2014-01-07 19:05:50 [] wait_for_common+0x123/0x180 2014-01-07 19:05:50 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:50 [] wait_for_completion+0x1d/0x20 2014-01-07 19:05:50 [] blk_execute_rq+0x8c/0xf0 2014-01-07 19:05:51 [] ? blk_rq_map_user+0x1a0/0x280 2014-01-07 19:05:51 [] sg_io+0x215/0x3d0 2014-01-07 19:05:51 [] ? do_lookup+0x9f/0x230 2014-01-07 19:05:51 [] scsi_cmd_ioctl+0x400/0x470 2014-01-07 19:05:51 [] scsi_cmd_blk_ioctl+0x51/0x70 2014-01-07 19:05:51 [] sd_ioctl+0xaf/0x110 [sd_mod] 2014-01-07 19:05:51 [] __blkdev_driver_ioctl+0x67/0x80 2014-01-07 19:05:51 [] blkdev_ioctl+0x1ed/0x6e0 2014-01-07 19:05:51 [] block_ioctl+0x3c/0x40 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] ? _atomic_dec_and_lock+0x55/0x80 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] ? __fput+0x1a1/0x210 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff8810323cb998 0000000000000086 ffff8810323cba28 0000000200000000 2014-01-07 19:05:51 ffff8810309ec080 ffff8810311ec728 0000000000000000 ffff880840010dc0 2014-01-07 19:05:51 ffff8810309ec638 ffff8810323cbfd8 000000000000fb88 ffff8810309ec638 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:05:51 [] __skb_recv_datagram+0x237/0x290 2014-01-07 19:05:51 [] ? receiver_wake_function+0x0/0x20 2014-01-07 19:05:51 [] ? __kfree_skb+0x47/0xa0 2014-01-07 19:05:51 [] skb_recv_datagram+0x24/0x30 2014-01-07 19:05:51 [] unix_dgram_recvmsg+0x86/0x380 2014-01-07 19:05:51 [] sock_recvmsg+0x133/0x160 2014-01-07 19:05:51 [] ? ptep_set_access_flags+0x6d/0x70 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] ? enqueue_pushable_task+0x73/0x90 2014-01-07 19:05:51 [] ? physflat_send_IPI_mask+0xe/0x10 2014-01-07 19:05:51 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:05:51 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:51 [] __sys_recvmsg+0x13c/0x2f0 2014-01-07 19:05:51 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:05:51 [] ? release_sock+0xce/0xe0 2014-01-07 19:05:51 [] sys_recvmsg+0x49/0x90 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff881031e93bf8 0000000000000086 00000000ffffffff 00000000c0397cb1 2014-01-07 19:05:51 ffff881031e93b98 ffffc900209e51c3 ffffffffa01364cc ffffffffa01364ca 2014-01-07 19:05:51 ffff881030945ab8 ffff881031e93fd8 000000000000fb88 ffff881030945ab8 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:51 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:51 [] ? scnprintf+0x34/0x40 2014-01-07 19:05:51 [] ? free_hot_page+0x2f/0x60 2014-01-07 19:05:51 [] do_futex+0x121/0xb60 2014-01-07 19:05:51 [] ? ctl_ioctl+0x1ca/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? table_status+0x0/0x90 [dm_mod] 2014-01-07 19:05:51 [] ? dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] ? vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] ? _atomic_dec_and_lock+0x55/0x80 2014-01-07 19:05:51 [] ? do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_futex+0x7b/0x170 2014-01-07 19:05:51 [] ? sys_ioctl+0x8e/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff88103197fd08 0000000000000086 ffff88103197fdc8 ffffffffa02b57b1 2014-01-07 19:05:51 0000001700000004 0000400000000006 0000000000000138 0000020400000000 2014-01-07 19:05:51 ffff88102f35d058 ffff88103197ffd8 000000000000fb88 ffff88102f35d058 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? copy_params+0xc1/0x140 [dm_mod] 2014-01-07 19:05:51 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:51 [] dm_wait_event+0x91/0xe0 [dm_mod] 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] dev_wait+0x4c/0xc0 [dm_mod] 2014-01-07 19:05:51 [] ctl_ioctl+0x1b4/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? dev_wait+0x0/0xc0 [dm_mod] 2014-01-07 19:05:51 [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff881030b79d08 0000000000000086 ffff881030b79dc8 ffffffffa02b57b1 2014-01-07 19:05:51 0000001700000004 0000400000000006 0000000000000138 0000020400000000 2014-01-07 19:05:51 ffff88102f153098 ffff881030b79fd8 000000000000fb88 ffff88102f153098 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? copy_params+0xc1/0x140 [dm_mod] 2014-01-07 19:05:51 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:51 [] dm_wait_event+0x91/0xe0 [dm_mod] 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] dev_wait+0x4c/0xc0 [dm_mod] 2014-01-07 19:05:51 [] ctl_ioctl+0x1b4/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? dev_wait+0x0/0xc0 [dm_mod] 2014-01-07 19:05:51 [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff881030329d08 0000000000000086 ffff881030329dc8 ffffffffa02b57b1 2014-01-07 19:05:51 0000001700000004 0000400000000006 0000000000000138 0000020400000000 2014-01-07 19:05:51 ffff881031a97af8 ffff881030329fd8 000000000000fb88 ffff881031a97af8 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? copy_params+0xc1/0x140 [dm_mod] 2014-01-07 19:05:51 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:51 [] dm_wait_event+0x91/0xe0 [dm_mod] 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] dev_wait+0x4c/0xc0 [dm_mod] 2014-01-07 19:05:51 [] ctl_ioctl+0x1b4/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? dev_wait+0x0/0xc0 [dm_mod] 2014-01-07 19:05:51 [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] ? rwsem_wake+0x75/0x170 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff881030339d08 0000000000000086 ffff881030339dc8 ffffffffa02b57b1 2014-01-07 19:05:51 0000001700000004 0000400000000006 0000000000000138 0000020400000000 2014-01-07 19:05:51 ffff881031d2f058 ffff881030339fd8 000000000000fb88 ffff881031d2f058 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? copy_params+0xc1/0x140 [dm_mod] 2014-01-07 19:05:51 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:51 [] dm_wait_event+0x91/0xe0 [dm_mod] 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] dev_wait+0x4c/0xc0 [dm_mod] 2014-01-07 19:05:51 [] ctl_ioctl+0x1b4/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? dev_wait+0x0/0xc0 [dm_mod] 2014-01-07 19:05:51 [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff88103086bd08 0000000000000086 ffff88103086bdc8 ffffffffa02b57b1 2014-01-07 19:05:51 0000001700000004 0000400000000006 0000000000000138 0000020400000000 2014-01-07 19:05:51 ffff8810309a1098 ffff88103086bfd8 000000000000fb88 ffff8810309a1098 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? copy_params+0xc1/0x140 [dm_mod] 2014-01-07 19:05:51 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:51 [] dm_wait_event+0x91/0xe0 [dm_mod] 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] dev_wait+0x4c/0xc0 [dm_mod] 2014-01-07 19:05:51 [] ctl_ioctl+0x1b4/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? dev_wait+0x0/0xc0 [dm_mod] 2014-01-07 19:05:51 [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff881031d9bd08 0000000000000086 0000000000000000 ffffffffa02b57b1 2014-01-07 19:05:51 0000001700000004 0000400000000006 0000000000000138 0000020400000000 2014-01-07 19:05:51 ffff8810318a3058 ffff881031d9bfd8 000000000000fb88 ffff8810318a3058 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? copy_params+0xc1/0x140 [dm_mod] 2014-01-07 19:05:51 [] dm_wait_event+0x91/0xe0 [dm_mod] 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:51 [] dev_wait+0x4c/0xc0 [dm_mod] 2014-01-07 19:05:51 [] ctl_ioctl+0x1b4/0x270 [dm_mod] 2014-01-07 19:05:51 [] ? dev_wait+0x0/0xc0 [dm_mod] 2014-01-07 19:05:51 [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2014-01-07 19:05:51 [] vfs_ioctl+0x22/0xa0 2014-01-07 19:05:51 [] do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:51 [] sys_ioctl+0x81/0xa0 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff880827f13e78 0000000000000086 0000000000000000 0000000000000028 2014-01-07 19:05:51 ffff880828918d00 00007ffff6823040 ffff8808326cb318 0000000000000014 2014-01-07 19:05:51 ffff880827f11af8 ffff880827f13fd8 000000000000fb88 ffff880827f11af8 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] do_wait+0x1e4/0x240 2014-01-07 19:05:51 [] sys_wait4+0xa3/0x100 2014-01-07 19:05:51 [] ? child_wait_callback+0x0/0x70 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff881031175a58 0000000000000082 0000000000000000 ffffffff8109bc05 2014-01-07 19:05:51 ffff881000000000 0000000181485c38 ffff8810311759f8 ffff880831b7ec10 2014-01-07 19:05:51 ffff8810309445f8 ffff881031175fd8 000000000000fb88 ffff8810309445f8 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:05:51 [] schedule_hrtimeout_range+0xc8/0x160 2014-01-07 19:05:51 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:51 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:51 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:51 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:51 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? pollwake+0x0/0x60 2014-01-07 19:05:51 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:51 [] ? read_tsc+0x9/0x20 2014-01-07 19:05:51 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:05:51 [] ? poll_select_set_timeout+0x8d/0xa0 2014-01-07 19:05:51 [] sys_poll+0x71/0x100 2014-01-07 19:05:51 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:51 ffff880812e01ca8 0000000000000086 0000000000000000 ffffffff81119f27 2014-01-07 19:05:51 0000000000470000 ffff8810303ec3e0 ffff880812e01ca8 ffffffff811436a9 2014-01-07 19:05:51 ffff8808343105f8 ffff880812e01fd8 000000000000fb88 ffff8808343105f8 2014-01-07 19:05:51 Call Trace: 2014-01-07 19:05:51 [] ? unlock_page+0x27/0x30 2014-01-07 19:05:51 [] ? __do_fault+0x469/0x530 2014-01-07 19:05:51 [] pipe_wait+0x5b/0x80 2014-01-07 19:05:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:05:52 [] pipe_read+0x3e6/0x4e0 2014-01-07 19:05:52 [] do_sync_read+0xfa/0x140 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? vfs_ioctl+0x22/0xa0 2014-01-07 19:05:52 [] ? do_vfs_ioctl+0x84/0x580 2014-01-07 19:05:52 [] ? security_file_permission+0x16/0x20 2014-01-07 19:05:52 [] vfs_read+0xb5/0x1a0 2014-01-07 19:05:52 [] sys_read+0x51/0x90 2014-01-07 19:05:52 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:52 ffff880818457e30 0000000000000046 0000000000000000 ffff880828859d80 2014-01-07 19:05:52 ffff880818457e30 ffffffffa03141fc ffff880000002711 000000015bf5d9ff 2014-01-07 19:05:52 ffff880818649ab8 ffff880818457fd8 000000000000fb88 ffff880818649ab8 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880812dd9e30 0000000000000046 0000000000000000 ffff880812dd9df4 2014-01-07 19:05:52 ffff880800000000 ffff88083fe81200 ffff880044616740 000000000000015a 2014-01-07 19:05:52 ffff880831a37058 ffff880812dd9fd8 000000000000fb88 ffff880831a37058 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880832535e30 0000000000000046 0000000000011400 ffff88082888c4c0 2014-01-07 19:05:52 ffff880832535e30 ffffffffa03141fc ffff8800001e8573 000000016554a85a 2014-01-07 19:05:52 ffff880831a37ab8 ffff880832535fd8 000000000000fb88 ffff880831a37ab8 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880832533e30 0000000000000046 0000000000000000 ffff880832533df4 2014-01-07 19:05:52 ffff880800000000 ffff88083fe81600 ffff880044616740 000000000000015a 2014-01-07 19:05:52 ffff880832501058 ffff880832533fd8 000000000000fb88 ffff880832501058 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880810f27e30 0000000000000046 0000000000011400 ffff88083280a480 2014-01-07 19:05:52 ffff880810f27e30 ffffffffa03141fc ffff8800001e8416 000000015fafabf6 2014-01-07 19:05:52 ffff880833ce7098 ffff880810f27fd8 000000000000fb88 ffff880833ce7098 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff8808186d5e30 0000000000000046 0000000000011400 ffff88082888c0c0 2014-01-07 19:05:52 ffff8808186d5e30 ffffffffa03141fc ffff8800000f42a5 00000001604ba24c 2014-01-07 19:05:52 ffff8808334f85f8 ffff8808186d5fd8 000000000000fb88 ffff8808334f85f8 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff88081813fe30 0000000000000046 0000000000011400 ffff8808288016c0 2014-01-07 19:05:52 ffff88081813fe30 ffffffffa03141fc ffff8800001e8479 00000001660d3420 2014-01-07 19:05:52 ffff88081878d098 ffff88081813ffd8 000000000000fb88 ffff88081878d098 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff8808184dbe30 0000000000000046 0000000000011400 ffff8808288013c0 2014-01-07 19:05:52 ffff8808184dbe30 ffffffffa03141fc ffff8800001e8480 000000016aa55181 2014-01-07 19:05:52 ffff880829299ab8 ffff8808184dbfd8 000000000000fb88 ffff880829299ab8 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880831217e30 0000000000000046 ffff880831217df8 ffff880831217df4 2014-01-07 19:05:52 ffff880831217e30 ffff88083fe82000 ffff880044616740 0000000000000406 2014-01-07 19:05:52 ffff8808319dc638 ffff880831217fd8 000000000000fb88 ffff8808319dc638 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff8808328cbe30 0000000000000046 ffff8808328cbdf8 ffff8808328cbdf4 2014-01-07 19:05:52 ffff8808328cbe30 ffff88083fe82200 ffff880044616740 0000000000000406 2014-01-07 19:05:52 ffff8808335e7058 ffff8808328cbfd8 000000000000fb88 ffff8808335e7058 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880831207e30 0000000000000046 0000000000011400 ffff880831132180 2014-01-07 19:05:52 ffff880831207e30 ffffffffa03141fc ffff880000085c04 0000000169cd97bc 2014-01-07 19:05:52 ffff8808185c1ab8 ffff880831207fd8 000000000000fb88 ffff8808185c1ab8 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880817863e30 0000000000000046 0000000000011400 ffff880833e3f3c0 2014-01-07 19:05:52 ffff880817863e30 ffffffffa03141fc ffff8800001e848a 000000016d732783 2014-01-07 19:05:52 ffff880834311058 ffff880817863fd8 000000000000fb88 ffff880834311058 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x27c/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff880818005e30 0000000000000046 ffff880818005df8 ffff880818005df4 2014-01-07 19:05:52 ffff880818005e30 ffff88083fe82800 ffff880044616740 0000000000000406 2014-01-07 19:05:52 ffff880831dc9098 ffff880818005fd8 000000000000fb88 ffff880831dc9098 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff8808186c1e30 0000000000000046 ffff8808186c1df8 ffff8808186c1df4 2014-01-07 19:05:52 ffff8808186c1e30 ffff88083fe82a00 ffff880044616740 0000000000000406 2014-01-07 19:05:52 ffff880831923af8 ffff8808186c1fd8 000000000000fb88 ffff880831923af8 2014-01-07 19:05:52 Call Trace: 2014-01-07 19:05:52 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:52 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:52 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:52 [] kthread+0x96/0xa0 2014-01-07 19:05:52 [] child_rip+0xa/0x20 2014-01-07 19:05:52 [] ? kthread+0x0/0xa0 2014-01-07 19:05:52 [] ? child_rip+0x0/0x20 2014-01-07 19:05:52 ffff8808187d7e30 0000000000000046 ffff8808187d7df8 ffff8808187d7df4 2014-01-07 19:05:53 ffff8808187d7e30 ffff88083fe82c00 ffff880044616740 0000000000000406 2014-01-07 19:05:53 ffff880833584638 ffff8808187d7fd8 000000000000fb88 ffff880833584638 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:53 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:53 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:53 [] kthread+0x96/0xa0 2014-01-07 19:05:53 [] child_rip+0xa/0x20 2014-01-07 19:05:53 [] ? kthread+0x0/0xa0 2014-01-07 19:05:53 [] ? child_rip+0x0/0x20 2014-01-07 19:05:53 ffff88083238be30 0000000000000046 ffff88083238bdf8 ffff88083238bdf4 2014-01-07 19:05:53 ffff88083238be30 ffff88083fe82e00 ffff880044616740 0000000000000406 2014-01-07 19:05:53 ffff88081875c5f8 ffff88083238bfd8 000000000000fb88 ffff88081875c5f8 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand] 2014-01-07 19:05:53 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:53 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:53 [] kthread+0x96/0xa0 2014-01-07 19:05:53 [] child_rip+0xa/0x20 2014-01-07 19:05:53 [] ? kthread+0x0/0xa0 2014-01-07 19:05:53 [] ? child_rip+0x0/0x20 2014-01-07 19:05:53 ffff880833e9be68 0000000000000086 0000000000000000 ffff880833e9be2c 2014-01-07 19:05:53 ffff880800000000 ffff88083fe81600 ffff880044616740 000000000000015a 2014-01-07 19:05:53 ffff88081828a5f8 ffff880833e9bfd8 000000000000fb88 ffff88081828a5f8 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] do_nanosleep+0x8b/0xc0 2014-01-07 19:05:53 [] hrtimer_nanosleep+0xc4/0x180 2014-01-07 19:05:53 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:53 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:53 [] sys_nanosleep+0x74/0x80 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff881031e83a58 0000000000000082 0000000000000000 ffffffff8109bc05 2014-01-07 19:05:53 0000000000000001 0000000100000286 ffff881031e839f8 ffffffff8109b2c1 2014-01-07 19:05:53 ffff88103191a638 ffff881031e83fd8 000000000000fb88 ffff88103191a638 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:05:53 [] ? lock_hrtimer_base+0x31/0x60 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0xc8/0x160 2014-01-07 19:05:53 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:53 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:53 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:53 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:53 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? fsnotify_clear_marks_by_inode+0x32/0xf0 2014-01-07 19:05:53 [] ? sock_destroy_inode+0x19/0x20 2014-01-07 19:05:53 [] ? __d_free+0x3f/0x60 2014-01-07 19:05:53 [] ? d_free+0x58/0x60 2014-01-07 19:05:53 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:53 [] ? read_tsc+0x9/0x20 2014-01-07 19:05:53 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:05:53 [] ? poll_select_set_timeout+0x8d/0xa0 2014-01-07 19:05:53 [] sys_poll+0x71/0x100 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff8810318f9908 0000000000000082 0000000000000000 ffffffff813a1a35 2014-01-07 19:05:53 0000000000000034 0000000000000042 0000000000000000 ffff880816fdb580 2014-01-07 19:05:53 ffff881030151058 ffff8810318f9fd8 000000000000fb88 ffff881030151058 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? loopback_xmit+0x75/0xa0 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:53 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:53 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:53 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:53 [] do_select+0x57c/0x6c0 2014-01-07 19:05:53 [] ? udp_send_skb+0x119/0x3d0 2014-01-07 19:05:53 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? dput+0x9a/0x150 2014-01-07 19:05:53 [] ? path_to_nameidata+0x25/0x60 2014-01-07 19:05:53 [] ? __link_path_walk+0x768/0x1030 2014-01-07 19:05:53 [] ? handle_pte_fault+0x2cd/0xb50 2014-01-07 19:05:53 [] ? move_addr_to_kernel+0x64/0x70 2014-01-07 19:05:53 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:05:53 [] ? cp_new_stat+0xe4/0x100 2014-01-07 19:05:53 [] sys_select+0x47/0x110 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff880810f2dda8 0000000000000086 0000000000000000 ffffffff81096da0 2014-01-07 19:05:53 ffff880810f2dd08 ffff880810f2dd08 ffff880810f2dd68 ffff880810f2dd88 2014-01-07 19:05:53 ffff88081828b058 ffff880810f2dfd8 000000000000fb88 ffff88081828b058 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:53 [] ? ep_scan_ready_list+0x194/0x1a0 2014-01-07 19:05:53 [] ep_poll+0x2ad/0x330 2014-01-07 19:05:53 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:53 [] sys_epoll_wait+0xc5/0xe0 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff880812ee5a58 0000000000000086 0000000000000000 0000000000000003 2014-01-07 19:05:53 ffff880812ee59e8 ffffffff81055f96 ffff880812ee59f8 ffff8808342bf500 2014-01-07 19:05:53 ffff880833ff1ab8 ffff880812ee5fd8 000000000000fb88 ffff880833ff1ab8 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? enqueue_task+0x66/0x80 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:53 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:53 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:53 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:53 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:53 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:53 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? do_sync_readv_writev+0xfb/0x140 2014-01-07 19:05:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:53 [] ? do_readv_writev+0x169/0x1f0 2014-01-07 19:05:53 [] ? __d_free+0x3f/0x60 2014-01-07 19:05:53 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:53 [] ? __fput+0x1a1/0x210 2014-01-07 19:05:53 [] sys_poll+0x71/0x100 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff880812f27a58 0000000000000082 0000000000000000 ffffffff8109bc05 2014-01-07 19:05:53 ffff880800000001 0000000100000286 ffff880812f279f8 ffffffff8109b2c1 2014-01-07 19:05:53 ffff8808342bfab8 ffff880812f27fd8 000000000000fb88 ffff8808342bfab8 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:05:53 [] ? lock_hrtimer_base+0x31/0x60 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0xc8/0x160 2014-01-07 19:05:53 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:53 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:53 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:53 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:53 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? unmap_region+0x110/0x130 2014-01-07 19:05:53 [] ? read_tsc+0x9/0x20 2014-01-07 19:05:53 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:05:53 [] ? poll_select_set_timeout+0x8d/0xa0 2014-01-07 19:05:53 [] sys_poll+0x71/0x100 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff88102fa7ba58 0000000000000086 0000000000000000 ffff88085c4b15e8 2014-01-07 19:05:53 ffff88102fa7b9f8 ffffffff8109ad0b ffff88102fa7b9f8 ffffffff8109b2c1 2014-01-07 19:05:53 ffff88102f9e9058 ffff88102fa7bfd8 000000000000fb88 ffff88102f9e9058 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? __remove_hrtimer+0x3b/0xb0 2014-01-07 19:05:53 [] ? lock_hrtimer_base+0x31/0x60 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:53 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:53 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:53 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:53 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:53 [] ? proc_delete_inode+0x0/0x60 2014-01-07 19:05:53 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? sock_aio_write+0x19b/0x1c0 2014-01-07 19:05:53 [] ? sock_aio_write+0x0/0x1c0 2014-01-07 19:05:53 [] ? do_sync_readv_writev+0xfb/0x140 2014-01-07 19:05:53 [] ? d_hash_and_lookup+0x83/0xb0 2014-01-07 19:05:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:53 [] ? call_rcu+0xe/0x10 2014-01-07 19:05:53 [] ? release_task+0x33f/0x4b0 2014-01-07 19:05:53 [] ? do_readv_writev+0x169/0x1f0 2014-01-07 19:05:53 [] ? do_wait+0x17f/0x240 2014-01-07 19:05:53 [] sys_poll+0x71/0x100 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff880812f47a58 0000000000000086 0000000000000000 0000000000000003 2014-01-07 19:05:53 ffff880812f479e8 ffffffff81055f96 ffff880812f479f8 ffff8808342bf500 2014-01-07 19:05:53 ffff8808182d9058 ffff880812f47fd8 000000000000fb88 ffff8808182d9058 2014-01-07 19:05:53 Call Trace: 2014-01-07 19:05:53 [] ? enqueue_task+0x66/0x80 2014-01-07 19:05:53 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:53 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:53 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:53 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:53 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:53 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? pollwake+0x0/0x60 2014-01-07 19:05:53 [] ? sock_aio_write+0x0/0x1c0 2014-01-07 19:05:53 [] ? do_sync_readv_writev+0xfb/0x140 2014-01-07 19:05:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:53 [] ? do_filp_open+0x6ea/0xdc0 2014-01-07 19:05:53 [] ? do_readv_writev+0x169/0x1f0 2014-01-07 19:05:53 [] sys_poll+0x71/0x100 2014-01-07 19:05:53 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:53 ffff880812edbe68 0000000000000082 0000000000000000 ffff880812edbe2c 2014-01-07 19:05:54 ffff880800000000 ffff88083fe81600 ffff880044616740 000000000000015a 2014-01-07 19:05:54 ffff8808292305f8 ffff880812edbfd8 000000000000fb88 ffff8808292305f8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] do_nanosleep+0x8b/0xc0 2014-01-07 19:05:54 [] hrtimer_nanosleep+0xc4/0x180 2014-01-07 19:05:54 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:54 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:54 [] sys_nanosleep+0x74/0x80 2014-01-07 19:05:54 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:54 ffff88103129bc98 0000000000000082 0000000000000000 ffffffff810573c5 2014-01-07 19:05:54 0000000000000000 0000000a00000008 0000001044696740 ffff88081788caa0 2014-01-07 19:05:54 ffff8810301c6638 ffff88103129bfd8 000000000000fb88 ffff8810301c6638 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? select_idle_sibling+0x95/0x150 2014-01-07 19:05:54 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:05:54 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:54 [] ? enqueue_task+0x66/0x80 2014-01-07 19:05:54 [] __skb_recv_datagram+0x237/0x290 2014-01-07 19:05:54 [] ? receiver_wake_function+0x0/0x20 2014-01-07 19:05:54 [] skb_recv_datagram+0x24/0x30 2014-01-07 19:05:54 [] unix_accept+0x74/0x130 2014-01-07 19:05:54 [] sys_accept4+0x155/0x2b0 2014-01-07 19:05:54 [] ? sys_futex+0x7b/0x170 2014-01-07 19:05:54 [] ? security_file_fcntl+0x16/0x20 2014-01-07 19:05:54 [] sys_accept+0x10/0x20 2014-01-07 19:05:54 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:54 ffff880812f59bf8 0000000000000082 ffff880812f59be8 ffffffff8109bc05 2014-01-07 19:05:54 0000000000000009 000000013fe82200 ffff880044616740 0000000000000207 2014-01-07 19:05:54 ffff8808325745f8 ffff880812f59fd8 000000000000fb88 ffff8808325745f8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:05:54 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:54 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:54 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:54 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:54 [] do_futex+0x121/0xb60 2014-01-07 19:05:54 [] ? __wake_up+0x53/0x70 2014-01-07 19:05:54 [] ? rcu_start_gp+0x1be/0x230 2014-01-07 19:05:54 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:54 [] sys_futex+0x7b/0x170 2014-01-07 19:05:54 [] ? __fput+0x1e0/0x210 2014-01-07 19:05:54 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:54 ffff880812f5bbf8 0000000000000082 0000000000000000 ffffffff81439c14 2014-01-07 19:05:54 ffff880812f5bc48 0000000000000068 ffff880812f5bc28 ffffffff814dd379 2014-01-07 19:05:54 ffff880831e47098 ffff880812f5bfd8 000000000000fb88 ffff880831e47098 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? sock_def_readable+0x44/0x80 2014-01-07 19:05:54 [] ? unix_stream_sendmsg+0x249/0x420 2014-01-07 19:05:54 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:54 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] do_futex+0x121/0xb60 2014-01-07 19:05:54 [] ? sock_destroy_inode+0x19/0x20 2014-01-07 19:05:54 [] ? __d_free+0x3f/0x60 2014-01-07 19:05:54 [] ? d_free+0x58/0x60 2014-01-07 19:05:54 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:54 [] sys_futex+0x7b/0x170 2014-01-07 19:05:54 [] ? fput+0x25/0x30 2014-01-07 19:05:54 [] ? filp_close+0x5d/0x90 2014-01-07 19:05:54 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:54 ffff880812f75bf8 0000000000000082 0000000000000000 ffffffff81439c14 2014-01-07 19:05:54 ffff880812f75c48 0000000000000060 ffff880812f75c28 ffffffff814dd379 2014-01-07 19:05:54 ffff88081788d058 ffff880812f75fd8 000000000000fb88 ffff88081788d058 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? sock_def_readable+0x44/0x80 2014-01-07 19:05:54 [] ? unix_stream_sendmsg+0x249/0x420 2014-01-07 19:05:54 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:54 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:54 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:54 [] ? pollwake+0x56/0x60 2014-01-07 19:05:54 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:54 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:05:54 [] do_futex+0x121/0xb60 2014-01-07 19:05:54 [] ? sock_destroy_inode+0x19/0x20 2014-01-07 19:05:54 [] ? __d_free+0x3f/0x60 2014-01-07 19:05:54 [] ? d_free+0x58/0x60 2014-01-07 19:05:54 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:54 [] sys_futex+0x7b/0x170 2014-01-07 19:05:54 [] ? fput+0x25/0x30 2014-01-07 19:05:54 [] ? filp_close+0x5d/0x90 2014-01-07 19:05:54 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:54 ffff880831d67e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808325eb058 ffff880831d67fd8 000000000000fb88 ffff8808325eb058 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880810f19e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff880833cf1ab8 ffff880810f19fd8 000000000000fb88 ffff880833cf1ab8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff8808182f9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808185c05f8 ffff8808182f9fd8 000000000000fb88 ffff8808185c05f8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff88083191be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808185c1058 ffff88083191bfd8 000000000000fb88 ffff8808185c1058 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880812f1be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808342f65f8 ffff880812f1bfd8 000000000000fb88 ffff8808342f65f8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880812f0be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808334ec638 ffff880812f0bfd8 000000000000fb88 ffff8808334ec638 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880812f0de30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808180efaf8 ffff880812f0dfd8 000000000000fb88 ffff8808180efaf8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880812f0fe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff880818328638 ffff880812f0ffd8 000000000000fb88 ffff880818328638 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880812f05e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff8808182d85f8 ffff880812f05fd8 000000000000fb88 ffff8808182d85f8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:54 [] ? kthread+0x0/0xa0 2014-01-07 19:05:54 [] ? child_rip+0x0/0x20 2014-01-07 19:05:54 ffff880812f07e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:54 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:54 ffff88081856faf8 ffff880812f07fd8 000000000000fb88 ffff88081856faf8 2014-01-07 19:05:54 Call Trace: 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:54 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:54 [] kthread+0x96/0xa0 2014-01-07 19:05:54 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812f29e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:55 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:55 ffff88081840b098 ffff880812f29fd8 000000000000fb88 ffff88081840b098 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812f2be30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:55 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:55 ffff8808186f1058 ffff880812f2bfd8 000000000000fb88 ffff8808186f1058 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812f2de30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:55 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:55 ffff880833cd1af8 ffff880812f2dfd8 000000000000fb88 ffff880833cd1af8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812f2fe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:55 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:55 ffff8808335d1058 ffff880812f2ffd8 000000000000fb88 ffff8808335d1058 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812ea9e30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:55 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:55 ffff880833fc5ab8 ffff880812ea9fd8 000000000000fb88 ffff880833fc5ab8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812eabe30 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:05:55 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:55 ffff8808343efab8 ffff880812eabfd8 000000000000fb88 ffff8808343efab8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:55 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880812fcfe90 0000000000000046 0000000000000000 ffff88085c436740 2014-01-07 19:05:55 0000000000000009 ffff88085c436740 0000000000000009 0000000000000001 2014-01-07 19:05:55 ffff8808334e3058 ffff880812fcffd8 000000000000fb88 ffff8808334e3058 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ib_fmr_cleanup_thread+0x7a/0xe0 [ib_core] 2014-01-07 19:05:55 [] ? ib_fmr_cleanup_thread+0x0/0xe0 [ib_core] 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880814fa7e90 0000000000000046 0000000000000000 ffff88085c436740 2014-01-07 19:05:55 0000000000000009 ffff88085c436740 0000000000000009 0000000000000001 2014-01-07 19:05:55 ffff88081878daf8 ffff880814fa7fd8 000000000000fb88 ffff88081878daf8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ib_fmr_cleanup_thread+0x7a/0xe0 [ib_core] 2014-01-07 19:05:55 [] ? ib_fmr_cleanup_thread+0x0/0xe0 [ib_core] 2014-01-07 19:05:55 [] kthread+0x96/0xa0 2014-01-07 19:05:55 [] child_rip+0xa/0x20 2014-01-07 19:05:55 [] ? kthread+0x0/0xa0 2014-01-07 19:05:55 [] ? child_rip+0x0/0x20 2014-01-07 19:05:55 ffff880831c41e68 0000000000000082 0000000000000000 ffff880831c41e2c 2014-01-07 19:05:55 ffff880800000000 ffff88083fe81200 ffff880044616740 000000000000015a 2014-01-07 19:05:55 ffff880818485098 ffff880831c41fd8 000000000000fb88 ffff880818485098 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? common_interrupt+0xe/0x13 2014-01-07 19:05:55 [] do_nanosleep+0x8b/0xc0 2014-01-07 19:05:55 [] hrtimer_nanosleep+0xc4/0x180 2014-01-07 19:05:55 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:55 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:55 [] sys_nanosleep+0x74/0x80 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff880831a51bf8 0000000000000082 0000000000000000 ffffffff8109bc05 2014-01-07 19:05:55 ffff88080000000d 000000013fe82a00 ffff880044696740 00000000000005fe 2014-01-07 19:05:55 ffff880818081ab8 ffff880831a51fd8 000000000000fb88 ffff880818081ab8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:55 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff8808329d3bf8 0000000000000082 0000000000000000 ffff8808329d3bbc 2014-01-07 19:05:55 01ff880800000000 ffff88083fe82200 ffff880044616740 00000000000002af 2014-01-07 19:05:55 ffff8808327f85f8 ffff8808329d3fd8 000000000000fb88 ffff8808327f85f8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] ? math_state_restore+0x45/0x60 2014-01-07 19:05:55 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff880810f2bbf8 0000000000000082 0000000000000000 ffff880810f2bbbc 2014-01-07 19:05:55 01ff880000019e40 ffff88083fe81200 ffff880044616740 0000000000000207 2014-01-07 19:05:55 ffff8808319ae638 ffff880810f2bfd8 000000000000fb88 ffff8808319ae638 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] ? math_state_restore+0x45/0x60 2014-01-07 19:05:55 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff8808312cdbf8 0000000000000082 0000000000000000 ffff88083155f9f0 2014-01-07 19:05:55 0000000000000008 ffff88083155fa78 0000000000000001 0000000000000000 2014-01-07 19:05:55 ffff880834395098 ffff8808312cdfd8 000000000000fb88 ffff880834395098 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] ? math_state_restore+0x45/0x60 2014-01-07 19:05:55 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff880818309bf8 0000000000000082 0000000000000000 ffff880818309bbc 2014-01-07 19:05:55 01ff880800000000 ffff88083fe82200 ffff880044616740 0000000000000407 2014-01-07 19:05:55 ffff8808326d9ab8 ffff880818309fd8 000000000000fb88 ffff8808326d9ab8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff880812ed9bf8 0000000000000082 0000000000000000 ffff880812ed9bbc 2014-01-07 19:05:55 ffff880812ed9b78 ffff88083fe81600 ffff880044696740 0000000000000400 2014-01-07 19:05:55 ffff880828855098 ffff880812ed9fd8 000000000000fb88 ffff880828855098 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff88083264bbf8 0000000000000082 0000000000000000 ffff88083264bbbc 2014-01-07 19:05:55 ffff880800000000 ffff88083fe81400 ffff8800446b6740 0000000000000207 2014-01-07 19:05:55 ffff880817965af8 ffff88083264bfd8 000000000000fb88 ffff880817965af8 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:55 [] do_futex+0x121/0xb60 2014-01-07 19:05:55 [] sys_futex+0x7b/0x170 2014-01-07 19:05:55 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:55 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:55 ffff8808321c9bf8 0000000000000082 0000000000000000 ffffffff8112bc13 2014-01-07 19:05:55 ffff8808321c9b78 ffffffff81277ab9 0000000000016740 ffff88085c4101f0 2014-01-07 19:05:55 ffff880817964638 ffff8808321c9fd8 000000000000fb88 ffff880817964638 2014-01-07 19:05:55 Call Trace: 2014-01-07 19:05:55 [] ? __alloc_pages_nodemask+0x113/0x8d0 2014-01-07 19:05:55 [] ? cpumask_next_and+0x29/0x50 2014-01-07 19:05:55 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:55 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:55 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880818163bf8 0000000000000082 0000000000000000 ffff880818163bbc 2014-01-07 19:05:56 0000000000000000 ffff88083fe82000 ffff88085c436740 0000000000000400 2014-01-07 19:05:56 ffff880818379098 ffff880818163fd8 000000000000fb88 ffff880818379098 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880810f17bf8 0000000000000082 0000000000000000 ffff88083155f9f0 2014-01-07 19:05:56 0000000000000008 ffff88083155fa78 000000000000000a 0000000000000000 2014-01-07 19:05:56 ffff880818378638 ffff880810f17fd8 000000000000fb88 ffff880818378638 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880832921bf8 0000000000000082 0000000000000000 ffff880832921bbc 2014-01-07 19:05:56 0000000000000dc0 ffff88083fe82400 ffff88085c436740 00000000000002af 2014-01-07 19:05:56 ffff880832781058 ffff880832921fd8 000000000000fb88 ffff880832781058 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff88083261dbf8 0000000000000082 0000000000000000 ffff88083155f9f0 2014-01-07 19:05:56 0000000000000008 ffff88083155fa78 0000000000000006 0000000000000000 2014-01-07 19:05:56 ffff8808327805f8 ffff88083261dfd8 000000000000fb88 ffff8808327805f8 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff8808293bfbf8 0000000000000082 0000000000000000 ffff88083155f9f0 2014-01-07 19:05:56 0000000000000008 ffff88083155fa78 000000000000000b 0000000000000000 2014-01-07 19:05:56 ffff88082d631098 ffff8808293bffd8 000000000000fb88 ffff88082d631098 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880831a3bbf8 0000000000000082 0000000000000000 ffff880831a3bbbc 2014-01-07 19:05:56 0000000000000000 ffff88083fe81000 ffff88085c436740 0000000000000400 2014-01-07 19:05:56 ffff88082d630638 ffff880831a3bfd8 000000000000fb88 ffff88082d630638 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880831cf5bf8 0000000000000082 ffff880831cf5bc0 ffff880831cf5bbc 2014-01-07 19:05:56 0000000000000000 ffff88083fe81000 ffff880044696740 0000000000000207 2014-01-07 19:05:56 ffff8808310e3af8 ffff880831cf5fd8 000000000000fb88 ffff8808310e3af8 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880816c07bf8 0000000000000082 0000000000000000 ffffffff8112bc13 2014-01-07 19:05:56 01ff880840010dc0 0000000000000000 ffff880816c07ba8 ffffffff81065a05 2014-01-07 19:05:56 ffff880833cc7058 ffff880816c07fd8 000000000000fb88 ffff880833cc7058 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] ? __alloc_pages_nodemask+0x113/0x8d0 2014-01-07 19:05:56 [] ? enqueue_entity+0x125/0x410 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] ? thread_return+0x4e/0x76e 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff8808292f5bf8 0000000000000082 0000000000000000 ffff8808292f5bbc 2014-01-07 19:05:56 0000000000000000 ffff88083fe81800 ffff88085c436740 0000000000000200 2014-01-07 19:05:56 ffff8808335d05f8 ffff8808292f5fd8 000000000000fb88 ffff8808335d05f8 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff88083246fbf8 0000000000000082 0000000000000000 ffff88083249f1f0 2014-01-07 19:05:56 0000000000000008 ffff88083249f278 0000000000000037 0000000000000000 2014-01-07 19:05:56 ffff8808334d8638 ffff88083246ffd8 000000000000fb88 ffff8808334d8638 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] ? ib_umad_write+0x5d4/0x620 [ib_umad] 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880831bf3bf8 0000000000000082 0000000000000000 ffff880829376800 2014-01-07 19:05:56 ffff880831bf3b88 ffff880834a7d980 ffff880831bf3b88 ffff88082779ec00 2014-01-07 19:05:56 ffff880833cf05f8 ffff880831bf3fd8 000000000000fb88 ffff880833cf05f8 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? security_inode_permission+0x1f/0x30 2014-01-07 19:05:56 [] ? call_rcu+0xe/0x10 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] ? sys_renameat+0xb9/0x240 2014-01-07 19:05:56 [] ? destroy_inode+0x2f/0x60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880818725bf8 0000000000000082 0000000000000000 0000000000000000 2014-01-07 19:05:56 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:56 ffff880833eb6638 ffff880818725fd8 000000000000fb88 ffff880833eb6638 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff880831c49a58 0000000000000082 0000000000000000 ffff880831c49a1c 2014-01-07 19:05:56 0000000000000000 ffff88083fe81400 ffff88085c436740 00000000000009fd 2014-01-07 19:05:56 ffff880833cfd098 ffff880831c49fd8 000000000000fb88 ffff880833cfd098 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:56 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:56 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:56 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:56 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:56 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:56 [] ? pollwake+0x0/0x60 2014-01-07 19:05:56 [] ? enqueue_entity+0x125/0x410 2014-01-07 19:05:56 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:56 [] ? enqueue_task+0x66/0x80 2014-01-07 19:05:56 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] ? wake_up_state+0x10/0x20 2014-01-07 19:05:56 [] ? wake_futex+0x40/0x60 2014-01-07 19:05:56 [] ? do_futex+0x6b2/0xb60 2014-01-07 19:05:56 [] ? sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] sys_poll+0x71/0x100 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff8808288efe68 0000000000000082 0000000000000000 ffff8808288efe2c 2014-01-07 19:05:56 0000000000000000 ffff88083fe81400 ffff880044616740 000000000000015a 2014-01-07 19:05:56 ffff880831e47af8 ffff8808288effd8 000000000000fb88 ffff880831e47af8 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] do_nanosleep+0x8b/0xc0 2014-01-07 19:05:56 [] hrtimer_nanosleep+0xc4/0x180 2014-01-07 19:05:56 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:56 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:56 [] sys_nanosleep+0x74/0x80 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff881030b49bf8 0000000000000082 0000000000000000 ffffffff8109bc05 2014-01-07 19:05:56 ffff881000000000 000000013fe81000 ffff8800446b6740 00000000000002af 2014-01-07 19:05:56 ffff8810301c7098 ffff881030b49fd8 000000000000fb88 ffff8810301c7098 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:56 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:56 ffff88103187dbf8 0000000000000082 0000000000000000 ffff88103187dbbc 2014-01-07 19:05:56 01ff880000000000 ffff88083fe81000 ffff88085c416740 0000000000000400 2014-01-07 19:05:56 ffff8810301c7af8 ffff88103187dfd8 000000000000fb88 ffff8810301c7af8 2014-01-07 19:05:56 Call Trace: 2014-01-07 19:05:56 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:56 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:56 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:56 [] do_futex+0x121/0xb60 2014-01-07 19:05:56 [] sys_futex+0x7b/0x170 2014-01-07 19:05:56 [] ? math_state_restore+0x45/0x60 2014-01-07 19:05:56 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff88102f917bf8 0000000000000082 0000000000000000 ffffffff8112bc13 2014-01-07 19:05:57 01ff880840010dc0 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:57 ffff88102f9e9ab8 ffff88102f917fd8 000000000000fb88 ffff88102f9e9ab8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] ? __alloc_pages_nodemask+0x113/0x8d0 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? math_state_restore+0x45/0x60 2014-01-07 19:05:57 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff881031cf3bf8 0000000000000082 0000000000000000 ffff881031cf3bbc 2014-01-07 19:05:57 01ff880000000000 ffff88083fe82200 ffff88085c4b6740 0000000000000400 2014-01-07 19:05:57 ffff88103191b098 ffff881031cf3fd8 000000000000fb88 ffff88103191b098 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? math_state_restore+0x45/0x60 2014-01-07 19:05:57 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810321c3bf8 0000000000000082 0000000000000000 ffff8810321c3bbc 2014-01-07 19:05:57 01ff880840010dc0 ffff88083fe82200 ffff88085c416740 0000000000000400 2014-01-07 19:05:57 ffff88103191baf8 ffff8810321c3fd8 000000000000fb88 ffff88103191baf8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810342d3bf8 0000000000000082 0000000000000000 ffff88103fc09940 2014-01-07 19:05:57 01ff8810342d3bc8 ffffffff811675ab 0000000000000000 0000000100000000 2014-01-07 19:05:57 ffff8810303f3058 ffff8810342d3fd8 000000000000fb88 ffff8810303f3058 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] ? cache_alloc_refill+0x15b/0x240 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff881030303bf8 0000000000000082 0000000000000000 ffff881030303bbc 2014-01-07 19:05:57 0000000000000008 ffff88083fe81200 ffff880044656740 0000000000000400 2014-01-07 19:05:57 ffff8810303f25f8 ffff881030303fd8 000000000000fb88 ffff8810303f25f8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810301c9bf8 0000000000000082 0000000000000000 000000d08112bc13 2014-01-07 19:05:57 ffff8810301c8000 0000000000013200 0000000000000000 00000000000200da 2014-01-07 19:05:57 ffff881035d845f8 ffff8810301c9fd8 000000000000fb88 ffff881035d845f8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff88102f291bf8 0000000000000082 0000000000000000 0000000000019e40 2014-01-07 19:05:57 0000000000009e40 0000000000000046 0000000000000002 ffff880827d5aa30 2014-01-07 19:05:57 ffff881035d85058 ffff88102f291fd8 000000000000fb88 ffff881035d85058 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff88102fa4dbf8 0000000000000082 0000000000000000 ffff880827d5a9f0 2014-01-07 19:05:57 0000000000000008 ffff880827d5aa78 000000000000000a 0000000000000000 2014-01-07 19:05:57 ffff8810341d5098 ffff88102fa4dfd8 000000000000fb88 ffff8810341d5098 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff88102f295bf8 0000000000000082 0000000000000000 ffff880827d5a9f0 2014-01-07 19:05:57 0000000000000008 ffff880827d5aa78 0000000000000006 0000000000000000 2014-01-07 19:05:57 ffff8810341d5af8 ffff88102f295fd8 000000000000fb88 ffff8810341d5af8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810333fbbf8 0000000000000082 0000000000000000 ffff8810333fbbbc 2014-01-07 19:05:57 0000000000000000 ffff88083fe81200 ffff880044696740 0000000000000400 2014-01-07 19:05:57 ffff881030151ab8 ffff8810333fbfd8 000000000000fb88 ffff881030151ab8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810313bbbf8 0000000000000082 0000000000000000 ffff880827d5a9f0 2014-01-07 19:05:57 0000000000000008 ffff880827d5aa78 000000000000000d 0000000000000000 2014-01-07 19:05:57 ffff881031d2a638 ffff8810313bbfd8 000000000000fb88 ffff881031d2a638 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff88102e899bf8 0000000000000082 0000000000000000 ffff880827d5a9f0 2014-01-07 19:05:57 0000000000000008 ffff880827d5aa78 0000000000000012 0000000000000000 2014-01-07 19:05:57 ffff881031d2b098 ffff88102e899fd8 000000000000fb88 ffff881031d2b098 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810303b7bf8 0000000000000082 0000000000000000 000000008112bc13 2014-01-07 19:05:57 0000000000000dc0 0000000000000046 0000000000000000 ffff880827d5aa30 2014-01-07 19:05:57 ffff881034137ab8 ffff8810303b7fd8 000000000000fb88 ffff881034137ab8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810321b1bf8 0000000000000082 0000000000000000 ffff880827d5a9f0 2014-01-07 19:05:57 0000000000000008 ffff880827d5aa78 0000000000000017 0000000000000000 2014-01-07 19:05:57 ffff881034137058 ffff8810321b1fd8 000000000000fb88 ffff881034137058 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810333d5bf8 0000000000000082 0000000000000000 ffff8810333d5bbc 2014-01-07 19:05:57 01ff880000000000 ffff88083fe81000 ffff88085c416740 0000000000000400 2014-01-07 19:05:57 ffff8810341365f8 ffff8810333d5fd8 000000000000fb88 ffff8810341365f8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff88102f971bf8 0000000000000082 0000000000000000 ffff8808343255f0 2014-01-07 19:05:57 0000000000000008 ffff880834325678 0000000000000037 0000000000000000 2014-01-07 19:05:57 ffff881031c43af8 ffff88102f971fd8 000000000000fb88 ffff881031c43af8 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? futex_wake+0x10e/0x120 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] ? ib_umad_write+0x5d4/0x620 [ib_umad] 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] ? sys_write+0x7c/0x90 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:57 ffff8810323f3bf8 0000000000000082 ffff8810323f3b98 ffff880829376800 2014-01-07 19:05:57 ffff8810323f3b88 ffff880834a7d980 ffff8810323f3b88 ffff88082779ec00 2014-01-07 19:05:57 ffff881031c43098 ffff8810323f3fd8 000000000000fb88 ffff881031c43098 2014-01-07 19:05:57 Call Trace: 2014-01-07 19:05:57 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:57 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:57 [] ? security_inode_permission+0x1f/0x30 2014-01-07 19:05:57 [] ? call_rcu+0xe/0x10 2014-01-07 19:05:57 [] do_futex+0x121/0xb60 2014-01-07 19:05:57 [] ? sys_renameat+0xb9/0x240 2014-01-07 19:05:57 [] ? destroy_inode+0x2f/0x60 2014-01-07 19:05:57 [] sys_futex+0x7b/0x170 2014-01-07 19:05:57 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff881033129bf8 0000000000000082 0000000000000000 0000000000004d9b 2014-01-07 19:05:58 ffff881033129b78 ffffffff81277ab9 0000000000016740 ffff8800446901f0 2014-01-07 19:05:58 ffff881031c42638 ffff881033129fd8 000000000000fb88 ffff881031c42638 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ? cpumask_next_and+0x29/0x50 2014-01-07 19:05:58 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:58 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:58 [] ? perf_event_task_sched_out+0x33/0x80 2014-01-07 19:05:58 [] do_futex+0x121/0xb60 2014-01-07 19:05:58 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:05:58 [] ? switch_task_namespaces+0x24/0x60 2014-01-07 19:05:58 [] sys_futex+0x7b/0x170 2014-01-07 19:05:58 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff8808327d3a58 0000000000000082 0000000000000000 ffff8808327d3a1c 2014-01-07 19:05:58 ffff880000000000 ffff88083fe81200 ffff88085c416740 0000000000000400 2014-01-07 19:05:58 ffff8808343bbab8 ffff8808327d3fd8 000000000000fb88 ffff8808343bbab8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:58 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:58 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:58 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:58 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:58 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:58 [] ? pollwake+0x0/0x60 2014-01-07 19:05:58 [] ? enqueue_entity+0x125/0x410 2014-01-07 19:05:58 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:05:58 [] ? enqueue_task+0x66/0x80 2014-01-07 19:05:58 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:05:58 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:58 [] ? wake_up_state+0x10/0x20 2014-01-07 19:05:58 [] ? wake_futex+0x40/0x60 2014-01-07 19:05:58 [] ? do_futex+0x6b2/0xb60 2014-01-07 19:05:58 [] ? sys_futex+0x7b/0x170 2014-01-07 19:05:58 [] sys_poll+0x71/0x100 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff88083111fbf8 0000000000000082 ffff88083111fbc0 ffff88083111fbbc 2014-01-07 19:05:58 ffff880816d12400 ffff88083fe81800 ffff8800446b6740 0000000000000400 2014-01-07 19:05:58 ffff880834283058 ffff88083111ffd8 000000000000fb88 ffff880834283058 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:58 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:58 [] ? sysfs_create_file+0x26/0x30 2014-01-07 19:05:58 [] ? scsi_scan_target+0xde/0xf0 2014-01-07 19:05:58 [] ? srp_create_target+0x332/0xe60 [ib_srp] 2014-01-07 19:05:58 [] do_futex+0x121/0xb60 2014-01-07 19:05:58 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:58 [] sys_futex+0x7b/0x170 2014-01-07 19:05:58 [] ? fput+0x25/0x30 2014-01-07 19:05:58 [] ? filp_close+0x5d/0x90 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff8808311d7e38 0000000000000082 0000000000000000 ffff8808183eeaa0 2014-01-07 19:05:58 ffff8808183eead8 0000000000000000 ffff8808311d7df8 ffffea0038a6a2e0 2014-01-07 19:05:58 ffff88081828bab8 ffff8808311d7fd8 000000000000fb88 ffff88081828bab8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:58 [] ib_uverbs_event_read+0x11d/0x240 [ib_uverbs] 2014-01-07 19:05:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:58 [] ? security_file_permission+0x16/0x20 2014-01-07 19:05:58 [] vfs_read+0xb5/0x1a0 2014-01-07 19:05:58 [] sys_read+0x51/0x90 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff8808311fde38 0000000000000082 0000000000000000 0000000000000000 2014-01-07 19:05:58 0000000000000000 0000000000000000 0000000000000000 ffffea0038a9c7a8 2014-01-07 19:05:58 ffff880833c45ab8 ffff8808311fdfd8 000000000000fb88 ffff880833c45ab8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ib_uverbs_event_read+0x11d/0x240 [ib_uverbs] 2014-01-07 19:05:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:58 [] ? security_file_permission+0x16/0x20 2014-01-07 19:05:58 [] vfs_read+0xb5/0x1a0 2014-01-07 19:05:58 [] sys_read+0x51/0x90 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff880832885bf8 0000000000000082 0000000000000000 0000000000061220 2014-01-07 19:05:58 ffff880832885b78 ffffffff81277ab9 0000000000016740 ffff8800446901f0 2014-01-07 19:05:58 ffff880833c445f8 ffff880832885fd8 000000000000fb88 ffff880833c445f8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ? cpumask_next_and+0x29/0x50 2014-01-07 19:05:58 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:58 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:58 [] ? perf_event_task_sched_out+0x33/0x80 2014-01-07 19:05:58 [] do_futex+0x121/0xb60 2014-01-07 19:05:58 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:05:58 [] ? __free_pages+0x60/0xa0 2014-01-07 19:05:58 [] ? free_pages+0x49/0x50 2014-01-07 19:05:58 [] sys_futex+0x7b/0x170 2014-01-07 19:05:58 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff880829369bf8 0000000000000082 0000000000000000 0000000600001000 2014-01-07 19:05:58 ffff880832650400 ffff8808291b498f ffff8808326fa138 ffff8808291b4990 2014-01-07 19:05:58 ffff8808183efab8 ffff880829369fd8 000000000000fb88 ffff8808183efab8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:58 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:58 [] ? sysfs_create_file+0x26/0x30 2014-01-07 19:05:58 [] ? scsi_scan_target+0xde/0xf0 2014-01-07 19:05:58 [] ? srp_create_target+0x332/0xe60 [ib_srp] 2014-01-07 19:05:58 [] do_futex+0x121/0xb60 2014-01-07 19:05:58 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:05:58 [] sys_futex+0x7b/0x170 2014-01-07 19:05:58 [] ? fput+0x25/0x30 2014-01-07 19:05:58 [] ? filp_close+0x5d/0x90 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff880831193e38 0000000000000082 0000000000000000 ffff8808183eeaa0 2014-01-07 19:05:58 ffff8808183eead8 0000000000000000 ffff880831193df8 ffffffff81064b00 2014-01-07 19:05:58 ffff880833fc5058 ffff880831193fd8 000000000000fb88 ffff880833fc5058 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ? pick_next_task_fair+0xd0/0x130 2014-01-07 19:05:58 [] ib_uverbs_event_read+0x11d/0x240 [ib_uverbs] 2014-01-07 19:05:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:58 [] ? security_file_permission+0x16/0x20 2014-01-07 19:05:58 [] vfs_read+0xb5/0x1a0 2014-01-07 19:05:58 [] sys_read+0x51/0x90 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff880832ad9e38 0000000000000082 0000000000000000 0000000000000000 2014-01-07 19:05:58 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:58 ffff880833fc45f8 ffff880832ad9fd8 000000000000fb88 ffff880833fc45f8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ib_uverbs_event_read+0x11d/0x240 [ib_uverbs] 2014-01-07 19:05:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:58 [] ? security_file_permission+0x16/0x20 2014-01-07 19:05:58 [] vfs_read+0xb5/0x1a0 2014-01-07 19:05:58 [] sys_read+0x51/0x90 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff88083420dbf8 0000000000000082 0000000000000000 0000000000000000 2014-01-07 19:05:58 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:58 ffff880831a41098 ffff88083420dfd8 000000000000fb88 ffff880831a41098 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] futex_wait_queue_me+0xb9/0xf0 2014-01-07 19:05:58 [] futex_wait+0x1f8/0x380 2014-01-07 19:05:58 [] do_futex+0x121/0xb60 2014-01-07 19:05:58 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:05:58 [] sys_futex+0x7b/0x170 2014-01-07 19:05:58 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff880827fe3908 0000000000000086 0000000000000000 ffff880840010dc0 2014-01-07 19:05:58 0000000000000002 0000000000000002 0000000000000003 ffff880840021b40 2014-01-07 19:05:58 ffff880827f5a5f8 ffff880827fe3fd8 000000000000fb88 ffff880827f5a5f8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:58 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:58 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:58 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:58 [] do_select+0x57c/0x6c0 2014-01-07 19:05:58 [] ? alloc_pages_vma+0x9a/0x150 2014-01-07 19:05:58 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:58 [] ? pollwake+0x0/0x60 2014-01-07 19:05:58 [] ? find_get_page+0x1e/0xa0 2014-01-07 19:05:58 [] ? filemap_fault+0xd3/0x500 2014-01-07 19:05:58 [] ? unlock_page+0x27/0x30 2014-01-07 19:05:58 [] ? __do_fault+0x469/0x530 2014-01-07 19:05:58 [] ? handle_pte_fault+0xf7/0xb50 2014-01-07 19:05:58 [] ? __pagevec_free+0x44/0x90 2014-01-07 19:05:58 [] ? page_remove_rmap+0x54/0xa0 2014-01-07 19:05:58 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:05:58 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:05:58 [] ? cpumask_any_but+0x31/0x50 2014-01-07 19:05:58 [] ? unmap_region+0x110/0x130 2014-01-07 19:05:58 [] sys_select+0x47/0x110 2014-01-07 19:05:58 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:05:58 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 0000000000000010 ffffffff8113b520 ffff880840010dc0 ffff8808344f8ec0 2014-01-07 19:05:58 0000000000000000 0000000000000002 ffff88000002abc0 ffff88081818e040 2014-01-07 19:05:58 00000000000084d0 ffff88081824bb20 ffffffff8112bc13 ffff880000019e40 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] ? zone_statistics+0x70/0xc0 2014-01-07 19:05:58 [] ? __alloc_pages_nodemask+0x113/0x8d0 2014-01-07 19:05:58 [] ? __alloc_pages_nodemask+0x113/0x8d0 2014-01-07 19:05:58 [] ? alloc_pages_current+0xaa/0x110 2014-01-07 19:05:58 [] ? pte_alloc_one+0x37/0x50 2014-01-07 19:05:58 [] ? __pte_alloc+0xab/0x160 2014-01-07 19:05:58 [] ? copy_pte_range+0x30e/0x4e0 2014-01-07 19:05:58 [] ? cache_alloc_refill+0x15b/0x240 2014-01-07 19:05:58 [] ? alloc_pid+0x301/0x460 2014-01-07 19:05:58 [] ? cgroup_fork_callbacks+0x35/0x50 2014-01-07 19:05:58 [] ? _write_lock_irq+0x1e/0x20 2014-01-07 19:05:58 [] ? copy_process+0xaf0/0x1450 2014-01-07 19:05:58 [] ? do_fork+0x94/0x460 2014-01-07 19:05:58 [] ? ipv6_setsockopt+0x6a/0xb0 [ipv6] 2014-01-07 19:05:58 [] ? sys_wait4+0xae/0x100 2014-01-07 19:05:58 [] ? sys_clone+0x28/0x30 2014-01-07 19:05:58 [] ? stub_clone+0x13/0x20 2014-01-07 19:05:58 [] ? system_call_fastpath+0x16/0x1b 2014-01-07 19:05:58 ffff880831b9f908 0000000000000082 0000000000000000 ffff880831b9f8cc 2014-01-07 19:05:58 0000001000000000 ffff88083fe81a00 ffff880044616740 000000000000015a 2014-01-07 19:05:58 ffff88081825daf8 ffff880831b9ffd8 000000000000fb88 ffff88081825daf8 2014-01-07 19:05:58 Call Trace: 2014-01-07 19:05:58 [] schedule_hrtimeout_range+0xc8/0x160 2014-01-07 19:05:58 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:05:58 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:05:58 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:58 [] do_select+0x57c/0x6c0 2014-01-07 19:05:59 [] ? cache_alloc_refill+0x15b/0x240 2014-01-07 19:05:59 [] ? put_cmsg+0xc0/0x100 2014-01-07 19:05:59 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:05:59 [] ? __sys_recvmsg+0x13c/0x2f0 2014-01-07 19:05:59 [] ? move_addr_to_user+0x93/0xb0 2014-01-07 19:05:59 [] ? sys_recvfrom+0xee/0x180 2014-01-07 19:05:59 [] ? read_tsc+0x9/0x20 2014-01-07 19:05:59 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:05:59 [] sys_select+0x47/0x110 2014-01-07 19:05:59 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:59 ffff8808184f1e40 0000000000000046 0000000000000000 ffffffff81057310 2014-01-07 19:05:59 ffff8808184f1db0 ffffffff81277b29 ffff8808184f1dd0 ffffffff81277b6a 2014-01-07 19:05:59 ffff8808311625f8 ffff8808184f1fd8 000000000000fb88 ffff8808311625f8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:59 [] ? __next_cpu+0x19/0x30 2014-01-07 19:05:59 [] ? __any_online_cpu+0x2a/0x50 2014-01-07 19:05:59 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff880832363e40 0000000000000046 0000000000000000 ffffffff81057310 2014-01-07 19:05:59 ffff880832363db0 ffffffff81277b29 ffff880832363dd0 ffffffff81277b6a 2014-01-07 19:05:59 ffff880831163058 ffff880832363fd8 000000000000fb88 ffff880831163058 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:59 [] ? __next_cpu+0x19/0x30 2014-01-07 19:05:59 [] ? __any_online_cpu+0x2a/0x50 2014-01-07 19:05:59 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff8808328c1e40 0000000000000046 0000000000000000 ffffffff81057310 2014-01-07 19:05:59 ffff8808328c1db0 ffffffff81277b29 ffff8808328c1dd0 ffffffff81277b6a 2014-01-07 19:05:59 ffff8808291b9af8 ffff8808328c1fd8 000000000000fb88 ffff8808291b9af8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:59 [] ? __next_cpu+0x19/0x30 2014-01-07 19:05:59 [] ? __any_online_cpu+0x2a/0x50 2014-01-07 19:05:59 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff88081805be40 0000000000000046 0000000000000000 ffffffff81057310 2014-01-07 19:05:59 ffff88081805bdb0 ffffffff81277b29 ffff88081805bdd0 ffffffff81277b6a 2014-01-07 19:05:59 ffff880831089058 ffff88081805bfd8 000000000000fb88 ffff880831089058 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:59 [] ? __next_cpu+0x19/0x30 2014-01-07 19:05:59 [] ? __any_online_cpu+0x2a/0x50 2014-01-07 19:05:59 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff8808178dde30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:05:59 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:05:59 ffff880818329af8 ffff8808178ddfd8 000000000000fb88 ffff880818329af8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:59 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:59 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff8808187bde30 0000000000000046 0000000000000000 ffff88085c4567a8 2014-01-07 19:05:59 ffff8808187bddb0 ffffffff81057310 ffff880818328b18 ffff88085c4567a8 2014-01-07 19:05:59 ffff880818329098 ffff8808187bdfd8 000000000000fb88 ffff880818329098 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:05:59 [] scsi_error_handler+0x96/0x6b0 2014-01-07 19:05:59 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:59 [] ? scsi_error_handler+0x0/0x6b0 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff88080ed01a08 0000000000000082 ffff88080ed019d0 ffff88080ed019cc 2014-01-07 19:05:59 0000000000000001 ffff88083fe81200 ffff880044616740 00000000000006e2 2014-01-07 19:05:59 ffff880833cd0638 ffff88080ed01fd8 000000000000fb88 ffff880833cd0638 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:59 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:59 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:59 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:59 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:59 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:59 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:59 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? sock_def_readable+0x44/0x80 2014-01-07 19:05:59 [] ? unix_dgram_sendmsg+0x5e3/0x6b0 2014-01-07 19:05:59 [] ? sock_sendmsg+0x123/0x150 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? __sys_sendmsg+0x406/0x420 2014-01-07 19:05:59 [] ? sock_destroy_inode+0x19/0x20 2014-01-07 19:05:59 [] ? sys_sendto+0x139/0x190 2014-01-07 19:05:59 [] sys_ppoll+0x4c/0x180 2014-01-07 19:05:59 [] ? sys_sendmsg+0x49/0x90 2014-01-07 19:05:59 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:59 ffff88080ed4fa08 0000000000000082 0000000000000000 0000000000000000 2014-01-07 19:05:59 0000000000000003 0000000000000000 0000000000000002 ffff8800446367a8 2014-01-07 19:05:59 ffff88080ed4daf8 ffff88080ed4ffd8 000000000000fb88 ffff88080ed4daf8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:05:59 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:05:59 [] ? __pollwait+0x75/0xf0 2014-01-07 19:05:59 [] ? try_to_wake_up+0x24e/0x3e0 2014-01-07 19:05:59 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:05:59 [] do_sys_poll+0x457/0x520 2014-01-07 19:05:59 [] ? default_wake_function+0x12/0x20 2014-01-07 19:05:59 [] ? __pollwait+0x0/0xf0 2014-01-07 19:05:59 [] ? pollwake+0x0/0x60 2014-01-07 19:05:59 [] ? sock_def_readable+0x44/0x80 2014-01-07 19:05:59 [] ? unix_dgram_sendmsg+0x5e3/0x6b0 2014-01-07 19:05:59 [] ? sock_sendmsg+0x123/0x150 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? __sys_sendmsg+0x406/0x420 2014-01-07 19:05:59 [] ? cache_alloc_refill+0x1c0/0x240 2014-01-07 19:05:59 [] ? sock_destroy_inode+0x19/0x20 2014-01-07 19:05:59 [] ? sys_sendto+0x139/0x190 2014-01-07 19:05:59 [] sys_ppoll+0x4c/0x180 2014-01-07 19:05:59 [] ? sys_sendmsg+0x49/0x90 2014-01-07 19:05:59 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:05:59 ffff88103113de30 0000000000000046 0000000000000000 ffff8800446567a8 2014-01-07 19:05:59 0000000000000001 ffff880044656740 ffff88103113dde0 ffffffff8106669b 2014-01-07 19:05:59 ffff881033137af8 ffff88103113dfd8 000000000000fb88 ffff881033137af8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:05:59 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:05:59 [] ? dm_wq_work+0x0/0xf0 [dm_mod] 2014-01-07 19:05:59 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:05:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:05:59 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff88103023de20 0000000000000046 0000000000000000 ffff880ff12692c0 2014-01-07 19:05:59 ffff8808185e9450 ffff88080ebb0000 ffffc9003f3e2000 ffff88080ebb80a8 2014-01-07 19:05:59 ffff88102f87f098 ffff88103023dfd8 000000000000fb88 ffff88102f87f098 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:05:59 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:59 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff8810321d7e20 0000000000000046 0000000000000000 00000000000004bb 2014-01-07 19:05:59 0000000000000003 0000000000000001 0000000000000000 0000000000000000 2014-01-07 19:05:59 ffff881031a27ab8 ffff8810321d7fd8 000000000000fb88 ffff881031a27ab8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:05:59 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:59 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff881031e13e20 0000000000000046 0000000000002d2a 00000000000016cf 2014-01-07 19:05:59 0000000000000004 0000000000000001 0000000000000001 0000000000000000 2014-01-07 19:05:59 ffff881030a53af8 ffff881031e13fd8 000000000000fb88 ffff881030a53af8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:05:59 [] ? default_wake_function+0x0/0x20 2014-01-07 19:05:59 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:05:59 [] kthread+0x96/0xa0 2014-01-07 19:05:59 [] child_rip+0xa/0x20 2014-01-07 19:05:59 [] ? kthread+0x0/0xa0 2014-01-07 19:05:59 [] ? child_rip+0x0/0x20 2014-01-07 19:05:59 ffff881031153e20 0000000000000046 0000000000000000 00000000000004bb 2014-01-07 19:05:59 0000000000000003 0000000000000001 0000000000000000 0000000000000000 2014-01-07 19:05:59 ffff881031025ab8 ffff881031153fd8 000000000000fb88 ffff881031025ab8 2014-01-07 19:05:59 Call Trace: 2014-01-07 19:05:59 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:05:59 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff881032c2de20 0000000000000046 ffff881032c2dde8 ffff881032c2dde4 2014-01-07 19:06:00 0000000000000003 ffff88083fe81600 ffff8800446b6740 000000000000af5c 2014-01-07 19:06:00 ffff881031d2baf8 ffff881032c2dfd8 000000000000fb88 ffff881031d2baf8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff8810333f3e20 0000000000000046 0000000000002d2a 00000000000016cf 2014-01-07 19:06:00 0000000000000004 0000000000000001 0000000000000001 0000000000000000 2014-01-07 19:06:00 ffff88102f35c5f8 ffff8810333f3fd8 000000000000fb88 ffff88102f35c5f8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff8810347efe20 0000000000000046 ffff8810347efd90 ffffffff81096db6 2014-01-07 19:06:00 ffff88085c436740 ffff880831118970 ffff8810347efde0 ffffffff81051439 2014-01-07 19:06:00 ffff8810313ea5f8 ffff8810347effd8 000000000000fb88 ffff8810313ea5f8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:00 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff881031919e20 0000000000000046 ffff881031919de8 ffff881031919de4 2014-01-07 19:06:00 ffff88085c436740 ffff88083fe81c00 ffff8800446b6740 000000000000af5c 2014-01-07 19:06:00 ffff8810313ebab8 ffff881031919fd8 000000000000fb88 ffff8810313ebab8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff8810333b3e20 0000000000000046 ffff8810333b3de8 ffff8810333b3de4 2014-01-07 19:06:00 ffff88085c436740 ffff88083fe81e00 ffff8800446b6740 000000000000af5c 2014-01-07 19:06:00 ffff8810303f3ab8 ffff8810333b3fd8 000000000000fb88 ffff8810303f3ab8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88102f9cfe20 0000000000000046 ffffffff81e26bc0 0000000000015e35 2014-01-07 19:06:00 ffff88085c436740 0000000000015e35 0000000000000001 000000000000002a 2014-01-07 19:06:00 ffff8810309a1af8 ffff88102f9cffd8 000000000000fb88 ffff8810309a1af8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080ec0fe20 0000000000000046 ffff88080ec0fde8 ffff88080ec0fde4 2014-01-07 19:06:00 ffff88085c436740 ffff88083fe82200 ffff8800446b6740 000000000000b185 2014-01-07 19:06:00 ffff8808327f9058 ffff88080ec0ffd8 000000000000fb88 ffff8808327f9058 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080edc1e20 0000000000000046 ffff88080edc1de8 ffff88080edc1de4 2014-01-07 19:06:00 ffff88085c436740 ffff88083fe82400 ffff8800446b6740 000000000000b185 2014-01-07 19:06:00 ffff88083263d098 ffff88080edc1fd8 000000000000fb88 ffff88083263d098 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080edc3e20 0000000000000046 ffff88080edc3de8 ffff88080edc3de4 2014-01-07 19:06:00 ffff88085c436740 ffff88083fe82600 ffff8800446b6740 000000000000b185 2014-01-07 19:06:00 ffff880831a2b098 ffff88080edc3fd8 000000000000fb88 ffff880831a2b098 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080edc5e20 0000000000000046 0000000000000000 000000000000b297 2014-01-07 19:06:00 ffff88085c436740 000000000000b297 0000000000000001 000000000000002a 2014-01-07 19:06:00 ffff880831998638 ffff88080edc5fd8 000000000000fb88 ffff880831998638 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 scsi host6: SRP abort called 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080edc7e20 0000000000000046 0000000000000000 ffff880827f5aad8 2014-01-07 19:06:00 0000000000000000 ffff8800446367a8 0000000000000001 ffff880044636740 2014-01-07 19:06:00 ffff880827f5b058 ffff88080edc7fd8 000000000000fb88 ffff880827f5b058 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080edc9e20 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:00 0000000000000000 ffff880831118970 ffff88080edc9de0 ffffffff81051439 2014-01-07 19:06:00 ffff880831a63ab8 ffff88080edc9fd8 000000000000fb88 ffff880831a63ab8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:00 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080edcbe20 0000000000000046 ffff88080edcbde8 ffff88080edcbde4 2014-01-07 19:06:00 0000000000000000 ffff88083fe82e00 ffff8800446b6740 000000000000af88 2014-01-07 19:06:00 ffff880833ec1058 ffff88080edcbfd8 000000000000fb88 ffff880833ec1058 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:00 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:00 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff88080ed9fe30 0000000000000046 0000000000000000 ffff8800446367a8 2014-01-07 19:06:00 ffff88080ed9fdb0 ffffffff81057310 ffff880833cdaad8 ffff8800446367a8 2014-01-07 19:06:00 ffff880833cdb058 ffff88080ed9ffd8 000000000000fb88 ffff880833cdb058 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:06:00 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:00 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:06:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:00 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff881030b75e30 0000000000000046 ffff881030b75df8 ffff881030b75df4 2014-01-07 19:06:00 0000000000000000 ffff88083fe81400 ffff880044616740 0000000000000519 2014-01-07 19:06:00 ffff88103105c5f8 ffff881030b75fd8 000000000000fb88 ffff88103105c5f8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:06:00 [] ? dm_wq_work+0x0/0xf0 [dm_mod] 2014-01-07 19:06:00 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:06:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:00 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff881031a5de30 0000000000000046 0000000000000000 ffff8800446367a8 2014-01-07 19:06:00 0000000000000001 ffff880044636740 ffff881031a5dde0 ffffffff8106669b 2014-01-07 19:06:00 ffff881030907098 ffff881031a5dfd8 000000000000fb88 ffff881030907098 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] ? dequeue_task_fair+0x12b/0x130 2014-01-07 19:06:00 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:06:00 [] ? dm_wq_work+0x0/0xf0 [dm_mod] 2014-01-07 19:06:00 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:06:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:00 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:00 [] kthread+0x96/0xa0 2014-01-07 19:06:00 [] child_rip+0xa/0x20 2014-01-07 19:06:00 [] ? kthread+0x0/0xa0 2014-01-07 19:06:00 [] ? child_rip+0x0/0x20 2014-01-07 19:06:00 ffff881031a47e30 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:00 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:00 ffff881030b4bab8 ffff881031a47fd8 000000000000fb88 ffff881030b4bab8 2014-01-07 19:06:00 Call Trace: 2014-01-07 19:06:00 [] ? dm_wq_work+0x0/0xf0 [dm_mod] 2014-01-07 19:06:01 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:01 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881031247e30 0000000000000046 0000000000000000 ffff881031247df4 2014-01-07 19:06:01 0000000000000000 ffff88083fe81200 ffff88085c436740 00000000000004a5 2014-01-07 19:06:01 ffff881031adb058 ffff881031247fd8 000000000000fb88 ffff881031adb058 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] ? prepare_to_wait+0x4e/0x80 2014-01-07 19:06:01 [] ? dm_wq_work+0x0/0xf0 [dm_mod] 2014-01-07 19:06:01 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:01 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881031a9fe30 0000000000000046 0000000000000000 ffff8800446367a8 2014-01-07 19:06:01 ffff881031a9fdb0 ffffffff81057310 ffff88102f153578 ffff8800446367a8 2014-01-07 19:06:01 ffff88102f153af8 ffff881031a9ffd8 000000000000fb88 ffff88102f153af8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:06:01 [] ? dm_wq_work+0x0/0xf0 [dm_mod] 2014-01-07 19:06:01 [] worker_thread+0x1fc/0x2a0 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:01 [] ? worker_thread+0x0/0x2a0 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff8810312f3d70 0000000000000046 ffff8810312f3d38 ffff8810312f3d34 2014-01-07 19:06:01 ffff8802ae8e5b90 ffff88083fe82000 ffff880044616740 0000000000000406 2014-01-07 19:06:01 ffff88102f35dab8 ffff8810312f3fd8 000000000000fb88 ffff88102f35dab8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:01 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:01 [] __cv_timedwait_common+0x9f/0x130 [spl] 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:01 [] ? arc_adapt_thread+0x0/0x160 [zfs] 2014-01-07 19:06:01 [] __cv_timedwait_interruptible+0x13/0x20 [spl] 2014-01-07 19:06:01 [] arc_adapt_thread+0x9c/0x160 [zfs] 2014-01-07 19:06:01 [] thread_generic_wrapper+0x5f/0x70 [spl] 2014-01-07 19:06:01 [] ? thread_generic_wrapper+0x0/0x70 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff8810332abc90 0000000000000046 0000000000000000 ffff8810332abc54 2014-01-07 19:06:01 ffff881000000000 0000000000000286 ffff8810332abc30 ffffffff810810cc 2014-01-07 19:06:01 ffff88102f3365f8 ffff8810332abfd8 000000000000fb88 ffff88102f3365f8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:06:01 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:01 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:01 [] __cv_timedwait_common+0x9f/0x130 [spl] 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:01 [] __cv_timedwait_interruptible+0x13/0x20 [spl] 2014-01-07 19:06:01 [] l2arc_feed_thread+0x55/0xa40 [zfs] 2014-01-07 19:06:01 [] ? enqueue_entity+0x56/0x410 2014-01-07 19:06:01 [] ? enqueue_task_fair+0xfb/0x100 2014-01-07 19:06:01 [] ? l2arc_feed_thread+0x0/0xa40 [zfs] 2014-01-07 19:06:01 [] thread_generic_wrapper+0x5f/0x70 [spl] 2014-01-07 19:06:01 [] ? thread_generic_wrapper+0x0/0x70 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff8810332afe20 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:01 0000000000000002 ffff88083432f930 ffff8810332afde0 ffffffff81051439 2014-01-07 19:06:01 ffff8810332adab8 ffff8810332affd8 000000000000fb88 ffff8810332adab8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:01 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881033295e20 0000000000000046 0000000000000000 0000000000000519 2014-01-07 19:06:01 0000000000000002 0000000000000001 0000000000000000 0000000000000000 2014-01-07 19:06:01 ffff8810332ad058 ffff881033295fd8 000000000000fb88 ffff8810332ad058 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881033297e20 0000000000000046 0000000000000000 0000000000000519 2014-01-07 19:06:01 0000000000000002 0000000000000001 0000000000000000 0000000000000000 2014-01-07 19:06:01 ffff8810332ac5f8 ffff881033297fd8 000000000000fb88 ffff8810332ac5f8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881030933e20 0000000000000046 0000000000000146 0000000000000519 2014-01-07 19:06:01 0000000000000002 0000000000000001 0000000000000000 0000000000000000 2014-01-07 19:06:01 ffff881030931af8 ffff881030933fd8 000000000000fb88 ffff881030931af8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881030937e20 0000000000000046 ffff881030937de8 ffff881030937de4 2014-01-07 19:06:01 0000000000000002 ffff88083fe81600 ffff880044696740 0000000000000207 2014-01-07 19:06:01 ffff881030931098 ffff881030937fd8 000000000000fb88 ffff881030931098 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881030a19e20 0000000000000046 ffff881030a19d90 ffffffff81096db6 2014-01-07 19:06:01 0000000000000003 ffff88083432ff30 ffff881030a19de0 ffffffff81051439 2014-01-07 19:06:01 ffff881030930638 ffff881030a19fd8 000000000000fb88 ffff881030930638 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:01 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff881030a1de20 0000000000000046 ffff881030a1dde8 ffff881030a1dde4 2014-01-07 19:06:01 ffff88085c496740 ffff88083fe81a00 ffff880044696740 0000000000000207 2014-01-07 19:06:01 ffff881030a1bab8 ffff881030a1dfd8 000000000000fb88 ffff881030a1bab8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff88102f2c9e20 0000000000000046 ffff88102f2c9de8 ffff88102f2c9de4 2014-01-07 19:06:01 ffff88085c496740 ffff88083fe81c00 ffff880044696740 0000000000000207 2014-01-07 19:06:01 ffff881030a1b058 ffff88102f2c9fd8 000000000000fb88 ffff881030a1b058 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff88102f2cde20 0000000000000046 ffff88102f2cdde8 ffff88102f2cdde4 2014-01-07 19:06:01 ffff88085c496740 ffff88083fe81e00 ffff880044696740 0000000000000207 2014-01-07 19:06:01 ffff881030a1a5f8 ffff88102f2cdfd8 000000000000fb88 ffff881030a1a5f8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff88102f219e20 0000000000000046 0000000000000000 0000000000000514 2014-01-07 19:06:01 ffff88085c496740 0000000000000514 0000000000000001 000000000000002a 2014-01-07 19:06:01 ffff88102f2cfaf8 ffff88102f219fd8 000000000000fb88 ffff88102f2cfaf8 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff88102f21de20 0000000000000046 0000000000000000 000000000000050c 2014-01-07 19:06:01 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:01 ffff88102f2cf098 ffff88102f21dfd8 000000000000fb88 ffff88102f2cf098 2014-01-07 19:06:01 Call Trace: 2014-01-07 19:06:01 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:01 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:01 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:01 [] kthread+0x96/0xa0 2014-01-07 19:06:01 [] child_rip+0xa/0x20 2014-01-07 19:06:01 [] ? kthread+0x0/0xa0 2014-01-07 19:06:01 [] ? child_rip+0x0/0x20 2014-01-07 19:06:01 ffff88102f21fe20 0000000000000046 0000000000000000 000000000000050c 2014-01-07 19:06:01 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:02 ffff88102f2ce638 ffff88102f21ffd8 000000000000fb88 ffff88102f2ce638 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810342ebe20 0000000000000046 ffffffff81e26bc0 000000000000050c 2014-01-07 19:06:02 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:02 ffff8810342e9ab8 ffff8810342ebfd8 000000000000fb88 ffff8810342e9ab8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810342efe20 0000000000000046 0000000000000000 000000000000050c 2014-01-07 19:06:02 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:02 ffff8810342e9058 ffff8810342effd8 000000000000fb88 ffff8810342e9058 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810342f9e20 0000000000000046 0000000000000000 000000000000050c 2014-01-07 19:06:02 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:02 ffff8810342e85f8 ffff8810342f9fd8 000000000000fb88 ffff8810342e85f8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810342ffe20 0000000000000046 0000000000000000 000000000000050c 2014-01-07 19:06:02 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:02 ffff8810342fdaf8 ffff8810342fffd8 000000000000fb88 ffff8810342fdaf8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810332f3e20 0000000000000046 ffff8810332f3de8 ffff8810332f3de4 2014-01-07 19:06:02 ffff88085c496740 ffff88083fe82e00 ffff880044696740 000000000000036b 2014-01-07 19:06:02 ffff8810342fd098 ffff8810332f3fd8 000000000000fb88 ffff8810342fd098 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810332f5e20 0000000000000046 ffff8810332f5de8 ffff8810332f5de4 2014-01-07 19:06:02 ffff88085c496740 ffff88083fe81000 ffff880044696740 0000000000000207 2014-01-07 19:06:02 ffff8810342fc638 ffff8810332f5fd8 000000000000fb88 ffff8810342fc638 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff881030909e20 0000000000000046 ffff881030909de8 ffff881030909de4 2014-01-07 19:06:02 ffff88085c496740 ffff88083fe81200 ffff880044696740 0000000000000207 2014-01-07 19:06:02 ffff8810332f7ab8 ffff881030909fd8 000000000000fb88 ffff8810332f7ab8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff88103090de20 0000000000000046 ffffffff81e26bc0 000000000000051c 2014-01-07 19:06:02 ffff88085c496740 000000000000051c 0000000000000001 000000000000002a 2014-01-07 19:06:02 ffff8810332f7058 ffff88103090dfd8 000000000000fb88 ffff8810332f7058 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff88103090fe20 0000000000000046 ffff88103090fde8 ffff88103090fde4 2014-01-07 19:06:02 ffff88085c496740 ffff88083fe81600 ffff880044696740 0000000000000207 2014-01-07 19:06:02 ffff8810332f65f8 ffff88103090ffd8 000000000000fb88 ffff8810332f65f8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810308abe20 0000000000000046 ffffffff81e26bc0 000000000000050c 2014-01-07 19:06:02 ffff88085c496740 000000000000050c 0000000000000000 000000000000002a 2014-01-07 19:06:02 ffff8810308a9af8 ffff8810308abfd8 000000000000fb88 ffff8810308a9af8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810308b9e20 0000000000000046 0000000000000000 ffff8810308b9de4 2014-01-07 19:06:02 ffff880800000000 ffff88083fe81a00 ffff880044696740 000000000000015f 2014-01-07 19:06:02 ffff8810308a9098 ffff8810308b9fd8 000000000000fb88 ffff8810308a9098 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810308bbe20 0000000000000046 0000000000000000 ffff8810308bbde4 2014-01-07 19:06:02 ffff880800000000 ffff88083fe81c00 ffff880044696740 000000000000015f 2014-01-07 19:06:02 ffff8810308a8638 ffff8810308bbfd8 000000000000fb88 ffff8810308a8638 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810308bfe20 0000000000000046 0000000000000000 ffff8810308bfde4 2014-01-07 19:06:02 ffff880800000000 ffff88083fe81e00 ffff880044696740 000000000000015f 2014-01-07 19:06:02 ffff8810308bdab8 ffff8810308bffd8 000000000000fb88 ffff8810308bdab8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810309dbe20 0000000000000046 0000000000000000 000000000000051c 2014-01-07 19:06:02 ffff88085c496740 000000000000051c 0000000000000001 000000000000002a 2014-01-07 19:06:02 ffff8810308bd058 ffff8810309dbfd8 000000000000fb88 ffff8810308bd058 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff8810309dde20 0000000000000046 0000000000000000 0000000000000514 2014-01-07 19:06:02 ffff88085c496740 0000000000000514 0000000000000001 000000000000002a 2014-01-07 19:06:02 ffff8810308bc5f8 ffff8810309ddfd8 000000000000fb88 ffff8810308bc5f8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff881033139e20 0000000000000046 0000000000000000 0000000000000514 2014-01-07 19:06:02 ffff88085c496740 0000000000000514 0000000000000001 000000000000002a 2014-01-07 19:06:02 ffff8810309dfaf8 ffff881033139fd8 000000000000fb88 ffff8810309dfaf8 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff88103313de20 0000000000000046 ffffffff81e26bc0 0000000000000514 2014-01-07 19:06:02 ffff88085c496740 0000000000000514 0000000000000001 000000000000002a 2014-01-07 19:06:02 ffff8810309df098 ffff88103313dfd8 000000000000fb88 ffff8810309df098 2014-01-07 19:06:02 Call Trace: 2014-01-07 19:06:02 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:02 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:02 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:02 [] kthread+0x96/0xa0 2014-01-07 19:06:02 [] child_rip+0xa/0x20 2014-01-07 19:06:02 [] ? kthread+0x0/0xa0 2014-01-07 19:06:02 [] ? child_rip+0x0/0x20 2014-01-07 19:06:02 ffff881033171e20 0000000000000046 0000000000000000 0000000000000514 2014-01-07 19:06:02 ffff88085c496740 0000000000000514 0000000000000001 000000000000002a 2014-01-07 19:06:03 ffff8810309de638 ffff881033171fd8 000000000000fb88 ffff8810309de638 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff881033175e20 0000000000000046 ffff881033175de8 ffff881033175de4 2014-01-07 19:06:03 ffff88085c496740 ffff88083fe82a00 ffff880044696740 0000000000000514 2014-01-07 19:06:03 ffff881033173ab8 ffff881033175fd8 000000000000fb88 ffff881033173ab8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff881033191e20 0000000000000046 0000000000000000 ffff881033191de4 2014-01-07 19:06:03 ffff880800000000 ffff88083fe82c00 ffff880044696740 00000000000001ff 2014-01-07 19:06:03 ffff881033173058 ffff881033191fd8 000000000000fb88 ffff881033173058 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff881033193e20 0000000000000046 ffff881033193de8 ffff881033193de4 2014-01-07 19:06:03 ffff88085c496740 ffff88083fe82e00 ffff880044696740 0000000000000205 2014-01-07 19:06:03 ffff8810331725f8 ffff881033193fd8 000000000000fb88 ffff8810331725f8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0e1db0 0000000000000046 0000000000000000 ffff88102f0e1d74 2014-01-07 19:06:03 ffff881000000000 0000000000000286 ffff88102f0e1d50 ffffffff810810cc 2014-01-07 19:06:03 ffff881032c385f8 ffff88102f0e1fd8 000000000000fb88 ffff881032c385f8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:06:03 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:03 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:03 [] kiblnd_connd+0x1de/0x360 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_connd+0x0/0x360 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0e3e00 0000000000000046 ffff88102f0e3d60 ffff8807c4587698 2014-01-07 19:06:03 ffffc90017716000 00000000fffffffd ffff88102f0e3e00 ffff8807c4587600 2014-01-07 19:06:03 ffff881030a52638 ffff88102f0e3fd8 000000000000fb88 ffff881030a52638 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0e5e00 0000000000000046 0000000000000000 ffff88102f0e5dc4 2014-01-07 19:06:03 0000000000000000 ffff88083fe81600 ffff880044616740 0000000000000181 2014-01-07 19:06:03 ffff881030a53098 ffff88102f0e5fd8 000000000000fb88 ffff881030a53098 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0e7e00 0000000000000046 0000000000000000 ffff88102f0e7dc4 2014-01-07 19:06:03 ffffc90000000000 ffff88083fe81a00 ffff880044616740 0000000000000181 2014-01-07 19:06:03 ffff8810313b7af8 ffff88102f0e7fd8 000000000000fb88 ffff8810313b7af8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0d9e00 0000000000000046 0000000000000000 ffff88102f0d9dc4 2014-01-07 19:06:03 0000000000000000 ffff88083fe81c00 ffff880044616740 000000000000015a 2014-01-07 19:06:03 ffff881034de6638 ffff88102f0d9fd8 000000000000fb88 ffff881034de6638 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0dbe00 0000000000000046 ffff88102f0dbdc8 ffff88102f0dbdc4 2014-01-07 19:06:03 ffffc90017716000 ffff88083fe82600 ffff880044616740 0000000000000406 2014-01-07 19:06:03 ffff8810309a0638 ffff88102f0dbfd8 000000000000fb88 ffff8810309a0638 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0dde00 0000000000000046 ffff88102f0dddc8 ffff88102f0dddc4 2014-01-07 19:06:03 ffffc90017716000 ffff88083fe82000 ffff880044616740 0000000000000207 2014-01-07 19:06:03 ffff881033137098 ffff88102f0ddfd8 000000000000fb88 ffff881033137098 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0dfe00 0000000000000046 ffff88102f0dfdc8 ffff88102f0dfdc4 2014-01-07 19:06:03 00000000fffffffa ffff88083fe82c00 ffff880044616740 0000000000000406 2014-01-07 19:06:03 ffff881033136638 ffff88102f0dffd8 000000000000fb88 ffff881033136638 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88102f0b9e00 0000000000000046 ffff88102f0b9dc8 ffff88102f0b9dc4 2014-01-07 19:06:03 ffffc90017716000 ffff88083fe82a00 ffff880044616740 0000000000000207 2014-01-07 19:06:03 ffff881031d2fab8 ffff88102f0b9fd8 000000000000fb88 ffff881031d2fab8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] kiblnd_scheduler+0x3b6/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:03 [] ? kiblnd_scheduler+0x0/0x7b0 [ko2iblnd] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff8810058bfd80 0000000000000046 0000000000000000 ffff8810058bfd44 2014-01-07 19:06:03 0000000000000000 ffff88083fe81e00 ffff880044616740 000000000000015a 2014-01-07 19:06:03 ffff8810309edaf8 ffff8810058bffd8 000000000000fb88 ffff8810309edaf8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:03 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:03 [] lnet_router_checker+0x47a/0x590 [lnet] 2014-01-07 19:06:03 [] ? default_wake_function+0x12/0x20 2014-01-07 19:06:03 [] ? lnet_router_checker+0x0/0x590 [lnet] 2014-01-07 19:06:03 [] kthread+0x96/0xa0 2014-01-07 19:06:03 [] child_rip+0xa/0x20 2014-01-07 19:06:03 [] ? kthread+0x0/0xa0 2014-01-07 19:06:03 [] ? child_rip+0x0/0x20 2014-01-07 19:06:03 ffff88080ea01e68 0000000000000086 ffff88080ea01e30 ffff88080ea01e2c 2014-01-07 19:06:03 ffff88080000000b ffff88083fe82600 ffff880044616740 0000000000000406 2014-01-07 19:06:03 ffff880831a41af8 ffff88080ea01fd8 000000000000fb88 ffff880831a41af8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] do_nanosleep+0x8b/0xc0 2014-01-07 19:06:03 [] hrtimer_nanosleep+0xc4/0x180 2014-01-07 19:06:03 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:06:03 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:06:03 [] sys_nanosleep+0x74/0x80 2014-01-07 19:06:03 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:03 ffff88103087fe68 0000000000000086 0000000000000000 ffffffff8109bc05 2014-01-07 19:06:03 ffff881000000000 0000000100000286 ffff88103087fe08 ffffffff8109b2c1 2014-01-07 19:06:03 ffff881031ada5f8 ffff88103087ffd8 000000000000fb88 ffff881031ada5f8 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] ? __hrtimer_start_range_ns+0x1a5/0x470 2014-01-07 19:06:03 [] ? lock_hrtimer_base+0x31/0x60 2014-01-07 19:06:03 [] do_nanosleep+0x8b/0xc0 2014-01-07 19:06:03 [] hrtimer_nanosleep+0xc4/0x180 2014-01-07 19:06:03 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:06:03 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:06:03 [] sys_nanosleep+0x74/0x80 2014-01-07 19:06:03 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:03 ffff88102f8a78d8 0000000000000082 0000000000000000 0000000000000000 2014-01-07 19:06:03 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:03 ffff88102f0c6638 ffff88102f8a7fd8 000000000000fb88 ffff88102f0c6638 2014-01-07 19:06:03 Call Trace: 2014-01-07 19:06:03 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:06:03 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:06:03 [] ? __pollwait+0x75/0xf0 2014-01-07 19:06:03 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:06:03 [] do_select+0x57c/0x6c0 2014-01-07 19:06:03 [] ? __pollwait+0x0/0xf0 2014-01-07 19:06:03 [] ? pollwake+0x0/0x60 2014-01-07 19:06:03 [] ? __stp_relay_dropped_open+0x0/0x10 [toss2361] 2014-01-07 19:06:03 [] ? vga_set_mem_top+0x59/0x60 2014-01-07 19:06:04 [] ? vgacon_scroll+0x107/0x2e0 2014-01-07 19:06:04 [] ? vgacon_set_cursor_size+0xbd/0x150 2014-01-07 19:06:04 [] ? notifier_call_chain+0x16/0x80 2014-01-07 19:06:04 [] ? perf_event_task_sched_out+0x33/0x80 2014-01-07 19:06:04 [] ? notify_update+0x2e/0x30 2014-01-07 19:06:04 [] ? vt_console_print+0x260/0x330 2014-01-07 19:06:04 [] ? __dequeue_entity+0x30/0x50 2014-01-07 19:06:04 [] ? __switch_to+0x1ac/0x320 2014-01-07 19:06:04 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:06:04 [] ? vprintk+0x251/0x560 2014-01-07 19:06:04 [] ? cache_alloc_refill+0x1c0/0x240 2014-01-07 19:06:04 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:04 [] ? _stp_ctl_read_cmd+0x8f/0x260 [toss2361] 2014-01-07 19:06:04 [] sys_pselect6+0x5e/0x210 2014-01-07 19:06:04 [] ? security_file_fcntl+0x16/0x20 2014-01-07 19:06:04 [] ? sys_fcntl+0x118/0x530 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff88080ef23dc8 0000000000000082 ffff88080ef23d90 ffff88080ef23d8c 2014-01-07 19:06:04 0000000000000000 ffff88083fe81400 ffff88085c416740 0000000000000400 2014-01-07 19:06:04 ffff880833c1b058 ffff88080ef23fd8 000000000000fb88 ffff880833c1b058 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:06:04 [] schedule_timeout_interruptible+0x1e/0x20 2014-01-07 19:06:04 [] sys_rt_sigtimedwait+0x206/0x260 2014-01-07 19:06:04 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff88080ecada08 0000000000000082 ffff88080ecad9d0 ffff88080ecad9cc 2014-01-07 19:06:04 0000000000000008 ffff88083fe82000 ffff880044616740 0000000000000406 2014-01-07 19:06:04 ffff8808319025f8 ffff88080ecadfd8 000000000000fb88 ffff8808319025f8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? apic_timer_interrupt+0xe/0x20 2014-01-07 19:06:04 [] schedule_hrtimeout_range+0xc8/0x160 2014-01-07 19:06:04 [] ? hrtimer_wakeup+0x0/0x30 2014-01-07 19:06:04 [] ? hrtimer_start_range_ns+0x14/0x20 2014-01-07 19:06:04 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:06:04 [] do_sys_poll+0x457/0x520 2014-01-07 19:06:04 [] ? __pollwait+0x0/0xf0 2014-01-07 19:06:04 [] ? pollwake+0x0/0x60 2014-01-07 19:06:04 [] ? filemap_fault+0xd3/0x500 2014-01-07 19:06:04 [] ? unlock_page+0x27/0x30 2014-01-07 19:06:04 [] ? __do_fault+0x469/0x530 2014-01-07 19:06:04 [] ? handle_pte_fault+0xf7/0xb50 2014-01-07 19:06:04 [] ? __lru_cache_add+0x40/0x90 2014-01-07 19:06:04 [] ? lru_cache_add_lru+0x21/0x40 2014-01-07 19:06:04 [] ? page_add_new_anon_rmap+0x9d/0xf0 2014-01-07 19:06:04 [] ? do_huge_pmd_anonymous_page+0x255/0x380 2014-01-07 19:06:04 [] ? handle_mm_fault+0x23a/0x310 2014-01-07 19:06:04 [] ? apic_timer_interrupt+0xe/0x20 2014-01-07 19:06:04 [] ? apic_timer_interrupt+0xe/0x20 2014-01-07 19:06:04 [] ? read_tsc+0x9/0x20 2014-01-07 19:06:04 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:04 [] ? read_tsc+0x9/0x20 2014-01-07 19:06:04 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:04 [] ? poll_select_set_timeout+0x8d/0xa0 2014-01-07 19:06:04 [] sys_ppoll+0x4c/0x180 2014-01-07 19:06:04 [] ? call_function_single_interrupt+0xe/0x20 2014-01-07 19:06:04 [] ? sys_read+0x7c/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff881032c4fcc8 0000000000000082 0000000000000000 ffffffff811436a9 2014-01-07 19:06:04 00000008281aa025 0000000000000000 0000000000000000 ffffea0038ab8080 2014-01-07 19:06:04 ffff88103089e5f8 ffff881032c4ffd8 000000000000fb88 ffff88103089e5f8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? __do_fault+0x469/0x530 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? uart_write+0xe9/0x120 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] ? do_device_not_available+0xe/0x10 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff881031ee9cc8 0000000000000086 ffff881031ee9c28 ffff88083106c078 2014-01-07 19:06:04 ffff88085c4567a8 ffff88085c456740 000000000000000b 000000000000000a 2014-01-07 19:06:04 ffff881030805098 ffff881031ee9fd8 000000000000fb88 ffff881030805098 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? release_console_sem+0x1cf/0x220 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff880812eb3cc8 0000000000000082 ffff880812eb3c28 ffff88083106c078 2014-01-07 19:06:04 ffff88085c4567a8 ffff88085c456740 000000000000000c 000000000000000a 2014-01-07 19:06:04 ffff88083434d058 ffff880812eb3fd8 000000000000fb88 ffff88083434d058 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? release_console_sem+0x1cf/0x220 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff8808329b1cc8 0000000000000082 ffff8808329b1c28 ffff88081788d538 2014-01-07 19:06:04 ffff88085c4367a8 ffff88085c436740 000000000000000d 0000000000000009 2014-01-07 19:06:04 ffff88081875dab8 ffff8808329b1fd8 000000000000fb88 ffff88081875dab8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? release_console_sem+0x1cf/0x220 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff88080ece7cc8 0000000000000082 ffff88080ece7ca8 ffffffff811436a9 2014-01-07 19:06:04 0000000828198025 0000000000000000 0000000000000000 ffffea0038ae20b8 2014-01-07 19:06:04 ffff88083106c5f8 ffff88080ece7fd8 000000000000fb88 ffff88083106c5f8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? __do_fault+0x469/0x530 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? release_console_sem+0x1cf/0x220 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff880816f2fcc8 0000000000000082 ffff880816f2fca8 ffffffff811436a9 2014-01-07 19:06:04 0000000828198025 0000000000000000 0000000000000000 ffffea0038ae5688 2014-01-07 19:06:04 ffff88081788dab8 ffff880816f2ffd8 000000000000fb88 ffff88081788dab8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? __do_fault+0x469/0x530 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? release_console_sem+0x1cf/0x220 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff8807de57dcc8 0000000000000086 ffff8807de57dc90 ffff8807de57dc8c 2014-01-07 19:06:04 0000000828198025 ffff88083fe81600 ffff880044636740 0000000000000632 2014-01-07 19:06:04 ffff88083103bab8 ffff8807de57dfd8 000000000000fb88 ffff88083103bab8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] ? flush_work+0x21/0xc0 2014-01-07 19:06:04 [] ? try_to_del_timer_sync+0x7b/0xe0 2014-01-07 19:06:04 [] n_tty_read+0x5f7/0x9b0 2014-01-07 19:06:04 [] ? release_console_sem+0x1cf/0x220 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] tty_read+0xa6/0xf0 2014-01-07 19:06:04 [] vfs_read+0xb5/0x1a0 2014-01-07 19:06:04 [] sys_read+0x51/0x90 2014-01-07 19:06:04 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:06:04 ffff88102f10dd10 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:04 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:04 ffff881031adbab8 ffff88102f10dfd8 000000000000fb88 ffff881031adbab8 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] schedule_timeout+0x215/0x2e0 2014-01-07 19:06:04 [] svc_recv+0x5a5/0x850 [sunrpc] 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] ? queue_delayed_work+0x21/0x40 2014-01-07 19:06:04 [] lockd+0xc1/0x230 [lockd] 2014-01-07 19:06:04 [] ? lockd+0x0/0x230 [lockd] 2014-01-07 19:06:04 [] kthread+0x96/0xa0 2014-01-07 19:06:04 [] child_rip+0xa/0x20 2014-01-07 19:06:04 [] ? kthread+0x0/0xa0 2014-01-07 19:06:04 [] ? child_rip+0x0/0x20 2014-01-07 19:06:04 ffff8810309f7e20 0000000000000046 ffff880e81800040 ffff880e81800040 2014-01-07 19:06:04 ffff8810309f7de0 ffffffffa05692e1 ffff8800446b6740 0000000000000400 2014-01-07 19:06:04 ffff88102f0c7098 ffff8810309f7fd8 000000000000fb88 ffff88102f0c7098 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] ? zio_ready+0x171/0x470 [zfs] 2014-01-07 19:06:04 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:04 [] kthread+0x96/0xa0 2014-01-07 19:06:04 [] child_rip+0xa/0x20 2014-01-07 19:06:04 [] ? kthread+0x0/0xa0 2014-01-07 19:06:04 [] ? child_rip+0x0/0x20 2014-01-07 19:06:04 ffff881031c97e20 0000000000000046 0000000000000000 ffff880e8f34d678 2014-01-07 19:06:04 ffff881031c97db0 ffff880554f4c028 0000000000100000 ffff880554f4c098 2014-01-07 19:06:04 ffff881030945058 ffff881031c97fd8 000000000000fb88 ffff881030945058 2014-01-07 19:06:04 Call Trace: 2014-01-07 19:06:04 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:04 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:04 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88103193de20 0000000000000046 ffff880701dd27a0 ffff880701dd2ab8 2014-01-07 19:06:05 ffff88103193ddb0 ffffffffa0564dc3 0000000000000000 ffff880701dd27a0 2014-01-07 19:06:05 ffff881031025058 ffff88103193dfd8 000000000000fb88 ffff881031025058 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102f323e20 0000000000000046 ffff880e84bdcaa0 ffff880e84bdcdb8 2014-01-07 19:06:05 ffff88102f323db0 ffffffffa0564dc3 0000000000000000 ffff880e84bdcaa0 2014-01-07 19:06:05 ffff881031da7ab8 ffff88102f323fd8 000000000000fb88 ffff881031da7ab8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881030803e20 0000000000000046 ffff881030803de8 ffff881030803de4 2014-01-07 19:06:05 ffff881030803db0 ffff88083fe81400 ffff88085c416740 000000000000af70 2014-01-07 19:06:05 ffff881033194638 ffff881030803fd8 000000000000fb88 ffff881033194638 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102f04be20 0000000000000046 ffff880e83c18040 ffff880e83c18358 2014-01-07 19:06:05 ffff88102f04bdb0 ffffffffa0564dc3 0000000000000000 ffff880e83c18040 2014-01-07 19:06:05 ffff88102f337ab8 ffff88102f04bfd8 000000000000fb88 ffff88102f337ab8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102fa77e20 0000000000000046 0000000000000000 ffff880e8fa1cdb8 2014-01-07 19:06:05 ffff88102fa77db0 ffffffffa0564dc3 0000000000000000 ffff880e8fa1caa0 2014-01-07 19:06:05 ffff88103105dab8 ffff88102fa77fd8 000000000000fb88 ffff88103105dab8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102e92de20 0000000000000046 ffff880e81f6fac0 ffff880e81f6fdd8 2014-01-07 19:06:05 ffff88102e92ddb0 ffffffffa0564dc3 0000000000000000 ffff880e81f6fac0 2014-01-07 19:06:05 ffff88102f152638 ffff88102e92dfd8 000000000000fb88 ffff88102f152638 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102f881e20 0000000000000046 ffff880e80c841e0 ffff880e80c844f8 2014-01-07 19:06:05 ffff88102f881db0 ffffffffa0564dc3 0000000000000000 ffff880e80c841e0 2014-01-07 19:06:05 ffff881031a97098 ffff88102f881fd8 000000000000fb88 ffff881031a97098 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881030245e20 0000000000000046 0000000000000000 ffff8806c337e398 2014-01-07 19:06:05 ffff881030245db0 ffffffffa0564dc3 0000000000000000 ffff8806c337e080 2014-01-07 19:06:05 ffff881031a96638 ffff881030245fd8 000000000000fb88 ffff881031a96638 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881031bdfe20 0000000000000046 0000000000000000 ffff8806c336f0b8 2014-01-07 19:06:05 00000a5a376c6000 ffff8806c3369468 0000000000100000 ffff8806c33694d8 2014-01-07 19:06:05 ffff881030906638 ffff881031bdffd8 000000000000fb88 ffff881030906638 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881030167e20 0000000000000046 0000000000000000 ffff880e83cd2f18 2014-01-07 19:06:05 00000a5a376c6000 ffff880e79119468 0000000000100000 ffff880e791194d8 2014-01-07 19:06:05 ffff881030907af8 ffff881030167fd8 000000000000fb88 2014-01-07 19:06:05 scsi host6: SRP abort called 2014-01-07 19:06:05 ffff881030907af8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881030b8de20 0000000000000046 0000000000000000 ffff880e8e737978 2014-01-07 19:06:05 00000a5a371f0000 ffff880e83c84028 0000000000100000 ffff880e83c84098 2014-01-07 19:06:05 ffff881031d33ab8 ffff881030b8dfd8 000000000000fb88 ffff881031d33ab8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881031c87e20 0000000000000046 0000000000000000 ffff880e83c87978 2014-01-07 19:06:05 00000a59f73f8000 ffff880e7af89008 0000000000100000 ffff880e7af89078 2014-01-07 19:06:05 ffff881031d33058 ffff881031c87fd8 000000000000fb88 ffff881031d33058 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881030b89e20 0000000000000046 0000000000000000 ffff880e90b23c38 2014-01-07 19:06:05 00000a5a773f8000 ffff880e83e65ec8 0000000000100000 ffff880e83e65f38 2014-01-07 19:06:05 ffff881031d325f8 ffff881030b89fd8 000000000000fb88 ffff881031d325f8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102f2f7e20 0000000000000046 0000000000000000 ffff880e8f2a0c18 2014-01-07 19:06:05 00000a59b73f8000 ffff880e8f2a25e8 0000000000100000 ffff880e8f2a2658 2014-01-07 19:06:05 ffff881030b5daf8 ffff88102f2f7fd8 000000000000fb88 ffff881030b5daf8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff881031c07e20 0000000000000046 0000000000000000 ffff880e79a69938 2014-01-07 19:06:05 00000a5bf76a2000 ffff880e793cd608 0000000000100000 ffff880e793cd678 2014-01-07 19:06:05 ffff881030b5d098 ffff881031c07fd8 000000000000fb88 ffff881030b5d098 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff8810331ade20 0000000000000046 0000000000000000 ffff880e8e8c4098 2014-01-07 19:06:05 00000a5c376a2000 ffff880e81ae48e8 0000000000100000 ffff880e81ae4958 2014-01-07 19:06:05 ffff881030b5c638 ffff8810331adfd8 000000000000fb88 ffff881030b5c638 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:05 [] child_rip+0xa/0x20 2014-01-07 19:06:05 [] ? kthread+0x0/0xa0 2014-01-07 19:06:05 [] ? child_rip+0x0/0x20 2014-01-07 19:06:05 ffff88102f0ede20 0000000000000046 0000000000000000 ffff8807bd210c18 2014-01-07 19:06:05 00000a5bb7444000 ffff8802a38e98c8 0000000000100000 ffff8802a38e9938 2014-01-07 19:06:05 ffff88103222fab8 ffff88102f0edfd8 000000000000fb88 ffff88103222fab8 2014-01-07 19:06:05 Call Trace: 2014-01-07 19:06:05 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:05 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:05 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88102f2e7e20 0000000000000046 0000000000000000 ffff8806c336d218 2014-01-07 19:06:06 00000a59f76c6000 ffff8806c336c8e8 0000000000100000 ffff8806c336c958 2014-01-07 19:06:06 ffff88103222f058 ffff88102f2e7fd8 000000000000fb88 ffff88103222f058 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff881031e8fe20 0000000000000046 0000000000000000 ffff880700dd14d8 2014-01-07 19:06:06 00000a5af76c6000 ffff880700e56328 0000000000100000 ffff880700e56398 2014-01-07 19:06:06 ffff88103222e5f8 ffff881031e8ffd8 000000000000fb88 ffff88103222e5f8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88103089be20 0000000000000046 0000000000000000 ffff880e8ea48358 2014-01-07 19:06:06 00000a5ab71f0000 ffff880e8e233308 0000000000100000 ffff880e8e233378 2014-01-07 19:06:06 ffff881031a2baf8 ffff88103089bfd8 000000000000fb88 ffff881031a2baf8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff881032737e20 0000000000000046 0000000000000000 ffff880e79b33378 2014-01-07 19:06:06 00000a59b76c6000 ffff880e79b36788 0000000000100000 ffff880e79b367f8 2014-01-07 19:06:06 ffff881031a2b098 ffff881032737fd8 000000000000fb88 ffff881031a2b098 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff8810331f9e20 0000000000000046 0000000000000000 ffff880e78d244f8 2014-01-07 19:06:06 00000a5b376c6000 ffff880e78d218c8 0000000000100000 ffff880e78d21938 2014-01-07 19:06:06 ffff881031a2a638 ffff8810331f9fd8 000000000000fb88 ffff881031a2a638 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff8810310a7e20 0000000000000046 0000000000000000 ffff880e79118358 2014-01-07 19:06:06 00000a59f76c6000 ffff880e7911d1a8 0000000000100000 ffff880e7911d218 2014-01-07 19:06:06 ffff88102f217ab8 ffff8810310a7fd8 000000000000fb88 ffff88102f217ab8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff8810058bbe20 0000000000000046 0000000000000000 ffff880701d97518 2014-01-07 19:06:06 00000a59b76c6000 ffff880701d91468 0000000000100000 ffff880701d914d8 2014-01-07 19:06:06 ffff88102f217058 ffff8810058bbfd8 000000000000fb88 ffff88102f217058 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88102f827e20 0000000000000046 ffff880e81a15360 ffff880e81a15678 2014-01-07 19:06:06 ffff88102f827db0 ffffffffa0564dc3 0000000000000000 ffff880e81a15360 2014-01-07 19:06:06 ffff88102f2165f8 ffff88102f827fd8 000000000000fb88 ffff88102f2165f8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88102f281e20 0000000000000046 0000000000000000 ffff880e90b35ad8 2014-01-07 19:06:06 ffff88102f281db0 ffffffffa0564dc3 0000000000000000 ffff880e90b357c0 2014-01-07 19:06:06 ffff881030ab5af8 ffff88102f281fd8 000000000000fb88 ffff881030ab5af8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88102f857e20 0000000000000046 0000000000000000 ffff880701de1078 2014-01-07 19:06:06 ffff88102f857db0 ffffffffa0564dc3 0000000000000000 ffff880701de0d60 2014-01-07 19:06:06 ffff881030ab5098 ffff88102f857fd8 000000000000fb88 ffff881030ab5098 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff881032443e20 0000000000000046 0000000000000000 ffffffffa0513e9b 2014-01-07 19:06:06 ffff881000000000 ffff880700e0e080 0000000000000008 ffff8807d3433000 2014-01-07 19:06:06 ffff881030ab4638 ffff881032443fd8 000000000000fb88 ffff881030ab4638 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff881030ab3e20 0000000000000046 0000000000000000 ffffffffa0513e9b 2014-01-07 19:06:06 ffff881000000000 ffff880e90b357c0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:06 ffff88102e919ab8 ffff881030ab3fd8 000000000000fb88 ffff88102e919ab8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff8810308e3e20 0000000000000046 0000000000000000 ffff8810308e3de4 2014-01-07 19:06:06 ffff881000000000 ffff88083fe81a00 ffff88085c416740 ffffffff8100b9ce 2014-01-07 19:06:06 ffff88102e919058 ffff8810308e3fd8 000000000000fb88 ffff88102e919058 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? common_interrupt+0xe/0x13 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88102f315e20 0000000000000046 ffff88102f315de8 ffff88102f315de4 2014-01-07 19:06:06 ffff881000000000 ffff88083fe81c00 ffff88085c416740 000000000000ad6f 2014-01-07 19:06:06 ffff88102e9185f8 ffff88102f315fd8 000000000000fb88 ffff88102e9185f8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff88102e923e20 0000000000000046 0000000000000000 ffff88102e923de4 2014-01-07 19:06:06 0000000000004000 ffff88083fe81e00 ffff88085c416740 000000000000ad7f 2014-01-07 19:06:06 ffff881031bd7af8 ffff88102e923fd8 000000000000fb88 ffff881031bd7af8 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff881030273e20 0000000000000046 ffff880700e0e080 ffff8807d3433050 2014-01-07 19:06:06 0000000000000800 0000000000000003 ffff881030273de0 ffffffffa0566a67 2014-01-07 19:06:06 ffff881031bd7098 ffff881030273fd8 000000000000fb88 ffff881031bd7098 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? zio_write_bp_init+0x77/0x500 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:06 ffff881030249e20 0000000000000046 0000000000000000 ffff880701d80c18 2014-01-07 19:06:06 ffff881030249db0 ffffffffa0564dc3 0000000000000000 ffff880701d80900 2014-01-07 19:06:06 ffff881031bd6638 ffff881030249fd8 000000000000fb88 ffff881031bd6638 2014-01-07 19:06:06 Call Trace: 2014-01-07 19:06:06 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:06 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:06 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:06 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:06 [] kthread+0x96/0xa0 2014-01-07 19:06:06 [] child_rip+0xa/0x20 2014-01-07 19:06:06 [] ? kthread+0x0/0xa0 2014-01-07 19:06:06 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88103033be20 0000000000000046 0000000000000000 ffffc900180172c0 2014-01-07 19:06:07 0000000000004000 0000000000000003 ffff88103033bde0 ffffffffa0566a67 2014-01-07 19:06:07 ffff8810320bdab8 ffff88103033bfd8 000000000000fb88 ffff8810320bdab8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] ? zio_write_bp_init+0x77/0x500 [zfs] 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88102f8c7e20 0000000000000046 0000000000000000 ffff88102f8c7de4 2014-01-07 19:06:07 ffff881000000000 ffff88083fe82600 ffff88085c416740 000000000000ad64 2014-01-07 19:06:07 ffff8810320bd058 ffff88102f8c7fd8 000000000000fb88 ffff8810320bd058 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff8810310b9e20 0000000000000046 0000000000000000 ffff880e9141f0b8 2014-01-07 19:06:07 ffff8810310b9db0 ffffffffa0564dc3 0000000000000000 ffff880e9141eda0 2014-01-07 19:06:07 ffff8810320bc5f8 ffff8810310b9fd8 000000000000fb88 ffff8810320bc5f8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] ? zio_wait_for_children+0x63/0x80 [zfs] 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881032c3de20 0000000000000046 ffff881032c3dde8 ffff881032c3dde4 2014-01-07 19:06:07 0000000000000000 ffff88083fe82a00 ffff88085c416740 000000000000ad64 2014-01-07 19:06:07 ffff881031a91af8 ffff881032c3dfd8 000000000000fb88 ffff881031a91af8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88102fa0be20 0000000000000046 ffff88102fa0bde8 ffff88102fa0bde4 2014-01-07 19:06:07 0000000000004000 ffff88083fe82c00 ffff88085c416740 000000000000ad64 2014-01-07 19:06:07 ffff881031a91098 ffff88102fa0bfd8 000000000000fb88 ffff881031a91098 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881031937e20 0000000000000046 0000000000000000 ffff881031937de4 2014-01-07 19:06:07 0000000000004000 ffff88083fe82e00 ffff88085c416740 000000000000ad64 2014-01-07 19:06:07 ffff881031a90638 ffff881031937fd8 000000000000fb88 ffff881031a90638 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88102e939e20 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:07 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:07 ffff881031303ab8 ffff88102e939fd8 000000000000fb88 ffff881031303ab8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88103190fe20 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:07 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:07 ffff881031303058 ffff88103190ffd8 000000000000fb88 ffff881031303058 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88103021de20 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:07 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:07 ffff8810313025f8 ffff88103021dfd8 000000000000fb88 ffff8810313025f8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881031ad5e20 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:07 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:07 ffff881030911af8 ffff881031ad5fd8 000000000000fb88 ffff881030911af8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881030037e20 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:07 0000000000000000 ffff880831b74e70 ffff881030037de0 ffffffff81051439 2014-01-07 19:06:07 ffff881030911098 ffff881030037fd8 000000000000fb88 ffff881030911098 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:07 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881031939e20 0000000000000046 0000000000000000 ffff880e8cac5f38 2014-01-07 19:06:07 ffff881031939db0 ffff880e8e78ebe8 0000000000100000 ffff880e8e78ec58 2014-01-07 19:06:07 ffff881030910638 ffff881031939fd8 000000000000fb88 ffff881030910638 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88102ef8de20 0000000000000046 0000000000000000 ffff8806c39e6c58 2014-01-07 19:06:07 ffff88102ef8ddb0 ffff880742456788 0000000000100000 ffff8807424567f8 2014-01-07 19:06:07 ffff881030171ab8 ffff88102ef8dfd8 000000000000fb88 ffff881030171ab8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88103129de20 0000000000000046 0000000000000000 ffff880e8ca47dd8 2014-01-07 19:06:07 ffff88103129ddb0 ffff8806c2da3bc8 0000000000100000 ffff8806c2da3c38 2014-01-07 19:06:07 ffff881030171058 ffff88103129dfd8 000000000000fb88 ffff881030171058 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881033113e20 0000000000000046 0000000000000000 ffff880e90f8a1f8 2014-01-07 19:06:07 ffff881033113db0 ffff880e8d097048 0000000000100000 ffff880e8d0970b8 2014-01-07 19:06:07 ffff8810301705f8 ffff881033113fd8 000000000000fb88 ffff8810301705f8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88103194fe20 0000000000000046 0000000000000000 ffff8807010467f8 2014-01-07 19:06:07 ffff88103194fdb0 ffff880e841a5a68 0000000000100000 ffff880e841a5ad8 2014-01-07 19:06:07 ffff881030965af8 ffff88103194ffd8 000000000000fb88 ffff881030965af8 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff88102f341e20 0000000000000046 0000000000000000 ffff880701dbcdb8 2014-01-07 19:06:07 ffff88102f341db0 ffff880e81851008 0000000000100000 ffff880e81851078 2014-01-07 19:06:07 ffff881030965098 ffff88102f341fd8 000000000000fb88 ffff881030965098 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:07 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:07 [] kthread+0x96/0xa0 2014-01-07 19:06:07 [] child_rip+0xa/0x20 2014-01-07 19:06:07 [] ? kthread+0x0/0xa0 2014-01-07 19:06:07 [] ? child_rip+0x0/0x20 2014-01-07 19:06:07 ffff881031189e20 0000000000000046 0000000000000000 ffff880e84044db8 2014-01-07 19:06:07 ffff881031189db0 ffff880e8c4cda68 0000000000100000 ffff880e8c4cdad8 2014-01-07 19:06:07 ffff881030964638 ffff881031189fd8 000000000000fb88 ffff881030964638 2014-01-07 19:06:07 Call Trace: 2014-01-07 19:06:07 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:07 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff8810332a9e20 0000000000000046 0000000000000000 ffff880e80d03378 2014-01-07 19:06:08 ffff8810332a9db0 ffff880e805ad608 0000000000100000 ffff880e805ad678 2014-01-07 19:06:08 ffff881030813ab8 ffff8810332a9fd8 000000000000fb88 ffff881030813ab8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff8810311e5e20 0000000000000046 0000000000000000 ffff8807411c07b8 2014-01-07 19:06:08 ffff8810311e5db0 ffff8806c2da18c8 0000000000100000 ffff8806c2da1938 2014-01-07 19:06:08 ffff881030813058 ffff8810311e5fd8 000000000000fb88 ffff881030813058 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff8810331abe20 0000000000000046 0000000000000000 ffff880e8e9e7978 2014-01-07 19:06:08 ffff8810331abdb0 ffff880656edf048 0000000000100000 ffff880656edf0b8 2014-01-07 19:06:08 ffff8810308125f8 ffff8810331abfd8 000000000000fb88 ffff8810308125f8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff88103094fe20 0000000000000046 0000000000000000 ffff880e8f6344f8 2014-01-07 19:06:08 ffff88103094fdb0 ffff880e8d096788 0000000000100000 ffff880e8d0967f8 2014-01-07 19:06:08 ffff88103094daf8 ffff88103094ffd8 000000000000fb88 ffff88103094daf8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881030acde20 0000000000000046 0000000000000000 ffff880e81a6a1f8 2014-01-07 19:06:08 ffff881030acddb0 ffff8806c3149468 0000000000100000 ffff8806c31494d8 2014-01-07 19:06:08 ffff88103094d098 ffff881030acdfd8 000000000000fb88 ffff88103094d098 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881030acfe20 0000000000000046 0000000000000000 ffff88049079d678 2014-01-07 19:06:08 ffff881030acfdb0 ffff880e86536328 0000000000100000 ffff880e86536398 2014-01-07 19:06:08 ffff88103094c638 ffff881030acffd8 000000000000fb88 ffff88103094c638 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881030b5be20 0000000000000046 0000000000000000 ffff880729d82ab8 2014-01-07 19:06:08 ffff881030b5bdb0 ffff8807982c5a68 0000000000100000 ffff8807982c5ad8 2014-01-07 19:06:08 ffff881030b59ab8 ffff881030b5bfd8 000000000000fb88 ffff881030b59ab8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881031d37e20 0000000000000046 0000000000000000 ffff880e8e1f67f8 2014-01-07 19:06:08 ffff881031d37db0 ffff880611913bc8 0000000000100000 ffff880611913c38 2014-01-07 19:06:08 ffff881030b59058 ffff881031d37fd8 000000000000fb88 ffff881030b59058 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff8810301ade20 0000000000000046 0000000000000000 ffff880725d5f978 2014-01-07 19:06:08 ffff8810301addb0 ffff880e80dc48e8 0000000000100000 ffff880e80dc4958 2014-01-07 19:06:08 ffff881030b585f8 ffff8810301adfd8 000000000000fb88 ffff881030b585f8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881031a61e20 0000000000000046 0000000000000000 ffff8810301af578 2014-01-07 19:06:08 0000000000000000 ffff8800446367a8 0000000000000001 ffff880044636740 2014-01-07 19:06:08 ffff8810301afaf8 ffff881031a61fd8 000000000000fb88 ffff8810301afaf8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff88102efe5e20 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:08 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2014-01-07 19:06:08 ffff8810301af098 ffff88102efe5fd8 000000000000fb88 ffff8810301af098 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff88103083de20 0000000000000046 0000000000000000 ffff8810301ae0b8 2014-01-07 19:06:08 0000000000000000 ffff8800446367a8 0000000000000001 ffff880044636740 2014-01-07 19:06:08 ffff8810301ae638 ffff88103083dfd8 000000000000fb88 ffff8810301ae638 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881034db1e20 0000000000000046 ffff881034db1da0 ffff88103083f538 2014-01-07 19:06:08 0000000000000000 ffff8800446367a8 0000000000000001 ffff880044636740 2014-01-07 19:06:08 ffff88103083fab8 ffff881034db1fd8 000000000000fb88 ffff88103083fab8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881034db5e20 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:08 0000000000000000 ffff880828801570 ffff881034db5de0 ffffffff81051439 2014-01-07 19:06:08 ffff88103083f058 ffff881034db5fd8 000000000000fb88 ffff88103083f058 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:08 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff881034db7e20 0000000000000046 ffff881034db7db0 ffffffffa0513e9b 2014-01-07 19:06:08 ffff881034db7de0 ffff880611911a80 0000000000000008 ffff8807d3433000 2014-01-07 19:06:08 ffff88103083e5f8 ffff881034db7fd8 000000000000fb88 ffff88103083e5f8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff88103131be20 0000000000000046 ffff88103131bdb0 ffffffffa0513e9b 2014-01-07 19:06:08 ffff88103131bde0 ffff8806119134c0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:08 ffff881031319af8 ffff88103131bfd8 000000000000fb88 ffff881031319af8 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:08 ffff88103131fe20 0000000000000046 ffff88103131fdb0 ffffffffa0513e9b 2014-01-07 19:06:08 ffff88103131fde0 ffff880611916da0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:08 ffff881031319098 ffff88103131ffd8 000000000000fb88 ffff881031319098 2014-01-07 19:06:08 Call Trace: 2014-01-07 19:06:08 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:08 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:08 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:08 [] kthread+0x96/0xa0 2014-01-07 19:06:08 [] child_rip+0xa/0x20 2014-01-07 19:06:08 [] ? kthread+0x0/0xa0 2014-01-07 19:06:08 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810311d1e20 0000000000000046 ffff880554f4bd80 ffff880e8d091a80 2014-01-07 19:06:09 ffff8810311d1de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff881031318638 ffff8810311d1fd8 000000000000fb88 ffff881031318638 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810311d7e20 0000000000000046 ffff880554f4bd80 ffff880611913920 2014-01-07 19:06:09 ffff8810311d7de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff8810311d5ab8 ffff8810311d7fd8 000000000000fb88 ffff8810311d5ab8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff88103123be20 0000000000000046 ffff88103123bdb0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff88103123bde0 ffff880e8d0904a0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff8810311d5058 ffff88103123bfd8 000000000000fb88 ffff8810311d5058 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff88103123de20 0000000000000046 ffff880554f4bd80 ffff880e8d0927a0 2014-01-07 19:06:09 ffff88103123dde0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff8810311d45f8 ffff88103123dfd8 000000000000fb88 ffff8810311d45f8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff881031ce9e20 0000000000000046 ffff881031ce9db0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff881031ce9de0 ffff880611914aa0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff88103123faf8 ffff881031ce9fd8 000000000000fb88 ffff88103123faf8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff881031cede20 0000000000000046 ffff880554f4bd80 ffff880e8d0964e0 2014-01-07 19:06:09 ffff881031cedde0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff88103123f098 ffff881031cedfd8 000000000000fb88 ffff88103123f098 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff881031cefe20 0000000000000046 ffff881031cefdb0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff881031cefde0 ffff8806119164e0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff88103123e638 ffff881031ceffd8 000000000000fb88 ffff88103123e638 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff881031203e20 0000000000000046 ffff880554f4bd80 ffff880611915360 2014-01-07 19:06:09 ffff881031203de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff881031201ab8 ffff881031203fd8 000000000000fb88 ffff881031201ab8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810310e9e20 0000000000000046 ffff8810310e9db0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff8810310e9de0 ffff880611911620 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff881031201058 ffff8810310e9fd8 000000000000fb88 ffff881031201058 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810310ebe20 0000000000000046 ffff880554f4bd80 ffff8806119164e0 2014-01-07 19:06:09 ffff8810310ebde0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff8810312005f8 ffff8810310ebfd8 000000000000fb88 ffff8810312005f8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810310efe20 0000000000000046 ffff8810310efdb0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff8810310efde0 ffff880611914640 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff8810310edaf8 ffff8810310effd8 000000000000fb88 ffff8810310edaf8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810058b3e20 0000000000000046 ffff880554f4bd80 ffff880611913060 2014-01-07 19:06:09 ffff8810058b3de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff8810310ed098 ffff8810058b3fd8 000000000000fb88 ffff8810310ed098 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810058b5e20 0000000000000046 ffff880554f4bd80 ffff880611917660 2014-01-07 19:06:09 ffff8810058b5de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff8810310ec638 ffff8810058b5fd8 000000000000fb88 ffff8810310ec638 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff881030089e20 0000000000000046 ffff881030089db0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff881030089de0 ffff880611913060 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff8810058b7ab8 ffff881030089fd8 000000000000fb88 ffff8810058b7ab8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff88103008de20 0000000000000046 ffff88103008ddb0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff88103008dde0 ffff880e8d093d80 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff8810058b7058 ffff88103008dfd8 000000000000fb88 ffff8810058b7058 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff881031149e20 0000000000000046 ffff881031149db0 ffffffffa0513e9b 2014-01-07 19:06:09 ffff881031149de0 ffff880611915360 0000000000000008 ffff8807d3433000 2014-01-07 19:06:09 ffff8810058b65f8 ffff881031149fd8 000000000000fb88 ffff8810058b65f8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff88103114de20 0000000000000046 ffff880554f4bd80 ffff880611911a80 2014-01-07 19:06:09 ffff88103114dde0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:09 ffff88103114baf8 ffff88103114dfd8 000000000000fb88 ffff88103114baf8 2014-01-07 19:06:09 Call Trace: 2014-01-07 19:06:09 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:09 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:09 [] kthread+0x96/0xa0 2014-01-07 19:06:09 [] child_rip+0xa/0x20 2014-01-07 19:06:09 [] ? kthread+0x0/0xa0 2014-01-07 19:06:09 [] ? child_rip+0x0/0x20 2014-01-07 19:06:09 ffff8810058c1e20 0000000000000046 ffff880554f4bd80 ffff8806119141e0 2014-01-07 19:06:10 ffff8810058c1de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff88103114b098 ffff8810058c1fd8 000000000000fb88 ffff88103114b098 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058c3e20 0000000000000046 ffff880554f4bd80 ffff880e8d0911c0 2014-01-07 19:06:10 ffff8810058c3de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff88103114a638 ffff8810058c3fd8 000000000000fb88 ffff88103114a638 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058c7e20 0000000000000046 ffff8810058c7db0 ffffffffa0513e9b 2014-01-07 19:06:10 ffff8810058c7de0 ffff880611913920 0000000000000008 ffff8807d3433000 2014-01-07 19:06:10 ffff8810058c5ab8 ffff8810058c7fd8 000000000000fb88 ffff8810058c5ab8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058cbe20 0000000000000046 ffff8810058cbdb0 ffffffffa0513e9b 2014-01-07 19:06:10 ffff8810058cbde0 ffff880e8d095360 0000000000000008 ffff8807d3433000 2014-01-07 19:06:10 ffff8810058c5058 ffff8810058cbfd8 000000000000fb88 ffff8810058c5058 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058cde20 0000000000000046 ffff880554f4bd80 ffff880611910040 2014-01-07 19:06:10 ffff8810058cdde0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058c45f8 ffff8810058cdfd8 000000000000fb88 ffff8810058c45f8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058d3e20 0000000000000046 ffff880554f4bd80 ffff8806119134c0 2014-01-07 19:06:10 ffff8810058d3de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058d1af8 ffff8810058d3fd8 000000000000fb88 ffff8810058d1af8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058d7e20 0000000000000046 ffff880554f4bd80 ffff880611914640 2014-01-07 19:06:10 ffff8810058d7de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058d1098 ffff8810058d7fd8 000000000000fb88 ffff8810058d1098 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058d9e20 0000000000000046 ffff8810058d9db0 ffffffffa0513e9b 2014-01-07 19:06:10 ffff8810058d9de0 ffff8806119141e0 0000000000000008 ffff8807d3433000 2014-01-07 19:06:10 ffff8810058d0638 ffff8810058d9fd8 000000000000fb88 ffff8810058d0638 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? spa_taskq_dispatch_ent+0x6b/0xa0 [zfs] 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058dde20 0000000000000046 ffff880554f4bd80 ffff8807bdd67ac0 2014-01-07 19:06:10 ffff8810058ddde0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058dbab8 ffff8810058ddfd8 000000000000fb88 ffff8810058dbab8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058e1e20 0000000000000046 ffff880554f4bd80 ffff880611911620 2014-01-07 19:06:10 ffff8810058e1de0 ffff880554f4c058 0000000000100000 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058db058 ffff8810058e1fd8 000000000000fb88 ffff8810058db058 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058e3e20 0000000000000046 ffff8810058e3d80 ffffffff8150f79b 2014-01-07 19:06:10 ffff8810058e3de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058da5f8 ffff8810058e3fd8 000000000000fb88 ffff8810058da5f8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? mutex_unlock+0x1b/0x20 2014-01-07 19:06:10 scsi host6: SRP abort called 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058e7e20 0000000000000046 ffff880554f4bd80 ffff880e8d090040 2014-01-07 19:06:10 ffff8810058e7de0 ffff880554f4c058 0000000000000003 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058e5af8 ffff8810058e7fd8 000000000000fb88 ffff8810058e5af8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058ede20 0000000000000046 ffff8810058edd90 ffffffff81096db6 2014-01-07 19:06:10 0000000000000000 ffff880828801270 ffff8810058edde0 ffffffff81051439 2014-01-07 19:06:10 ffff8810058e5098 ffff8810058edfd8 000000000000fb88 ffff8810058e5098 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:10 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058efe20 0000000000000046 ffff8810058efd90 ffffffff81096db6 2014-01-07 19:06:10 0000000000000000 ffff880828801370 ffff8810058efde0 ffffffff81051439 2014-01-07 19:06:10 ffff8810058e4638 ffff8810058effd8 000000000000fb88 ffff8810058e4638 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:10 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058f3e20 0000000000000046 ffff8810058f3d90 ffffffff81096db6 2014-01-07 19:06:10 0000000000000000 ffff880828801970 ffff8810058f3de0 ffffffff81051439 2014-01-07 19:06:10 ffff8810058f1ab8 ffff8810058f3fd8 000000000000fb88 ffff8810058f1ab8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:10 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058f7e20 0000000000000046 ffff8810058f7da0 ffffffffa0529896 2014-01-07 19:06:10 ffff8810058f7de0 ffff880e8e80ac00 ffff88080e9ed000 0000000000000001 2014-01-07 19:06:10 ffff8810058f1058 ffff8810058f7fd8 000000000000fb88 ffff8810058f1058 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] ? vdev_disk_io_start+0x146/0x1a0 [zfs] 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:10 ffff8810058f9e20 0000000000000046 ffff880e8e80ac00 ffff880e8e80af18 2014-01-07 19:06:10 ffff8810058f9db0 ffff880554f4c028 0000000000100000 ffff880554f4c098 2014-01-07 19:06:10 ffff8810058f05f8 ffff8810058f9fd8 000000000000fb88 ffff8810058f05f8 2014-01-07 19:06:10 Call Trace: 2014-01-07 19:06:10 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:10 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:10 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:10 [] kthread+0x96/0xa0 2014-01-07 19:06:10 [] child_rip+0xa/0x20 2014-01-07 19:06:10 [] ? kthread+0x0/0xa0 2014-01-07 19:06:10 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881005901e20 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:11 0000000000000000 ffff8807d3498430 ffff881005901de0 ffffffff81051439 2014-01-07 19:06:11 ffff8810058fd058 ffff881005901fd8 000000000000fb88 ffff8810058fd058 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:11 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:11 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881005907d70 0000000000000046 0000000000000000 ffff881000000001 2014-01-07 19:06:11 0000000100000000 0000000000000001 ffff881005907d50 ffffffff8150fb00 2014-01-07 19:06:11 ffff8810058fc5f8 ffff881005907fd8 000000000000fb88 ffff8810058fc5f8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ? __mutex_lock_slowpath+0x70/0x180 2014-01-07 19:06:11 [] cv_wait_common+0xed/0x100 [spl] 2014-01-07 19:06:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:11 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:11 [] __cv_wait_interruptible+0x15/0x20 [spl] 2014-01-07 19:06:11 [] txg_thread_wait+0x1d/0x40 [zfs] 2014-01-07 19:06:11 [] txg_quiesce_thread+0x2bc/0x2d0 [zfs] 2014-01-07 19:06:11 [] ? txg_quiesce_thread+0x0/0x2d0 [zfs] 2014-01-07 19:06:11 [] thread_generic_wrapper+0x5f/0x70 [spl] 2014-01-07 19:06:11 [] ? thread_generic_wrapper+0x0/0x70 [spl] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff88100590bba0 0000000000000046 ffff88100590bb68 ffff88100590bb64 2014-01-07 19:06:11 ffff88100590bb10 ffff88083fe81200 ffff880044616740 0000000000000207 2014-01-07 19:06:11 ffff881005909af8 ffff88100590bfd8 000000000000fb88 ffff881005909af8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] io_schedule+0x73/0xc0 2014-01-07 19:06:11 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:11 [] dsl_pool_sync+0xf4/0x540 [zfs] 2014-01-07 19:06:11 [] spa_sync+0x40e/0xa00 [zfs] 2014-01-07 19:06:11 [] ? read_tsc+0x9/0x20 2014-01-07 19:06:11 [] ? read_tsc+0x9/0x20 2014-01-07 19:06:11 [] txg_sync_thread+0x27a/0x4b0 [zfs] 2014-01-07 19:06:11 [] ? txg_sync_thread+0x0/0x4b0 [zfs] 2014-01-07 19:06:11 [] thread_generic_wrapper+0x5f/0x70 [spl] 2014-01-07 19:06:11 [] ? thread_generic_wrapper+0x0/0x70 [spl] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881031367e60 0000000000000046 0000000000000000 ffff881031367e80 2014-01-07 19:06:11 ffff881031214ae0 ffff881031214ae0 ffff881031367e30 ffffffffa03897b1 2014-01-07 19:06:11 ffff881031215098 ffff881031367fd8 000000000000fb88 ffff881031215098 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:11 [] obd_zombie_impexp_thread+0xd9/0x190 [obdclass] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? obd_zombie_impexp_thread+0x0/0x190 [obdclass] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881031e0fde0 0000000000000046 0000000000000000 ffff881037cd0280 2014-01-07 19:06:11 ffff881031e0fd50 ffff881031214878 0000000000000000 ffff881031214080 2014-01-07 19:06:11 ffff881031214638 ffff881031e0ffd8 000000000000fb88 ffff881031214638 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff88102f3bbde0 0000000000000046 0000000000000000 0000000a00000003 2014-01-07 19:06:11 ffff88102f3bbd50 ffff88102fbb9cf8 0000000000000000 ffff88102fbb9500 2014-01-07 19:06:11 ffff88102fbb9ab8 ffff88102f3bbfd8 000000000000fb88 ffff88102fbb9ab8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881031c11de0 0000000000000046 0000000000000000 0000000a00000003 2014-01-07 19:06:11 ffff881031c11d50 ffff88102fbb9298 0000000000000000 ffff88102fbb8aa0 2014-01-07 19:06:11 ffff88102fbb9058 ffff881031c11fd8 000000000000fb88 ffff88102fbb9058 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff88100595dde0 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:11 ffff88100595dd50 ffffffffa096c398 ffff88100595dda0 ffffffff81051439 2014-01-07 19:06:11 ffff88102fbb85f8 ffff88100595dfd8 000000000000fb88 ffff88102fbb85f8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:11 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff88100595bde0 0000000000000046 0000000000000000 ffff88100595bd30 2014-01-07 19:06:11 ffff88100595bd50 ffff881005961d38 0000000000000000 ffff881005961540 2014-01-07 19:06:11 ffff881005961af8 ffff88100595bfd8 000000000000fb88 ffff881005961af8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff8810318b7de0 0000000000000046 0000000000000000 ffff8810318b7d30 2014-01-07 19:06:11 ffff8810318b7d50 ffff8810059612d8 0000000000000000 ffff881005960ae0 2014-01-07 19:06:11 ffff881005961098 ffff8810318b7fd8 000000000000fb88 ffff881005961098 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff8810319a7de0 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:11 ffff8810319a7d50 ffffffffa096c398 ffff8810319a7da0 ffffffff81051439 2014-01-07 19:06:11 ffff881005960638 ffff8810319a7fd8 000000000000fb88 ffff881005960638 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:11 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881031bc3de0 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:11 ffff881031bc3d50 ffffffffa096c398 ffff881031bc3da0 ffffffff81051439 2014-01-07 19:06:11 ffff881030219ab8 ffff881031bc3fd8 000000000000fb88 ffff881030219ab8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:11 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff8810303d7de0 0000000000000046 0000000000000000 ffff8810303d7d30 2014-01-07 19:06:11 ffff8810303d7d50 ffff881030219298 0000000000000000 ffff881030218aa0 2014-01-07 19:06:11 ffff881030219058 ffff8810303d7fd8 000000000000fb88 ffff881030219058 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff8810331afde0 0000000000000046 0000000000000000 ffff8810331afd30 2014-01-07 19:06:11 ffff8810331afd50 ffff881030218838 0000000000000000 ffff881030218040 2014-01-07 19:06:11 ffff8810302185f8 ffff8810331affd8 000000000000fb88 ffff8810302185f8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881005945de0 0000000000000046 0000000000000000 ffff881005945d30 2014-01-07 19:06:11 ffff881005945d50 ffff8810301cbd38 0000000000000000 ffff8810301cb540 2014-01-07 19:06:11 ffff8810301cbaf8 ffff881005945fd8 000000000000fb88 ffff8810301cbaf8 2014-01-07 19:06:11 Call Trace: 2014-01-07 19:06:11 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:11 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:11 [] kthread+0x96/0xa0 2014-01-07 19:06:11 [] child_rip+0xa/0x20 2014-01-07 19:06:11 [] ? kthread+0x0/0xa0 2014-01-07 19:06:11 [] ? child_rip+0x0/0x20 2014-01-07 19:06:11 ffff881005969de0 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:12 ffff881005969d50 ffffffffa096c398 ffff881005969da0 ffffffff81051439 2014-01-07 19:06:12 ffff8810301cb098 ffff881005969fd8 000000000000fb88 ffff8810301cb098 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:12 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:12 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881030163de0 0000000000000046 0000000000000000 ffff881030163d30 2014-01-07 19:06:12 ffff881030163d50 ffff8810301ca878 0000000000000000 ffff8810301ca080 2014-01-07 19:06:12 ffff8810301ca638 ffff881030163fd8 000000000000fb88 ffff8810301ca638 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff8810311e7de0 0000000000000046 0000000000000000 ffff8810311e7d30 2014-01-07 19:06:12 ffff8810311e7d50 ffff881030b5fcf8 0000000000000000 ffff881030b5f500 2014-01-07 19:06:12 ffff881030b5fab8 ffff8810311e7fd8 000000000000fb88 ffff881030b5fab8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff88100590fde0 0000000000000046 0000000000000000 ffff88100590fd30 2014-01-07 19:06:12 ffff88100590fd50 ffff881030b5f298 0000000000000000 ffff881030b5eaa0 2014-01-07 19:06:12 ffff881030b5f058 ffff88100590ffd8 000000000000fb88 ffff881030b5f058 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff88102f3bdde0 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:12 ffff88102f3bdd50 ffffffffa096c398 ffff88102f3bdda0 ffffffff81051439 2014-01-07 19:06:12 ffff881030b5e5f8 ffff88102f3bdfd8 000000000000fb88 ffff881030b5e5f8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:12 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:12 [] ptlrpc_hr_main+0x14a/0x750 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpc_hr_main+0x0/0x750 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff8810059d1d50 0000000000000046 ffff8810059d1d18 ffff8810059d1d14 2014-01-07 19:06:12 ffff8810059d1d50 ffff88083fe82a00 ffff880044616740 0000000000000406 2014-01-07 19:06:12 ffff881005997af8 ffff8810059d1fd8 000000000000fb88 ffff881005997af8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff88100599dd50 0000000000000046 0000000000000028 ffff88100599dd90 2014-01-07 19:06:12 ffff88100599dd50 0000082000000000 0000000000000010 ffff88100599ddb0 2014-01-07 19:06:12 ffff881005997098 ffff88100599dfd8 000000000000fb88 ffff881005997098 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881005975d50 0000000000000046 0000000000000028 ffff881005975d90 2014-01-07 19:06:12 ffff881005975d50 0000082000000000 0000000000000010 ffff881005975db0 2014-01-07 19:06:12 ffff881005996638 ffff881005975fd8 000000000000fb88 ffff881005996638 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881030adfd50 0000000000000046 ffff881030adfd18 ffff881030adfd14 2014-01-07 19:06:12 ffff881030adfd50 ffff88083fe82400 ffff880044616740 0000000000000406 2014-01-07 19:06:12 ffff881005911ab8 ffff881030adffd8 000000000000fb88 ffff881005911ab8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881005965d50 0000000000000046 0000000000000028 ffff881005965d90 2014-01-07 19:06:12 ffff881005965d50 0000082000000000 0000000000000010 ffff881005965db0 2014-01-07 19:06:12 ffff881005911058 ffff881005965fd8 000000000000fb88 ffff881005911058 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881005967d50 0000000000000046 0000000000000028 ffff881005967d90 2014-01-07 19:06:12 ffff881005967d50 0000082000000000 0000000000000010 ffff881005967db0 2014-01-07 19:06:12 ffff8810059105f8 ffff881005967fd8 000000000000fb88 ffff8810059105f8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff88102efa3d50 0000000000000046 0000000000000000 ffff88102efa3d14 2014-01-07 19:06:12 ffff881000000000 ffff88083fe81600 ffff880044616740 000000000000015a 2014-01-07 19:06:12 ffff88102efa1af8 ffff88102efa3fd8 000000000000fb88 ffff88102efa1af8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881030adbd50 0000000000000046 ffff881030adbd18 ffff881030adbd14 2014-01-07 19:06:12 ffff881030adbd50 ffff88083fe82400 ffff880044616740 0000000000000406 2014-01-07 19:06:12 ffff88102efa1098 ffff881030adbfd8 000000000000fb88 ffff88102efa1098 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881005971d50 0000000000000046 0000000000000028 ffff881005971d90 2014-01-07 19:06:12 ffff881005971d50 0000082000000000 0000000000000010 ffff881005971db0 2014-01-07 19:06:12 ffff88102efa0638 ffff881005971fd8 000000000000fb88 ffff88102efa0638 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881005915d50 0000000000000046 0000000000000028 ffff881005915d90 2014-01-07 19:06:12 ffff881005915d50 0000082000000000 0000000000000010 ffff881005915db0 2014-01-07 19:06:12 ffff881005973ab8 ffff881005915fd8 000000000000fb88 ffff881005973ab8 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:12 [] ? kthread+0x0/0xa0 2014-01-07 19:06:12 [] ? child_rip+0x0/0x20 2014-01-07 19:06:12 ffff881005955d50 0000000000000046 ffff881005955d18 ffff881005955d14 2014-01-07 19:06:12 ffff881005955d50 ffff88083fe82e00 ffff880044616740 0000000000000207 2014-01-07 19:06:12 ffff881005973058 ffff881005955fd8 000000000000fb88 ffff881005973058 2014-01-07 19:06:12 Call Trace: 2014-01-07 19:06:12 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:12 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:12 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:12 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:12 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:12 [] kthread+0x96/0xa0 2014-01-07 19:06:12 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff88102fbd9d50 0000000000000046 0000000000000028 ffff88102fbd9d90 2014-01-07 19:06:13 ffff88102fbd9d50 0000082000000000 0000000000000010 ffff88102fbd9db0 2014-01-07 19:06:13 ffff8810059725f8 ffff88102fbd9fd8 000000000000fb88 ffff8810059725f8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff88102ee65d50 0000000000000046 0000000000000028 ffff88102ee65d90 2014-01-07 19:06:13 ffff88102ee65d50 0000082000000000 0000000000000010 ffff88102ee65db0 2014-01-07 19:06:13 ffff88102fbdbaf8 ffff88102ee65fd8 000000000000fb88 ffff88102fbdbaf8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff881005991d50 0000000000000046 0000000000000028 ffff881005991d90 2014-01-07 19:06:13 ffff881005991d50 0000082000000000 0000000000000010 ffff881005991db0 2014-01-07 19:06:13 ffff88102fbdb098 ffff881005991fd8 000000000000fb88 ffff88102fbdb098 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff881005993d50 0000000000000046 ffff881005993d18 ffff881005993d14 2014-01-07 19:06:13 ffff881005993d50 ffff88083fe82000 ffff880044616740 0000000000000606 2014-01-07 19:06:13 ffff88102fbda638 ffff881005993fd8 000000000000fb88 ffff88102fbda638 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff88100599bd50 0000000000000046 0000000000000028 ffff88100599bd90 2014-01-07 19:06:13 ffff88100599bd50 0000082000000000 0000000000000010 ffff88100599bdb0 2014-01-07 19:06:13 ffff881005999ab8 ffff88100599bfd8 000000000000fb88 ffff881005999ab8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff8810059d7d50 0000000000000046 0000000000000028 ffff8810059d7d90 2014-01-07 19:06:13 ffff8810059d7d50 0000082000000000 0000000000000010 ffff8810059d7db0 2014-01-07 19:06:13 ffff881005999058 ffff8810059d7fd8 000000000000fb88 ffff881005999058 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpcd+0x1ec/0x370 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpcd+0x0/0x370 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff881005931d50 0000000000000046 ffff881005931db0 0000000005931d90 2014-01-07 19:06:13 0000000000000000 ffff8807a682fe4c 0000004c00000286 ffffffffa0915cf4 2014-01-07 19:06:13 ffff8810059985f8 ffff881005931fd8 000000000000fb88 ffff8810059985f8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] ptlrpc_pinger_main+0x736/0x820 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? ptlrpc_pinger_main+0x0/0x820 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff8810059afda0 0000000000000046 0000000000000000 0000000000000003 2014-01-07 19:06:13 ffff8810059afd30 0000000000000286 ffff8810059afd40 ffffffff810810cc 2014-01-07 19:06:13 ffff8810059adaf8 ffff8810059affd8 000000000000fb88 ffff8810059adaf8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:06:13 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:13 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:13 [] sec_gc_main+0x277/0x380 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? sec_gc_main+0x0/0x380 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff88100598be50 0000000000000046 0000000000000000 ffffffff81096db6 2014-01-07 19:06:13 0000000000000000 ffffffffa0c4a088 ffff88100598be10 ffffffff81051439 2014-01-07 19:06:13 ffff8810059ad098 ffff88100598bfd8 000000000000fb88 ffff8810059ad098 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:13 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:13 [] capa_thread_main+0x9c3/0xd50 [lustre] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? capa_thread_main+0x0/0xd50 [lustre] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff880ff5445da0 0000000000000046 0000000000000000 ffff880044636740 2014-01-07 19:06:13 0000000000000000 0000000000000001 ffff880ff5445d40 ffffffff81065d54 2014-01-07 19:06:13 ffff881030b8bab8 ffff880ff5445fd8 000000000000fb88 ffff881030b8bab8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ? enqueue_task_fair+0x64/0x100 2014-01-07 19:06:13 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:13 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff880ff5447e20 0000000000000046 0000000000000000 ffffffffa03d44f0 2014-01-07 19:06:13 0000000000000000 0000000000000000 ffff880ff5447da0 ffffffff81063422 2014-01-07 19:06:13 ffff881034217098 ffff880ff5447fd8 000000000000fb88 ffff881034217098 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ? default_wake_function+0x12/0x20 2014-01-07 19:06:13 [] lcw_dispatch_main+0xc9/0x930 [libcfs] 2014-01-07 19:06:13 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:13 [] ? lcw_dispatch_main+0x0/0x930 [libcfs] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff880ff5449da0 0000000000000046 0000000000000000 ffff8807d4349a40 2014-01-07 19:06:13 ffff8807d138f000 0000000000000000 0000000000000001 ffff8810341ba7c0 2014-01-07 19:06:13 ffff8810318a25f8 ffff880ff5449fd8 000000000000fb88 ffff8810318a25f8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff880ff544bda0 0000000000000046 0000000000000000 ffff880805834b40 2014-01-07 19:06:13 ffff8807d138f400 0000000000000000 0000000000000005 ffff8810341ba7c0 2014-01-07 19:06:13 ffff881034de7af8 ffff880ff544bfd8 000000000000fb88 ffff881034de7af8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff880ff544dda0 0000000000000046 0000000000000000 ffff880805834900 2014-01-07 19:06:13 ffff8807d138f400 0000000000000000 0000000000000003 ffff8810341ba7c0 2014-01-07 19:06:13 ffff881031083098 ffff880ff544dfd8 000000000000fb88 ffff881031083098 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:13 [] ? kthread+0x0/0xa0 2014-01-07 19:06:13 [] ? child_rip+0x0/0x20 2014-01-07 19:06:13 ffff880ff544fda0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:13 ffff880ff544fd30 ffff880832574aa0 ffff880ff544fd30 ffffffff8105231d 2014-01-07 19:06:13 ffff8810301505f8 ffff880ff544ffd8 000000000000fb88 ffff8810301505f8 2014-01-07 19:06:13 Call Trace: 2014-01-07 19:06:13 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:13 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:13 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:13 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:13 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:13 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:13 [] kthread+0x96/0xa0 2014-01-07 19:06:13 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff5451da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:14 ffff880ff5451d30 ffff880832574aa0 ffff880ff5451d30 ffffffff8105231d 2014-01-07 19:06:14 ffff88102f0c7af8 ffff880ff5451fd8 000000000000fb88 ffff88102f0c7af8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:14 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff5453da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:14 ffff880ff5453d30 ffff880832574aa0 ffff880ff5453d30 ffffffff8105231d 2014-01-07 19:06:14 ffff881030b4a5f8 ffff880ff5453fd8 000000000000fb88 ffff881030b4a5f8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:14 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff5455da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:14 ffff880ff5455d30 ffff880832574aa0 ffff880ff5455d30 ffffffff8105231d 2014-01-07 19:06:14 ffff88102f87e638 ffff880ff5455fd8 000000000000fb88 ffff88102f87e638 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:14 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff559dda0 0000000000000046 0000000000000000 ffff880831293080 2014-01-07 19:06:14 ffff8807d138f800 0000000000000000 0000000000000032 ffff8810343b6680 2014-01-07 19:06:14 ffff8810318a3ab8 ffff880ff559dfd8 000000000000fb88 ffff8810318a3ab8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff559fda0 0000000000000046 ffff880ff559fd68 ffff880ff559fd64 2014-01-07 19:06:14 ffff8807d138f800 ffff88083fe81400 ffff880044636740 00000000000004fe 2014-01-07 19:06:14 ffff88102f9e85f8 ffff880ff559ffd8 000000000000fb88 ffff88102f9e85f8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55a1da0 0000000000000046 0000000000000000 ffff8807d43495c0 2014-01-07 19:06:14 ffff8807d138f800 0000000000000000 0000000000000034 ffff8810343b6680 2014-01-07 19:06:14 ffff881032c39058 ffff880ff55a1fd8 000000000000fb88 ffff881032c39058 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55a3da0 0000000000000046 0000000000000000 ffff880ff55a3d64 2014-01-07 19:06:14 ffff880ff55a3d30 ffff88083fe81c00 ffff880044696740 0000000000000400 2014-01-07 19:06:14 ffff881031a265f8 ffff880ff55a3fd8 000000000000fb88 ffff881031a265f8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55a7da0 0000000000000046 0000000000000000 ffff880ff55a7d64 2014-01-07 19:06:14 ffff880700000000 ffff88083fe81e00 ffff880044656740 000000000000af5c 2014-01-07 19:06:14 ffff880ff55a5ab8 ffff880ff55a7fd8 000000000000fb88 ffff880ff55a5ab8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55abda0 0000000000000046 0000000000000000 ffff880805834240 2014-01-07 19:06:14 ffff8807d138fc00 0000000000000000 0000000000000004 ffff8810343b6680 2014-01-07 19:06:14 ffff880ff55a5058 ffff880ff55abfd8 000000000000fb88 ffff880ff55a5058 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:14 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55adda0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:14 ffff880ff55add30 ffff880832574aa0 ffff880ff55add30 ffffffff8105231d 2014-01-07 19:06:14 ffff880ff55a45f8 ffff880ff55adfd8 000000000000fb88 ffff880ff55a45f8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:14 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55b1da0 0000000000000046 ffff880ff55b1d68 ffff880ff55b1d64 2014-01-07 19:06:14 ffff880ff541e000 ffff88083fe82400 ffff88085c416740 000000000000ad64 2014-01-07 19:06:14 ffff880ff55afaf8 ffff880ff55b1fd8 000000000000fb88 ffff880ff55afaf8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55b7da0 0000000000000046 0000000000000000 ffff8810341f59c0 2014-01-07 19:06:14 ffff880ff541e000 0000000000000000 0000000000000005 ffff8810343b6680 2014-01-07 19:06:14 ffff880ff55af098 ffff880ff55b7fd8 000000000000fb88 ffff880ff55af098 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:14 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55b9da0 0000000000000046 ffff880f00000010 ffff881031e2fd80 2014-01-07 19:06:14 ffff880ff54aac00 0000000000000000 0000000000000000 ffff8810343b6680 2014-01-07 19:06:14 ffff880ff55ae638 ffff880ff55b9fd8 000000000000fb88 ffff880ff55ae638 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:14 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55dbda0 0000000000000046 ffff880ff55dbd68 ffff880ff55dbd64 2014-01-07 19:06:14 ffff880ff54aac00 ffff88083fe82c00 ffff88085c496740 0000000000000303 2014-01-07 19:06:14 ffff880ff55d9ab8 ffff880ff55dbfd8 000000000000fb88 ffff880ff55d9ab8 2014-01-07 19:06:14 Call Trace: 2014-01-07 19:06:14 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:14 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:14 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:14 [] kthread+0x96/0xa0 2014-01-07 19:06:14 [] child_rip+0xa/0x20 2014-01-07 19:06:14 [] ? kthread+0x0/0xa0 2014-01-07 19:06:14 [] ? child_rip+0x0/0x20 2014-01-07 19:06:14 ffff880ff55dfda0 0000000000000046 0000000000000000 ffff880ff55dfd64 2014-01-07 19:06:15 ffff880f00000000 ffff88083fe82800 ffff880044656740 000000000000ad5c 2014-01-07 19:06:15 ffff880ff55d9058 ffff880ff55dffd8 000000000000fb88 ffff880ff55d9058 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff55e1e40 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:15 0000000000000002 0000000000000000 ffff880ff55e1e10 ffff8800b8bd99c0 2014-01-07 19:06:15 ffff880ff55d85f8 ffff880ff55e1fd8 000000000000fb88 ffff880ff55d85f8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ldlm_bl_thread_main+0x345/0x3c0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ? ldlm_bl_thread_main+0x0/0x3c0 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff55e5e40 0000000000000046 0000000000000000 ffff880ff55e5e04 2014-01-07 19:06:15 0000000000000000 ffff88083fe81200 ffff8800446b6740 0000000000000400 2014-01-07 19:06:15 ffff880ff55e3af8 ffff880ff55e5fd8 000000000000fb88 ffff880ff55e3af8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ldlm_bl_thread_main+0x345/0x3c0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ? ldlm_bl_thread_main+0x0/0x3c0 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff55e9e50 0000000000000046 ffff880ff55e9dc0 ffffffff81096db6 2014-01-07 19:06:15 ffff880ff55e9e10 ffffffffa0964850 ffff880ff55e9e10 ffffffff81051439 2014-01-07 19:06:15 ffff880ff55e3098 ffff880ff55e9fd8 000000000000fb88 ffff880ff55e3098 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? autoremove_wake_function+0x16/0x40 2014-01-07 19:06:15 [] ? __wake_up_common+0x59/0x90 2014-01-07 19:06:15 [] expired_lock_main+0x269/0x860 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ? expired_lock_main+0x0/0x860 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff55edda0 0000000000000046 ffff880ff55edd68 ffff880ff55edd64 2014-01-07 19:06:15 ffff880ff55edd60 ffff88083fe82000 ffff880044616740 0000000000000406 2014-01-07 19:06:15 ffff880ff55e2638 ffff880ff55edfd8 000000000000fb88 ffff880ff55e2638 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:15 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:15 [] ldlm_pools_thread_main+0x1d0/0x2f0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ? ldlm_pools_thread_main+0x0/0x2f0 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff55f1e40 0000000000000046 0000000000000000 ffffffff8150f36a 2014-01-07 19:06:15 0000000000000000 0000000000000286 0000000000000000 dead000000200200 2014-01-07 19:06:15 ffff880ff55efab8 ffff880ff55f1fd8 000000000000fb88 ffff880ff55efab8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? schedule_timeout+0x19a/0x2e0 2014-01-07 19:06:15 [] mgc_requeue_thread+0x4cc/0x700 [mgc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ? mgc_requeue_thread+0x0/0x700 [mgc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff502bda0 0000000000000046 ffff880700000010 ffff8807d4349440 2014-01-07 19:06:15 ffff8807d0cf2000 0000000000000000 000000000000002e ffff8810343b6580 2014-01-07 19:06:15 ffff880ff55ee5f8 ffff880ff502bfd8 000000000000fb88 ffff880ff55ee5f8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:15 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff505fda0 0000000000000046 0000000000000000 ffff880ff505fd64 2014-01-07 19:06:15 ffff880700000000 ffff88083fe81600 ffff880044616740 0000000000000181 2014-01-07 19:06:15 ffff880ff505daf8 ffff880ff505ffd8 000000000000fb88 ffff880ff505daf8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff5063da0 0000000000000046 0000000000000000 ffff880831d17480 2014-01-07 19:06:15 ffff8807d0cf2000 0000000000000000 0000000000000034 ffff8810343b6580 2014-01-07 19:06:15 ffff880ff505d098 ffff880ff5063fd8 000000000000fb88 ffff880ff505d098 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff5065da0 0000000000000046 0000000000000000 ffff880ff5065d64 2014-01-07 19:06:15 ffff880700000000 ffff88083fe81800 ffff880044616740 0000000000000181 2014-01-07 19:06:15 ffff880ff505c638 ffff880ff5065fd8 000000000000fb88 ffff880ff505c638 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 scsi host6: SRP abort called 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff506bda0 0000000000000046 ffff880ff506bd68 ffff880ff506bd64 2014-01-07 19:06:15 ffff8807d0cf2400 ffff88083fe81e00 ffff880044696740 0000000000000400 2014-01-07 19:06:15 ffff880ff5069ab8 ffff880ff506bfd8 000000000000fb88 ffff880ff5069ab8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff506fda0 0000000000000046 0000000000000010 ffff8807d3f6fa80 2014-01-07 19:06:15 ffff8807d0cf2400 0000000000000000 0000000000000048 ffff8810343b6580 2014-01-07 19:06:15 ffff880ff5069058 ffff880ff506ffd8 000000000000fb88 ffff880ff5069058 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:15 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff5071da0 0000000000000046 0000000000000000 ffff88103225c140 2014-01-07 19:06:15 ffff880ff54aa000 0000000000000000 0000000000000010 ffff8810343b6580 2014-01-07 19:06:15 ffff880ff50685f8 ffff880ff5071fd8 000000000000fb88 ffff880ff50685f8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff5097da0 0000000000000046 0000000000000000 ffff880ff5097d64 2014-01-07 19:06:15 ffff880f00000000 ffff88083fe82600 ffff88085c4b6740 0000000000000400 2014-01-07 19:06:15 ffff880ff5095af8 ffff880ff5097fd8 000000000000fb88 ffff880ff5095af8 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff509bda0 0000000000000046 ffff880ff509bd68 ffff880ff509bd64 2014-01-07 19:06:15 ffff880ff54aa000 ffff88083fe82000 ffff880044616740 0000000000000207 2014-01-07 19:06:15 ffff880ff5095098 ffff880ff509bfd8 000000000000fb88 ffff880ff5095098 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:15 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:15 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:15 [] kthread+0x96/0xa0 2014-01-07 19:06:15 [] child_rip+0xa/0x20 2014-01-07 19:06:15 [] ? kthread+0x0/0xa0 2014-01-07 19:06:15 [] ? child_rip+0x0/0x20 2014-01-07 19:06:15 ffff880ff50a5da0 0000000000000046 0000000000000000 ffff881031e2f780 2014-01-07 19:06:15 ffff880ff5709c00 0000000000000000 000000000000005e ffff8810343b6580 2014-01-07 19:06:15 ffff880ff5094638 ffff880ff50a5fd8 000000000000fb88 ffff880ff5094638 2014-01-07 19:06:15 Call Trace: 2014-01-07 19:06:15 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:15 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff50adda0 0000000000000046 ffff880ff50add68 ffff880ff50add64 2014-01-07 19:06:16 ffff880ff5709c00 ffff88083fe82a00 ffff880044616740 0000000000000207 2014-01-07 19:06:16 ffff880ff50a7ab8 ffff880ff50adfd8 000000000000fb88 ffff880ff50a7ab8 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff50b3da0 0000000000000046 ffff880ff50b3d68 ffff880ff50b3d64 2014-01-07 19:06:16 ffff880f00000000 ffff88083fe82c00 ffff88085c4b6740 0000000000000400 2014-01-07 19:06:16 ffff880ff50a7058 ffff880ff50b3fd8 000000000000fb88 ffff880ff50a7058 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff527fda0 0000000000000046 0000000000000000 ffff880831d17540 2014-01-07 19:06:16 ffff8807d0cf2800 0000000000000000 0000000000000006 ffff8810338650c0 2014-01-07 19:06:16 ffff880ff50a65f8 ffff880ff527ffd8 000000000000fb88 ffff880ff50a65f8 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff5307da0 0000000000000046 0000000000000000 ffff880831d17240 2014-01-07 19:06:16 ffff8807d0cf2800 0000000000000000 0000000000000013 ffff8810338650c0 2014-01-07 19:06:16 ffff880ff5305af8 ffff880ff5307fd8 000000000000fb88 ffff880ff5305af8 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff530bda0 0000000000000046 0000000000000000 ffff8807d3f6fc00 2014-01-07 19:06:16 ffff8807d0cf2c00 0000000000000000 000000000000000f ffff8810338650c0 2014-01-07 19:06:16 ffff880ff5305098 ffff880ff530bfd8 000000000000fb88 ffff880ff5305098 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff530dda0 0000000000000046 0000000000000000 ffff880ff530dd64 2014-01-07 19:06:16 ffff880700000000 ffff88083fe81a00 ffff880044616740 0000000000000181 2014-01-07 19:06:16 ffff880ff5304638 ffff880ff530dfd8 000000000000fb88 ffff880ff5304638 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff5311da0 0000000000000046 0000000000000000 ffff881030991900 2014-01-07 19:06:16 ffff880ff5709800 0000000000000000 000000000000000b ffff8810338650c0 2014-01-07 19:06:16 ffff880ff530fab8 ffff880ff5311fd8 000000000000fb88 ffff880ff530fab8 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff5319da0 0000000000000046 0000000000000000 ffff880ff5319d64 2014-01-07 19:06:16 ffff880ff5709800 ffff88083fe82400 ffff88085c436740 0000000000000400 2014-01-07 19:06:16 ffff880ff530f058 ffff880ff5319fd8 000000000000fb88 ffff880ff530f058 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff5321da0 0000000000000046 0000000000000000 ffff880ff5321d64 2014-01-07 19:06:16 ffff880ff5709400 ffff88083fe82e00 ffff88085c496740 0000000000000400 2014-01-07 19:06:16 ffff880ff530e5f8 ffff880ff5321fd8 000000000000fb88 ffff880ff530e5f8 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff5329da0 0000000000000046 0000000000000000 ffff881031e2f180 2014-01-07 19:06:16 ffff880ff5709400 0000000000000000 0000000000000007 ffff8810338650c0 2014-01-07 19:06:16 ffff880ff5323af8 ffff880ff5329fd8 000000000000fb88 ffff880ff5323af8 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:16 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff4bb1690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:16 ffff880ff4bb16b0 0000000000000001 0000000000000aea ffff880e00000000 2014-01-07 19:06:16 ffff880ff5323098 ffff880ff4bb1fd8 000000000000fb88 ffff880ff5323098 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:16 [] io_schedule+0x73/0xc0 2014-01-07 19:06:16 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:16 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:16 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:16 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:16 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:16 ffff880ff4bb3550 0000000000000046 0000000000000000 0000000000281826 2014-01-07 19:06:16 0000000200003232 0000000affffffff ffffffffffffffff 00000000e65ca2d1 2014-01-07 19:06:16 ffff880ff5322638 ffff880ff4bb3fd8 000000000000fb88 ffff880ff5322638 2014-01-07 19:06:16 Call Trace: 2014-01-07 19:06:16 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:06:16 [] mutex_lock+0x2b/0x50 2014-01-07 19:06:16 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:06:16 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:16 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:16 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:16 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:16 [] kthread+0x96/0xa0 2014-01-07 19:06:16 [] child_rip+0xa/0x20 2014-01-07 19:06:16 [] ? kthread+0x0/0xa0 2014-01-07 19:06:16 [] ? child_rip+0x0/0x20 2014-01-07 19:06:17 ffff880ff4bb7360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:17 ffff880ff4bb72e0 ffffffff8150fa5e ffff880e83e0bd80 ffff880e83e0c098 2014-01-07 19:06:17 ffff880ff4bb5ab8 ffff880ff4bb7fd8 000000000000fb88 ffff880ff4bb5ab8 2014-01-07 19:06:17 Call Trace: 2014-01-07 19:06:17 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:17 [] io_schedule+0x73/0xc0 2014-01-07 19:06:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:17 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:17 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:17 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:17 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:17 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:17 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:17 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:17 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] kthread+0x96/0xa0 2014-01-07 19:06:17 [] child_rip+0xa/0x20 2014-01-07 19:06:17 [] ? kthread+0x0/0xa0 2014-01-07 19:06:17 [] ? child_rip+0x0/0x20 2014-01-07 19:06:17 ffff880ff4bbb690 0000000000000046 ffff880ff4bbb658 ffff880ff4bbb654 2014-01-07 19:06:17 ffff880ff4bbb6b0 ffff88083fe81c00 ffff880044696740 0000000000000400 2014-01-07 19:06:17 ffff880ff4bb5058 ffff880ff4bbbfd8 000000000000fb88 ffff880ff4bb5058 2014-01-07 19:06:17 Call Trace: 2014-01-07 19:06:17 [] io_schedule+0x73/0xc0 2014-01-07 19:06:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] kthread+0x96/0xa0 2014-01-07 19:06:17 [] child_rip+0xa/0x20 2014-01-07 19:06:17 [] ? kthread+0x0/0xa0 2014-01-07 19:06:17 [] ? child_rip+0x0/0x20 2014-01-07 19:06:17 ffff880ff4bbd690 0000000000000046 ffff880ff4bbd6b0 ffffffffa04e97d6 2014-01-07 19:06:17 ffff880ff4bbd6b0 ffffffff00000001 ffff8806f5939510 ffff880700000001 2014-01-07 19:06:17 ffff880ff4bb45f8 ffff880ff4bbdfd8 000000000000fb88 ffff880ff4bb45f8 2014-01-07 19:06:17 Call Trace: 2014-01-07 19:06:17 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:17 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:17 [] io_schedule+0x73/0xc0 2014-01-07 19:06:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] kthread+0x96/0xa0 2014-01-07 19:06:17 [] child_rip+0xa/0x20 2014-01-07 19:06:17 [] ? kthread+0x0/0xa0 2014-01-07 19:06:17 [] ? child_rip+0x0/0x20 2014-01-07 19:06:17 ffff880ff4bc3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:17 ffff880ff4bc36b0 0000000000000001 0000000000000c51 ffff880e00000000 2014-01-07 19:06:17 ffff880ff4bc1af8 ffff880ff4bc3fd8 000000000000fb88 ffff880ff4bc1af8 2014-01-07 19:06:17 Call Trace: 2014-01-07 19:06:17 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:17 [] io_schedule+0x73/0xc0 2014-01-07 19:06:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] kthread+0x96/0xa0 2014-01-07 19:06:17 [] child_rip+0xa/0x20 2014-01-07 19:06:17 [] ? kthread+0x0/0xa0 2014-01-07 19:06:17 [] ? child_rip+0x0/0x20 2014-01-07 19:06:17 ffff880ff4bc7690 0000000000000046 ffff880ff4bc76b0 ffffffffa04e9367 2014-01-07 19:06:17 ffff880ff4bc76b0 0000000000000001 0000000000000ca6 ffff880e00000000 2014-01-07 19:06:17 ffff880ff4bc1098 ffff880ff4bc7fd8 000000000000fb88 ffff880ff4bc1098 2014-01-07 19:06:17 Call Trace: 2014-01-07 19:06:17 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:17 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:17 [] io_schedule+0x73/0xc0 2014-01-07 19:06:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:17 [] kthread+0x96/0xa0 2014-01-07 19:06:17 [] child_rip+0xa/0x20 2014-01-07 19:06:17 [] ? kthread+0x0/0xa0 2014-01-07 19:06:17 [] ? child_rip+0x0/0x20 2014-01-07 19:06:17 ffff880ff4bcd360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:17 ffff880ff4bcd2e0 ffffffff8150fa5e ffff880e78b03d80 ffff880e78b04098 2014-01-07 19:06:17 ffff880ff4bc0638 ffff880ff4bcdfd8 000000000000fb88 ffff880ff4bc0638 2014-01-07 19:06:17 Call Trace: 2014-01-07 19:06:17 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:17 [] io_schedule+0x73/0xc0 2014-01-07 19:06:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:17 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:17 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:17 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:17 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:18 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:18 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:18 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:18 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] kthread+0x96/0xa0 2014-01-07 19:06:18 [] child_rip+0xa/0x20 2014-01-07 19:06:18 [] ? kthread+0x0/0xa0 2014-01-07 19:06:18 [] ? child_rip+0x0/0x20 2014-01-07 19:06:18 ffff880ff4bf5690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:18 ffff880ff4bf56b0 0000000000000001 0000000000000c53 ffff880e00000000 2014-01-07 19:06:18 ffff880ff4bcfab8 ffff880ff4bf5fd8 000000000000fb88 ffff880ff4bcfab8 2014-01-07 19:06:18 Call Trace: 2014-01-07 19:06:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:18 [] io_schedule+0x73/0xc0 2014-01-07 19:06:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] kthread+0x96/0xa0 2014-01-07 19:06:18 [] child_rip+0xa/0x20 2014-01-07 19:06:18 [] ? kthread+0x0/0xa0 2014-01-07 19:06:18 [] ? child_rip+0x0/0x20 2014-01-07 19:06:18 ffff880ff442d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:18 ffff880ff442d6b0 0000000000000001 0000000000000d9e ffff880e00000000 2014-01-07 19:06:18 ffff880ff4bcf058 ffff880ff442dfd8 000000000000fb88 ffff880ff4bcf058 2014-01-07 19:06:18 Call Trace: 2014-01-07 19:06:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:18 [] io_schedule+0x73/0xc0 2014-01-07 19:06:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] kthread+0x96/0xa0 2014-01-07 19:06:18 [] child_rip+0xa/0x20 2014-01-07 19:06:18 [] ? kthread+0x0/0xa0 2014-01-07 19:06:18 [] ? child_rip+0x0/0x20 2014-01-07 19:06:18 ffff880ff442f690 0000000000000046 ffff880ff442f6b0 ffffffffa04e9367 2014-01-07 19:06:18 ffff880ff442f6b0 0000000000000001 0000000000000e95 ffff880700000000 2014-01-07 19:06:18 ffff880ff4bce5f8 ffff880ff442ffd8 000000000000fb88 ffff880ff4bce5f8 2014-01-07 19:06:18 Call Trace: 2014-01-07 19:06:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:18 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:18 [] io_schedule+0x73/0xc0 2014-01-07 19:06:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] kthread+0x96/0xa0 2014-01-07 19:06:18 [] child_rip+0xa/0x20 2014-01-07 19:06:18 [] ? kthread+0x0/0xa0 2014-01-07 19:06:18 [] ? child_rip+0x0/0x20 2014-01-07 19:06:18 ffff880ff444b690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:18 ffff880ff444b6b0 ffffffff00000001 ffff880e80dbf4b0 ffff880e80dbf4a8 2014-01-07 19:06:18 ffff880ff4449af8 ffff880ff444bfd8 000000000000fb88 ffff880ff4449af8 2014-01-07 19:06:18 Call Trace: 2014-01-07 19:06:18 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:18 [] io_schedule+0x73/0xc0 2014-01-07 19:06:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] kthread+0x96/0xa0 2014-01-07 19:06:18 [] child_rip+0xa/0x20 2014-01-07 19:06:18 [] ? kthread+0x0/0xa0 2014-01-07 19:06:18 [] ? child_rip+0x0/0x20 2014-01-07 19:06:18 ffff880ff45efda0 0000000000000046 ffff880ff45efd20 ffffffff81055f96 2014-01-07 19:06:18 ffff880ff45efd30 ffff880832574aa0 ffff880ff45efd30 ffffffff8105231d 2014-01-07 19:06:18 ffff880ff4449098 ffff880ff45effd8 000000000000fb88 ffff880ff4449098 2014-01-07 19:06:18 Call Trace: 2014-01-07 19:06:18 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:18 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:18 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:18 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:18 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:18 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:18 [] kthread+0x96/0xa0 2014-01-07 19:06:18 [] child_rip+0xa/0x20 2014-01-07 19:06:18 [] ? kthread+0x0/0xa0 2014-01-07 19:06:18 [] ? child_rip+0x0/0x20 2014-01-07 19:06:18 ffff880ff46bdda0 0000000000000046 ffff880ff46bdd20 ffffffff81055f96 2014-01-07 19:06:18 ffff880ff46bdd30 ffff880832574aa0 ffff880ff46bdd30 ffffffff8105231d 2014-01-07 19:06:18 ffff880ff4448638 ffff880ff46bdfd8 000000000000fb88 ffff880ff4448638 2014-01-07 19:06:18 Call Trace: 2014-01-07 19:06:18 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:18 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:18 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:18 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:18 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46c1da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:19 ffff880ff46c1d30 ffff880832574aa0 ffff880ff46c1d30 ffffffff8105231d 2014-01-07 19:06:19 ffff880ff46bfab8 ffff880ff46c1fd8 000000000000fb88 ffff880ff46bfab8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:19 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46c5da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:19 ffff880ff46c5d30 ffff880832574aa0 ffff880ff46c5d30 ffffffff8105231d 2014-01-07 19:06:19 ffff880ff46bf058 ffff880ff46c5fd8 000000000000fb88 ffff880ff46bf058 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:19 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46c7da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:19 ffff880ff46c7d30 ffff880832574aa0 ffff880ff46c7d30 ffffffff8105231d 2014-01-07 19:06:19 ffff880ff46be5f8 ffff880ff46c7fd8 000000000000fb88 ffff880ff46be5f8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:19 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46cfda0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:19 ffff880ff46cfd30 ffff880832574aa0 ffff880ff46cfd30 ffffffff8105231d 2014-01-07 19:06:19 ffff880ff46cdaf8 ffff880ff46cffd8 000000000000fb88 ffff880ff46cdaf8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:19 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46d3da0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:19 ffff880ff46d3d30 ffff880832574aa0 ffff880ff46d3d30 ffffffff8105231d 2014-01-07 19:06:19 ffff880ff46cd098 ffff880ff46d3fd8 000000000000fb88 ffff880ff46cd098 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:19 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46dbda0 0000000000000046 0000000000000000 ffffffff81055f96 2014-01-07 19:06:19 ffff880ff46dbd30 ffff880832574aa0 ffff880ff46dbd30 ffffffff8105231d 2014-01-07 19:06:19 ffff880ff46cc638 ffff880ff46dbfd8 000000000000fb88 ffff880ff46cc638 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? enqueue_task+0x66/0x80 2014-01-07 19:06:19 [] ? check_preempt_curr+0x6d/0x90 2014-01-07 19:06:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff46e7e00 0000000000000046 ffff8800446367a8 ffff880ff46e5538 2014-01-07 19:06:19 ffff880ff46e7da0 ffffffff81065463 ffff880ff46e7db0 0000000000000246 2014-01-07 19:06:19 ffff880ff46e5ab8 ffff880ff46e7fd8 000000000000fb88 ffff880ff46e5ab8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? dequeue_entity+0x113/0x2e0 2014-01-07 19:06:19 [] ? ping_evictor_main+0x0/0x650 [ptlrpc] 2014-01-07 19:06:19 [] ping_evictor_main+0x4c3/0x650 [ptlrpc] 2014-01-07 19:06:19 [] ? thread_return+0x4e/0x76e 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? ping_evictor_main+0x0/0x650 [ptlrpc] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 scsi host7: SRP abort called 2014-01-07 19:06:19 ffff880ff4717d40 0000000000000046 0000000000000000 ffff880ff4717d04 2014-01-07 19:06:19 ffff880f00000000 0000000000000282 ffff880ff4717ce0 ffffffff810810cc 2014-01-07 19:06:19 ffff880ff4714638 ffff880ff4717fd8 000000000000fb88 ffff880ff4714638 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] ? lock_timer_base+0x3c/0x70 2014-01-07 19:06:19 [] schedule_timeout+0x192/0x2e0 2014-01-07 19:06:19 [] ? process_timeout+0x0/0x10 2014-01-07 19:06:19 [] qsd_upd_thread+0x94d/0xd10 [lquota] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? qsd_upd_thread+0x0/0xd10 [lquota] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff473fe20 0000000000000046 000000000000000b ffff880ff4378200 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff473fe00 ffff8807cf25e608 2014-01-07 19:06:19 ffff880ff473dab8 ffff880ff473ffd8 000000000000fb88 ffff880ff473dab8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff4743e20 0000000000000046 000000000000000b ffff880ff4099800 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff4743e00 ffff880810f11208 2014-01-07 19:06:19 ffff880ff473d058 ffff880ff4743fd8 000000000000fb88 ffff880ff473d058 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff4745e20 0000000000000046 0000000000000001 ffff880ff21ee800 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff4745e00 ffff880816c8bd48 2014-01-07 19:06:19 ffff880ff473c5f8 ffff880ff4745fd8 000000000000fb88 ffff880ff473c5f8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff4749e20 0000000000000046 0000000000000006 ffff880e7b82a000 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff4749e00 ffff8807d349e188 2014-01-07 19:06:19 ffff880ff4747af8 ffff880ff4749fd8 000000000000fb88 ffff880ff4747af8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff474de20 0000000000000046 000000000000000b ffff880ff4378000 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff474de00 ffff880818178448 2014-01-07 19:06:19 ffff880ff4747098 ffff880ff474dfd8 000000000000fb88 ffff880ff4747098 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff474fe20 0000000000000046 0000000000000003 ffff880e7bb87400 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff474fe00 ffff8808342a3808 2014-01-07 19:06:19 ffff880ff4746638 ffff880ff474ffd8 000000000000fb88 ffff880ff4746638 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:19 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:19 [] kthread+0x96/0xa0 2014-01-07 19:06:19 [] child_rip+0xa/0x20 2014-01-07 19:06:19 [] ? kthread+0x0/0xa0 2014-01-07 19:06:19 [] ? child_rip+0x0/0x20 2014-01-07 19:06:19 ffff880ff4753e20 0000000000000046 0000000000000001 ffff880e87d71600 2014-01-07 19:06:19 00000000fffffffe 0000000300000000 ffff880ff4753e00 ffff880812cfc748 2014-01-07 19:06:19 ffff880ff4751ab8 ffff880ff4753fd8 000000000000fb88 ffff880ff4751ab8 2014-01-07 19:06:19 Call Trace: 2014-01-07 19:06:19 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff880ff4759e20 0000000000000046 0000000000000001 ffff880e7d429000 2014-01-07 19:06:20 00000000fffffffe 0000000300000000 ffff880ff4759e00 ffff8807cf25e0c8 2014-01-07 19:06:20 ffff880ff4751058 ffff880ff4759fd8 000000000000fb88 ffff880ff4751058 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff880ff475be20 0000000000000046 0000000000000000 ffff880ff475bde4 2014-01-07 19:06:20 0000000000000000 ffff88083fe82000 ffff8800446b6740 000000000000f8cd 2014-01-07 19:06:20 ffff880ff47505f8 ffff880ff475bfd8 000000000000fb88 ffff880ff47505f8 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff880ff475fe20 0000000000000046 0000000000000034 0000000000000000 2014-01-07 19:06:20 00000000fffffffe 0000000300000000 ffff880ff475fe00 ffff8807cf25e548 2014-01-07 19:06:20 ffff880ff475daf8 ffff880ff475ffd8 000000000000fb88 ffff880ff475daf8 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff880ff4763e20 0000000000000046 0000000000000034 0000000000000000 2014-01-07 19:06:20 00000000fffffffe 0000000300000000 ffff880ff4763e00 ffff880816c8b988 2014-01-07 19:06:20 ffff880ff475d098 ffff880ff4763fd8 000000000000fb88 ffff880ff475d098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff880ff4765e20 0000000000000046 ffff880ff4765de8 ffff880ff4765de4 2014-01-07 19:06:20 00000000fffffffe ffff88083fe82600 ffff88085c416740 0000000000015ab9 2014-01-07 19:06:20 ffff880ff475c638 ffff880ff4765fd8 000000000000fb88 ffff880ff475c638 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cec21e20 0000000000000046 0000000000000020 0000000000000000 2014-01-07 19:06:20 00000000fffffffe 0000000300000000 ffff8807cec21e00 ffff8807cf13dbc8 2014-01-07 19:06:20 ffff880827f10638 ffff8807cec21fd8 000000000000fb88 ffff880827f10638 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cec23e20 0000000000000046 0000000000000000 ffff8807cec23de4 2014-01-07 19:06:20 0000000000000000 ffff88083fe82a00 ffff88085c456740 000000000000af5c 2014-01-07 19:06:20 ffff880833ea1098 ffff8807cec23fd8 000000000000fb88 ffff880833ea1098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cec25e20 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:20 00000000fffffffe 0000000300000000 ffff8807cec25e00 ffff880810f11088 2014-01-07 19:06:20 ffff880831999098 ffff8807cec25fd8 000000000000fb88 ffff880831999098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cec27e20 0000000000000046 ffff8807cec27de8 ffff8807cec27de4 2014-01-07 19:06:20 00000000fffffffe ffff88083fe82e00 ffff88085c416740 0000000000015ab9 2014-01-07 19:06:20 ffff880833609098 ffff8807cec27fd8 000000000000fb88 ffff880833609098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] taskq_thread+0x3c6/0x3f0 [spl] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? taskq_thread+0x0/0x3f0 [spl] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cecd1da0 0000000000000046 ffff8807cecd1d68 ffff8807cecd1d64 2014-01-07 19:06:20 ffff8807d138f400 ffff88083fe81c00 ffff8800446f6740 0000000000000400 2014-01-07 19:06:20 ffff8808180ef098 ffff8807cecd1fd8 000000000000fb88 ffff8808180ef098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 scsi host6: SRP abort called 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cfd8dda0 0000000000000046 ffff880700000010 ffff8807cf25e180 2014-01-07 19:06:20 ffff8807d0cf2400 0000000000000000 0000000000000027 ffff8810343b6580 2014-01-07 19:06:20 ffff8808325ea5f8 ffff8807cfd8dfd8 000000000000fb88 ffff8808325ea5f8 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:20 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:20 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807d194de40 0000000000000046 ffff8807d194de08 ffff8807d194de04 2014-01-07 19:06:20 0000000000000002 ffff88083fe81200 ffff880044656740 000000000000af5c 2014-01-07 19:06:20 ffff880833cd1098 ffff8807d194dfd8 000000000000fb88 ffff880833cd1098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ldlm_bl_thread_main+0x345/0x3c0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? ldlm_bl_thread_main+0x0/0x3c0 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807d194fe40 0000000000000046 0000000000000000 0000000000000000 2014-01-07 19:06:20 0000000000000002 0000000000000000 ffff8807d194fe10 ffff8800b8bd99c0 2014-01-07 19:06:20 ffff88081838a638 ffff8807d194ffd8 000000000000fb88 ffff88081838a638 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ldlm_bl_thread_main+0x345/0x3c0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? ldlm_bl_thread_main+0x0/0x3c0 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cec93da0 0000000000000046 0000000000000000 ffff8807d133a080 2014-01-07 19:06:20 ffff8807d138f400 0000000000000000 0000000000000000 ffff8810341ba7c0 2014-01-07 19:06:20 ffff88080ed4d098 ffff8807cec93fd8 000000000000fb88 ffff88080ed4d098 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ? __wake_up+0x53/0x70 2014-01-07 19:06:20 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cd58bda0 0000000000000046 0000000000000000 ffff8807cd58bd64 2014-01-07 19:06:20 ffff8807d0cf2000 ffff88083fe81400 ffff880044636740 0000000000000400 2014-01-07 19:06:20 ffff88081875d058 ffff8807cd58bfd8 000000000000fb88 ffff88081875d058 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cc577da0 0000000000000046 ffff8807cc577d68 ffff8807cc577d64 2014-01-07 19:06:20 ffff880ff5709c00 ffff88083fe82a00 ffff880044616740 0000000000000207 2014-01-07 19:06:20 ffff8808182d9ab8 ffff8807cc577fd8 000000000000fb88 ffff8808182d9ab8 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:20 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:20 [] kthread+0x96/0xa0 2014-01-07 19:06:20 [] child_rip+0xa/0x20 2014-01-07 19:06:20 [] ? kthread+0x0/0xa0 2014-01-07 19:06:20 [] ? child_rip+0x0/0x20 2014-01-07 19:06:20 ffff8807cb065da0 0000000000000046 0000000000000001 ffff8807cee84b40 2014-01-07 19:06:20 ffff8807d0cf2800 0000000000000000 0000000000000000 ffff8810338650c0 2014-01-07 19:06:20 ffff88083108c638 ffff8807cb065fd8 000000000000fb88 ffff88083108c638 2014-01-07 19:06:20 Call Trace: 2014-01-07 19:06:20 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:21 [] ? lprocfs_counter_add+0x1a8/0x1d6 [lvfs] 2014-01-07 19:06:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807cb067da0 0000000000000046 0000000000000000 ffff8807cb067d64 2014-01-07 19:06:21 ffff880ff5709800 ffff88083fe82200 ffff88085c416740 0000000000000400 2014-01-07 19:06:21 ffff880829299058 ffff8807cb067fd8 000000000000fb88 ffff880829299058 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807cb0b1da0 0000000000000046 0000000000000000 ffff880ff43499c0 2014-01-07 19:06:21 ffff880ff5709400 0000000000000000 0000000000000021 ffff8810338650c0 2014-01-07 19:06:21 ffff880831a63058 ffff8807cb0b1fd8 000000000000fb88 ffff880831a63058 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807cb0f1da0 0000000000000046 0000000000000000 ffff8807cee84f00 2014-01-07 19:06:21 ffff8807d0cf2800 0000000000000000 000000000000000d ffff8810338650c0 2014-01-07 19:06:21 ffff8808325005f8 ffff8807cb0f1fd8 000000000000fb88 ffff8808325005f8 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807cb115da0 0000000000000046 0000000000000000 ffff8807cb115d64 2014-01-07 19:06:21 ffff880700000000 ffff88083fe81800 ffff880044616740 000000000000015a 2014-01-07 19:06:21 ffff880832501ab8 ffff8807cb115fd8 000000000000fb88 ffff880832501ab8 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807cec1fda0 0000000000000046 ffff8807cec1fd68 ffff8807cec1fd64 2014-01-07 19:06:21 ffff880ff54aa000 ffff88083fe82400 ffff88085c416740 0000000000000400 2014-01-07 19:06:21 ffff880834387ab8 ffff8807cec1ffd8 000000000000fb88 ffff880834387ab8 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807c9ff3360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:21 ffff8807c9ff32e0 ffffffff8150fa5e ffff880e7a130d60 ffff880e7a131078 2014-01-07 19:06:21 ffff88083106d058 ffff8807c9ff3fd8 000000000000fb88 ffff88083106d058 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:21 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:21 [] io_schedule+0x73/0xc0 2014-01-07 19:06:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:21 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:21 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:21 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:21 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:21 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:21 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:21 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:21 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:21 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807c9ae1690 0000000000000046 ffff8807c9ae16b0 ffffffffa04e9367 2014-01-07 19:06:21 ffff8807c9ae16b0 0000000000000001 0000000000000e35 ffff880700000000 2014-01-07 19:06:21 ffff88080ed4c638 ffff8807c9ae1fd8 000000000000fb88 ffff88080ed4c638 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:21 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:21 [] io_schedule+0x73/0xc0 2014-01-07 19:06:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:21 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807c9bf7690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:21 ffff8807c9bf76b0 0000000000000001 0000000000000e7e ffff880e00000000 2014-01-07 19:06:21 ffff8808342bf058 ffff8807c9bf7fd8 000000000000fb88 ffff8808342bf058 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:21 [] io_schedule+0x73/0xc0 2014-01-07 19:06:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:21 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:21 [] kthread+0x96/0xa0 2014-01-07 19:06:21 [] child_rip+0xa/0x20 2014-01-07 19:06:21 [] ? kthread+0x0/0xa0 2014-01-07 19:06:21 [] ? child_rip+0x0/0x20 2014-01-07 19:06:21 ffff8807c7971690 0000000000000046 ffff8807c79716b0 ffffffffa04e9367 2014-01-07 19:06:21 ffff8807c79716b0 0000000000000001 0000000000000e14 ffff880700000000 2014-01-07 19:06:21 ffff8808186485f8 ffff8807c7971fd8 000000000000fb88 ffff8808186485f8 2014-01-07 19:06:21 Call Trace: 2014-01-07 19:06:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:21 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:21 [] io_schedule+0x73/0xc0 2014-01-07 19:06:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] kthread+0x96/0xa0 2014-01-07 19:06:22 [] child_rip+0xa/0x20 2014-01-07 19:06:22 [] ? kthread+0x0/0xa0 2014-01-07 19:06:22 [] ? child_rip+0x0/0x20 2014-01-07 19:06:22 ffff8807c71b9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:22 ffff8807c71b96b0 0000000000000001 0000000000000bef ffff880e00000000 2014-01-07 19:06:22 ffff8808343ee5f8 ffff8807c71b9fd8 000000000000fb88 ffff8808343ee5f8 2014-01-07 19:06:22 Call Trace: 2014-01-07 19:06:22 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:22 [] io_schedule+0x73/0xc0 2014-01-07 19:06:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] kthread+0x96/0xa0 2014-01-07 19:06:22 [] child_rip+0xa/0x20 2014-01-07 19:06:22 [] ? kthread+0x0/0xa0 2014-01-07 19:06:22 [] ? child_rip+0x0/0x20 2014-01-07 19:06:22 ffff8807c721d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:22 ffff8807c721d6b0 0000000000000001 0000000000000ea8 ffff880700000000 2014-01-07 19:06:22 ffff880832f8c638 ffff8807c721dfd8 000000000000fb88 ffff880832f8c638 2014-01-07 19:06:22 Call Trace: 2014-01-07 19:06:22 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:22 [] io_schedule+0x73/0xc0 2014-01-07 19:06:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] kthread+0x96/0xa0 2014-01-07 19:06:22 [] child_rip+0xa/0x20 2014-01-07 19:06:22 [] ? kthread+0x0/0xa0 2014-01-07 19:06:22 [] ? child_rip+0x0/0x20 2014-01-07 19:06:22 ffff8807c669f360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:22 ffff8807c669f2e0 ffffffff8150fa5e ffff880e7a9c3d80 ffff880e7a9c4098 2014-01-07 19:06:22 ffff880832f8daf8 ffff8807c669ffd8 000000000000fb88 ffff880832f8daf8 2014-01-07 19:06:22 Call Trace: 2014-01-07 19:06:22 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:22 [] io_schedule+0x73/0xc0 2014-01-07 19:06:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:22 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:22 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:22 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:22 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:22 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:22 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:22 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:22 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] kthread+0x96/0xa0 2014-01-07 19:06:22 [] child_rip+0xa/0x20 2014-01-07 19:06:22 [] ? kthread+0x0/0xa0 2014-01-07 19:06:22 [] ? child_rip+0x0/0x20 2014-01-07 19:06:22 ffff8807c671fda0 0000000000000046 ffff880700000010 ffff8807c88a8480 2014-01-07 19:06:22 ffff8807d0cf2400 0000000000000000 000000000000001d ffff8810343b6580 2014-01-07 19:06:22 ffff8808293bd058 ffff8807c671ffd8 000000000000fb88 ffff8808293bd058 2014-01-07 19:06:22 Call Trace: 2014-01-07 19:06:22 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:22 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:22 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:22 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:22 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] kthread+0x96/0xa0 2014-01-07 19:06:22 [] child_rip+0xa/0x20 2014-01-07 19:06:22 [] ? kthread+0x0/0xa0 2014-01-07 19:06:22 [] ? child_rip+0x0/0x20 2014-01-07 19:06:22 ffff8807c4cab690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:22 ffff8807c4cab6b0 ffffffff00000001 ffff8805d2474b30 ffff880e00000001 2014-01-07 19:06:22 ffff8808293bc5f8 ffff8807c4cabfd8 000000000000fb88 ffff8808293bc5f8 2014-01-07 19:06:22 Call Trace: 2014-01-07 19:06:22 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:22 [] io_schedule+0x73/0xc0 2014-01-07 19:06:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:22 [] kthread+0x96/0xa0 2014-01-07 19:06:22 [] child_rip+0xa/0x20 2014-01-07 19:06:22 [] ? kthread+0x0/0xa0 2014-01-07 19:06:22 [] ? child_rip+0x0/0x20 2014-01-07 19:06:22 ffff8807c4cc1690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:22 ffff8807c4cc16b0 0000000000000001 0000000000000e04 ffff880700000000 2014-01-07 19:06:22 ffff880831089ab8 ffff8807c4cc1fd8 000000000000fb88 ffff880831089ab8 2014-01-07 19:06:22 Call Trace: 2014-01-07 19:06:22 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:22 [] io_schedule+0x73/0xc0 2014-01-07 19:06:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] kthread+0x96/0xa0 2014-01-07 19:06:23 [] child_rip+0xa/0x20 2014-01-07 19:06:23 [] ? kthread+0x0/0xa0 2014-01-07 19:06:23 [] ? child_rip+0x0/0x20 2014-01-07 19:06:23 ffff8807c4cc3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:23 ffff8807c4cc36b0 0000000000000001 0000000000000b92 ffff880e00000000 2014-01-07 19:06:23 ffff880833ec1ab8 ffff8807c4cc3fd8 000000000000fb88 ffff880833ec1ab8 2014-01-07 19:06:23 Call Trace: 2014-01-07 19:06:23 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:23 [] io_schedule+0x73/0xc0 2014-01-07 19:06:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] kthread+0x96/0xa0 2014-01-07 19:06:23 [] child_rip+0xa/0x20 2014-01-07 19:06:23 [] ? kthread+0x0/0xa0 2014-01-07 19:06:23 [] ? child_rip+0x0/0x20 2014-01-07 19:06:23 ffff8807c4555360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:23 ffff8807c45552e0 ffffffff8150fa5e ffff880e7a4c1620 ffff880e7a4c1938 2014-01-07 19:06:23 ffff88081878c638 ffff8807c4555fd8 000000000000fb88 ffff88081878c638 2014-01-07 19:06:23 Call Trace: 2014-01-07 19:06:23 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:23 [] io_schedule+0x73/0xc0 2014-01-07 19:06:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:23 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:23 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:23 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:23 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:23 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:23 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:23 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:23 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] kthread+0x96/0xa0 2014-01-07 19:06:23 [] child_rip+0xa/0x20 2014-01-07 19:06:23 [] ? kthread+0x0/0xa0 2014-01-07 19:06:23 [] ? child_rip+0x0/0x20 2014-01-07 19:06:23 ffff8807c3cd7690 0000000000000046 0000000000000000 ffff8807c3cd7654 2014-01-07 19:06:23 ffff880700000000 ffff88083fe82a00 ffff8800446b6740 0000000000000400 2014-01-07 19:06:23 ffff8808288e45f8 ffff8807c3cd7fd8 000000000000fb88 ffff8808288e45f8 2014-01-07 19:06:23 Call Trace: 2014-01-07 19:06:23 [] io_schedule+0x73/0xc0 2014-01-07 19:06:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] kthread+0x96/0xa0 2014-01-07 19:06:23 [] child_rip+0xa/0x20 2014-01-07 19:06:23 [] ? kthread+0x0/0xa0 2014-01-07 19:06:23 [] ? child_rip+0x0/0x20 2014-01-07 19:06:23 ffff8807c1fc9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:23 ffff8807c1fc96b0 0000000000000001 0000000000000df8 ffff880700000000 2014-01-07 19:06:23 ffff8808325bfaf8 ffff8807c1fc9fd8 000000000000fb88 ffff8808325bfaf8 2014-01-07 19:06:23 Call Trace: 2014-01-07 19:06:23 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:23 [] io_schedule+0x73/0xc0 2014-01-07 19:06:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:23 [] kthread+0x96/0xa0 2014-01-07 19:06:23 [] child_rip+0xa/0x20 2014-01-07 19:06:23 [] ? kthread+0x0/0xa0 2014-01-07 19:06:23 [] ? child_rip+0x0/0x20 2014-01-07 19:06:23 ffff880ff35a1690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:23 ffff880ff35a16b0 ffffffff00000001 ffff8806d130a120 ffff880700000001 2014-01-07 19:06:23 ffff881032c39ab8 ffff880ff35a1fd8 000000000000fb88 ffff881032c39ab8 2014-01-07 19:06:23 Call Trace: 2014-01-07 19:06:23 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:23 [] io_schedule+0x73/0xc0 2014-01-07 19:06:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] kthread+0x96/0xa0 2014-01-07 19:06:24 [] child_rip+0xa/0x20 2014-01-07 19:06:24 [] ? kthread+0x0/0xa0 2014-01-07 19:06:24 [] ? child_rip+0x0/0x20 2014-01-07 19:06:24 ffff880ff35af690 0000000000000046 ffff880ff35af6b0 ffffffffa04e9367 2014-01-07 19:06:24 ffff880ff35af6b0 0000000000000001 0000000000000c73 ffff880e00000000 2014-01-07 19:06:24 ffff88103105d058 ffff880ff35affd8 000000000000fb88 ffff88103105d058 2014-01-07 19:06:24 Call Trace: 2014-01-07 19:06:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:24 [] io_schedule+0x73/0xc0 2014-01-07 19:06:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] kthread+0x96/0xa0 2014-01-07 19:06:24 [] child_rip+0xa/0x20 2014-01-07 19:06:24 [] ? kthread+0x0/0xa0 2014-01-07 19:06:24 [] ? child_rip+0x0/0x20 2014-01-07 19:06:24 ffff880ff35c1690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:24 ffff880ff35c16b0 0000000000000001 0000000000000b0b ffff880e00000000 2014-01-07 19:06:24 ffff881030b8a5f8 ffff880ff35c1fd8 000000000000fb88 ffff881030b8a5f8 2014-01-07 19:06:24 Call Trace: 2014-01-07 19:06:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:24 [] io_schedule+0x73/0xc0 2014-01-07 19:06:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] kthread+0x96/0xa0 2014-01-07 19:06:24 [] child_rip+0xa/0x20 2014-01-07 19:06:24 [] ? kthread+0x0/0xa0 2014-01-07 19:06:24 [] ? child_rip+0x0/0x20 2014-01-07 19:06:24 ffff880ff35e3690 0000000000000046 ffff880ff35e36b0 ffffffffa04e9367 2014-01-07 19:06:24 ffff880ff35e36b0 0000000000000001 0000000000000b32 ffff880e00000000 2014-01-07 19:06:24 ffff881034217af8 ffff880ff35e3fd8 000000000000fb88 ffff881034217af8 2014-01-07 19:06:24 Call Trace: 2014-01-07 19:06:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:24 [] io_schedule+0x73/0xc0 2014-01-07 19:06:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:24 scsi host7: SRP abort called 2014-01-07 19:06:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] kthread+0x96/0xa0 2014-01-07 19:06:24 [] child_rip+0xa/0x20 2014-01-07 19:06:24 [] ? kthread+0x0/0xa0 2014-01-07 19:06:24 [] ? child_rip+0x0/0x20 2014-01-07 19:06:24 ffff880ff361d360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:24 ffff880ff361d2e0 ffffffff8150fa5e ffff880e8f1dcaa0 ffff880e8f1dcdb8 2014-01-07 19:06:24 ffff8810313b7098 ffff880ff361dfd8 000000000000fb88 ffff8810313b7098 2014-01-07 19:06:24 Call Trace: 2014-01-07 19:06:24 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:24 [] io_schedule+0x73/0xc0 2014-01-07 19:06:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:24 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:24 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:24 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:24 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:24 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:24 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:06:24 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] kthread+0x96/0xa0 2014-01-07 19:06:24 [] child_rip+0xa/0x20 2014-01-07 19:06:24 [] ? kthread+0x0/0xa0 2014-01-07 19:06:24 [] ? child_rip+0x0/0x20 2014-01-07 19:06:24 ffff880ff361f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:24 ffff880ff361f6b0 0000000000000001 0000000000000d66 ffff880e00000000 2014-01-07 19:06:24 ffff8810313b6638 ffff880ff361ffd8 000000000000fb88 ffff8810313b6638 2014-01-07 19:06:24 Call Trace: 2014-01-07 19:06:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:24 [] io_schedule+0x73/0xc0 2014-01-07 19:06:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:24 [] kthread+0x96/0xa0 2014-01-07 19:06:24 [] child_rip+0xa/0x20 2014-01-07 19:06:24 [] ? kthread+0x0/0xa0 2014-01-07 19:06:25 [] ? child_rip+0x0/0x20 2014-01-07 19:06:25 ffff880ff36a5690 0000000000000046 ffff880ff36a56b0 ffffffffa04e9367 2014-01-07 19:06:25 ffff880ff36a56b0 0000000000000001 0000000000000dea ffff880700000000 2014-01-07 19:06:25 ffff881030b8b058 ffff880ff36a5fd8 000000000000fb88 ffff881030b8b058 2014-01-07 19:06:25 Call Trace: 2014-01-07 19:06:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:25 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:25 [] io_schedule+0x73/0xc0 2014-01-07 19:06:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:25 [] ? ptlrpc_server_post_idle_rqbds+0x38/0xe0 [ptlrpc] 2014-01-07 19:06:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] kthread+0x96/0xa0 2014-01-07 19:06:25 [] child_rip+0xa/0x20 2014-01-07 19:06:25 [] ? kthread+0x0/0xa0 2014-01-07 19:06:25 [] ? child_rip+0x0/0x20 2014-01-07 19:06:25 ffff880ff375b690 0000000000000046 0000000000000000 ffff880ff375b654 2014-01-07 19:06:25 ffff880f00000000 ffff88083fe81c00 ffff88085c496740 00000000000005fe 2014-01-07 19:06:25 ffff880ff4715af8 ffff880ff375bfd8 000000000000fb88 ffff880ff4715af8 2014-01-07 19:06:25 Call Trace: 2014-01-07 19:06:25 [] io_schedule+0x73/0xc0 2014-01-07 19:06:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:25 [] ? lprocfs_counter_add+0xa6/0x1d6 [lvfs] 2014-01-07 19:06:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] kthread+0x96/0xa0 2014-01-07 19:06:25 [] child_rip+0xa/0x20 2014-01-07 19:06:25 [] ? kthread+0x0/0xa0 2014-01-07 19:06:25 [] ? child_rip+0x0/0x20 2014-01-07 19:06:25 ffff880ff377d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:25 ffff880ff377d6b0 0000000000000001 0000000000000c2d ffff880e00000000 2014-01-07 19:06:25 ffff880ff4715098 ffff880ff377dfd8 000000000000fb88 ffff880ff4715098 2014-01-07 19:06:25 Call Trace: 2014-01-07 19:06:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:25 [] io_schedule+0x73/0xc0 2014-01-07 19:06:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] kthread+0x96/0xa0 2014-01-07 19:06:25 [] child_rip+0xa/0x20 2014-01-07 19:06:25 [] ? kthread+0x0/0xa0 2014-01-07 19:06:25 [] ? child_rip+0x0/0x20 2014-01-07 19:06:25 ffff880ff377f4e0 0000000000000046 ffff88080e9ed000 ffff880e8f5cb920 2014-01-07 19:06:25 ffff88080e9ed000 0000000000000001 ffff880ff377f490 ffffffffa05668a9 2014-01-07 19:06:25 ffff8810310245f8 ffff880ff377ffd8 000000000000fb88 ffff8810310245f8 2014-01-07 19:06:25 Call Trace: 2014-01-07 19:06:25 [] ? zio_vdev_io_start+0x1c9/0x2c0 [zfs] 2014-01-07 19:06:25 [] ? zio_nowait+0xb3/0x170 [zfs] 2014-01-07 19:06:25 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:06:25 [] ? vdev_mirror_child_done+0x0/0x30 [zfs] 2014-01-07 19:06:25 scsi host6: SRP abort called 2014-01-07 19:06:25 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:06:25 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:06:25 [] ? down_write+0x32/0x40 2014-01-07 19:06:25 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:06:25 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] kthread+0x96/0xa0 2014-01-07 19:06:25 [] child_rip+0xa/0x20 2014-01-07 19:06:25 [] ? kthread+0x0/0xa0 2014-01-07 19:06:25 [] ? child_rip+0x0/0x20 2014-01-07 19:06:25 ffff880ff379f360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:25 ffff880ff379f2e0 ffffffff8150fa5e ffff8807420dac00 ffff8807420daf18 2014-01-07 19:06:25 ffff8810058fdab8 ffff880ff379ffd8 000000000000fb88 ffff8810058fdab8 2014-01-07 19:06:25 Call Trace: 2014-01-07 19:06:25 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:25 [] io_schedule+0x73/0xc0 2014-01-07 19:06:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:25 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:25 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:25 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:25 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:25 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:25 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:06:25 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:25 [] kthread+0x96/0xa0 2014-01-07 19:06:25 [] child_rip+0xa/0x20 2014-01-07 19:06:25 [] ? kthread+0x0/0xa0 2014-01-07 19:06:25 [] ? child_rip+0x0/0x20 2014-01-07 19:06:25 ffff880ff37d1690 0000000000000046 ffff880ff37d16b0 ffffffffa04e9367 2014-01-07 19:06:25 ffff880ff37d16b0 0000000000000001 0000000000000c8d ffff880e00000000 2014-01-07 19:06:25 ffff881030b4b058 ffff880ff37d1fd8 000000000000fb88 ffff881030b4b058 2014-01-07 19:06:25 Call Trace: 2014-01-07 19:06:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:25 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:26 [] io_schedule+0x73/0xc0 2014-01-07 19:06:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] kthread+0x96/0xa0 2014-01-07 19:06:26 [] child_rip+0xa/0x20 2014-01-07 19:06:26 [] ? kthread+0x0/0xa0 2014-01-07 19:06:26 [] ? child_rip+0x0/0x20 2014-01-07 19:06:26 ffff880ff37d3690 0000000000000046 ffff880ff37d36b0 ffffffffa04e9367 2014-01-07 19:06:26 ffff880ff37d36b0 0000000000000001 0000000000000e86 ffff880700000000 2014-01-07 19:06:26 ffff88103089fab8 ffff880ff37d3fd8 000000000000fb88 ffff88103089fab8 2014-01-07 19:06:26 Call Trace: 2014-01-07 19:06:26 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:26 [] io_schedule+0x73/0xc0 2014-01-07 19:06:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] kthread+0x96/0xa0 2014-01-07 19:06:26 [] child_rip+0xa/0x20 2014-01-07 19:06:26 [] ? kthread+0x0/0xa0 2014-01-07 19:06:26 [] ? child_rip+0x0/0x20 2014-01-07 19:06:26 ffff880ff302b690 0000000000000046 ffff880ff302b6b0 ffffffffa04e9367 2014-01-07 19:06:26 ffff880ff302b6b0 0000000000000001 0000000000000c2e ffff880e00000000 2014-01-07 19:06:26 ffff88103089f058 ffff880ff302bfd8 000000000000fb88 ffff88103089f058 2014-01-07 19:06:26 Call Trace: 2014-01-07 19:06:26 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:26 [] io_schedule+0x73/0xc0 2014-01-07 19:06:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] kthread+0x96/0xa0 2014-01-07 19:06:26 [] child_rip+0xa/0x20 2014-01-07 19:06:26 [] ? kthread+0x0/0xa0 2014-01-07 19:06:26 [] ? child_rip+0x0/0x20 2014-01-07 19:06:26 ffff880ff304f360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:26 ffff880ff304f2e0 ffffffff8150fa5e ffff880701e12340 ffff880701e12658 2014-01-07 19:06:26 ffff881030805af8 ffff880ff304ffd8 000000000000fb88 ffff881030805af8 2014-01-07 19:06:26 Call Trace: 2014-01-07 19:06:26 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:26 [] io_schedule+0x73/0xc0 2014-01-07 19:06:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:26 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:26 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:26 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:26 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:26 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:26 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:26 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:26 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] kthread+0x96/0xa0 2014-01-07 19:06:26 [] child_rip+0xa/0x20 2014-01-07 19:06:26 [] ? kthread+0x0/0xa0 2014-01-07 19:06:26 [] ? child_rip+0x0/0x20 2014-01-07 19:06:26 ffff880ff3089690 0000000000000046 ffff880ff30896b0 ffffffffa04e97d6 2014-01-07 19:06:26 ffff880ff30896b0 ffffffff00000001 ffff88073cf2b580 ffff880e00000001 2014-01-07 19:06:26 ffff881030804638 ffff880ff3089fd8 000000000000fb88 ffff881030804638 2014-01-07 19:06:26 Call Trace: 2014-01-07 19:06:26 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:26 [] io_schedule+0x73/0xc0 2014-01-07 19:06:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] kthread+0x96/0xa0 2014-01-07 19:06:26 [] child_rip+0xa/0x20 2014-01-07 19:06:26 [] ? kthread+0x0/0xa0 2014-01-07 19:06:26 [] ? child_rip+0x0/0x20 2014-01-07 19:06:26 ffff880ff308bda0 0000000000000046 0000000000000010 ffff8807c8beec80 2014-01-07 19:06:26 ffff8807d0cf2000 0000000000000000 0000000000000042 ffff8810343b6580 2014-01-07 19:06:26 ffff881031082638 ffff880ff308bfd8 000000000000fb88 ffff881031082638 2014-01-07 19:06:26 Call Trace: 2014-01-07 19:06:26 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:26 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:26 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:26 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:26 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:26 [] kthread+0x96/0xa0 2014-01-07 19:06:26 [] child_rip+0xa/0x20 2014-01-07 19:06:26 [] ? kthread+0x0/0xa0 2014-01-07 19:06:26 [] ? child_rip+0x0/0x20 2014-01-07 19:06:26 ffff880ff30cb690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:27 ffff880ff30cb6b0 0000000000000001 0000000000000d76 ffff880e00000000 2014-01-07 19:06:27 ffff881031083af8 ffff880ff30cbfd8 000000000000fb88 ffff881031083af8 2014-01-07 19:06:27 Call Trace: 2014-01-07 19:06:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:27 [] io_schedule+0x73/0xc0 2014-01-07 19:06:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] kthread+0x96/0xa0 2014-01-07 19:06:27 [] child_rip+0xa/0x20 2014-01-07 19:06:27 [] ? kthread+0x0/0xa0 2014-01-07 19:06:27 [] ? child_rip+0x0/0x20 2014-01-07 19:06:27 ffff880ff310d360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:27 ffff880ff310d2e0 ffffffff8150fa5e ffff880e7a0357c0 ffff880e7a035ad8 2014-01-07 19:06:27 ffff880ff310bab8 ffff880ff310dfd8 000000000000fb88 ffff880ff310bab8 2014-01-07 19:06:27 Call Trace: 2014-01-07 19:06:27 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:27 [] io_schedule+0x73/0xc0 2014-01-07 19:06:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:27 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:27 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:27 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:27 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:27 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:27 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:27 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] kthread+0x96/0xa0 2014-01-07 19:06:27 [] child_rip+0xa/0x20 2014-01-07 19:06:27 [] ? kthread+0x0/0xa0 2014-01-07 19:06:27 [] ? child_rip+0x0/0x20 2014-01-07 19:06:27 ffff880ff3125690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:27 ffff880ff31256b0 0000000000000001 0000000000000dc7 ffff880e00000000 2014-01-07 19:06:27 ffff880ff310b058 ffff880ff3125fd8 000000000000fb88 ffff880ff310b058 2014-01-07 19:06:27 Call Trace: 2014-01-07 19:06:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:27 [] io_schedule+0x73/0xc0 2014-01-07 19:06:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] kthread+0x96/0xa0 2014-01-07 19:06:27 [] child_rip+0xa/0x20 2014-01-07 19:06:27 [] ? kthread+0x0/0xa0 2014-01-07 19:06:27 [] ? child_rip+0x0/0x20 2014-01-07 19:06:27 ffff880ff3127690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:27 ffff880ff31276b0 0000000000000001 0000000000000b1f ffff880e00000000 2014-01-07 19:06:27 ffff880ff310a5f8 ffff880ff3127fd8 000000000000fb88 ffff880ff310a5f8 2014-01-07 19:06:27 Call Trace: 2014-01-07 19:06:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:27 [] io_schedule+0x73/0xc0 2014-01-07 19:06:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] kthread+0x96/0xa0 2014-01-07 19:06:27 [] child_rip+0xa/0x20 2014-01-07 19:06:27 [] ? kthread+0x0/0xa0 2014-01-07 19:06:27 [] ? child_rip+0x0/0x20 2014-01-07 19:06:27 ffff880ff3151360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:27 ffff880ff31512e0 ffffffff8150fa5e ffff880e90fde080 ffff880e90fde398 2014-01-07 19:06:27 ffff881034de7098 ffff880ff3151fd8 000000000000fb88 ffff881034de7098 2014-01-07 19:06:27 Call Trace: 2014-01-07 19:06:27 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:27 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:27 [] io_schedule+0x73/0xc0 2014-01-07 19:06:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:27 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:27 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:27 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:27 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:27 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:27 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:27 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:27 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:27 [] kthread+0x96/0xa0 2014-01-07 19:06:27 [] child_rip+0xa/0x20 2014-01-07 19:06:27 [] ? kthread+0x0/0xa0 2014-01-07 19:06:27 [] ? child_rip+0x0/0x20 2014-01-07 19:06:27 ffff880ff31b1690 0000000000000046 ffff880ff31b16b0 ffffffffa04e9367 2014-01-07 19:06:27 ffff880ff31b16b0 0000000000000001 0000000000000d63 ffff880e00000000 2014-01-07 19:06:27 ffff880ff31afaf8 ffff880ff31b1fd8 000000000000fb88 ffff880ff31afaf8 2014-01-07 19:06:27 Call Trace: 2014-01-07 19:06:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:27 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:27 [] io_schedule+0x73/0xc0 2014-01-07 19:06:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] kthread+0x96/0xa0 2014-01-07 19:06:28 [] child_rip+0xa/0x20 2014-01-07 19:06:28 [] ? kthread+0x0/0xa0 2014-01-07 19:06:28 [] ? child_rip+0x0/0x20 2014-01-07 19:06:28 ffff880ff322d690 0000000000000046 ffff880ff322d6b0 ffffffffa04e97d6 2014-01-07 19:06:28 ffff880ff322d6b0 ffffffff00000001 ffff880280414cf0 ffff880e00000001 2014-01-07 19:06:28 ffff880ff322bab8 ffff880ff322dfd8 000000000000fb88 ffff880ff322bab8 2014-01-07 19:06:28 Call Trace: 2014-01-07 19:06:28 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:28 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:28 [] io_schedule+0x73/0xc0 2014-01-07 19:06:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] kthread+0x96/0xa0 2014-01-07 19:06:28 [] child_rip+0xa/0x20 2014-01-07 19:06:28 [] ? kthread+0x0/0xa0 2014-01-07 19:06:28 [] ? child_rip+0x0/0x20 2014-01-07 19:06:28 ffff880ff323b690 0000000000000046 ffff880ff323b6b0 ffffffffa04e9367 2014-01-07 19:06:28 ffff880ff323b6b0 0000000000000001 0000000000000c34 ffff880e00000000 2014-01-07 19:06:28 ffff880ff322b058 ffff880ff323bfd8 000000000000fb88 ffff880ff322b058 2014-01-07 19:06:28 Call Trace: 2014-01-07 19:06:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:28 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:28 [] io_schedule+0x73/0xc0 2014-01-07 19:06:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] kthread+0x96/0xa0 2014-01-07 19:06:28 [] child_rip+0xa/0x20 2014-01-07 19:06:28 [] ? kthread+0x0/0xa0 2014-01-07 19:06:28 [] ? child_rip+0x0/0x20 2014-01-07 19:06:28 ffff880ff328bda0 0000000000000046 0000000000000010 ffff880ff3d2a540 2014-01-07 19:06:28 ffff880ff5709c00 0000000000000000 0000000000000059 ffff8810343b6580 2014-01-07 19:06:28 ffff8810059ac638 ffff880ff328bfd8 000000000000fb88 ffff8810059ac638 2014-01-07 19:06:28 Call Trace: 2014-01-07 19:06:28 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:06:28 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:06:28 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:28 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:28 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] kthread+0x96/0xa0 2014-01-07 19:06:28 [] child_rip+0xa/0x20 2014-01-07 19:06:28 [] ? kthread+0x0/0xa0 2014-01-07 19:06:28 [] ? child_rip+0x0/0x20 2014-01-07 19:06:28 ffff880ff32b3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:28 ffff880ff32b36b0 0000000000000001 0000000000000b71 ffff880e00000000 2014-01-07 19:06:28 ffff880ff46e45f8 ffff880ff32b3fd8 000000000000fb88 ffff880ff46e45f8 2014-01-07 19:06:28 Call Trace: 2014-01-07 19:06:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:28 [] io_schedule+0x73/0xc0 2014-01-07 19:06:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] kthread+0x96/0xa0 2014-01-07 19:06:28 [] child_rip+0xa/0x20 2014-01-07 19:06:28 [] ? kthread+0x0/0xa0 2014-01-07 19:06:28 [] ? child_rip+0x0/0x20 2014-01-07 19:06:28 ffff880ff32b5690 0000000000000046 ffff880ff32b56b0 ffffffffa04e9367 2014-01-07 19:06:28 ffff880ff32b56b0 0000000000000001 0000000000000eb9 ffff880700000000 2014-01-07 19:06:28 ffff880ff46e5058 ffff880ff32b5fd8 000000000000fb88 ffff880ff46e5058 2014-01-07 19:06:28 Call Trace: 2014-01-07 19:06:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:28 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:28 [] io_schedule+0x73/0xc0 2014-01-07 19:06:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:28 [] kthread+0x96/0xa0 2014-01-07 19:06:28 [] child_rip+0xa/0x20 2014-01-07 19:06:28 [] ? kthread+0x0/0xa0 2014-01-07 19:06:28 [] ? child_rip+0x0/0x20 2014-01-07 19:06:28 ffff880ff3351690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:28 ffff880ff33516b0 0000000000000001 0000000000000ead ffff880700000000 2014-01-07 19:06:28 ffff880ff322a5f8 ffff880ff3351fd8 000000000000fb88 ffff880ff322a5f8 2014-01-07 19:06:28 Call Trace: 2014-01-07 19:06:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:28 [] io_schedule+0x73/0xc0 2014-01-07 19:06:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] kthread+0x96/0xa0 2014-01-07 19:06:29 [] child_rip+0xa/0x20 2014-01-07 19:06:29 [] ? kthread+0x0/0xa0 2014-01-07 19:06:29 [] ? child_rip+0x0/0x20 2014-01-07 19:06:29 ffff880ff3379690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:29 ffff880ff33796b0 ffffffff00000001 ffff880f145dd430 ffff880e00000001 2014-01-07 19:06:29 ffff880ff3377af8 ffff880ff3379fd8 000000000000fb88 ffff880ff3377af8 2014-01-07 19:06:29 Call Trace: 2014-01-07 19:06:29 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:29 [] io_schedule+0x73/0xc0 2014-01-07 19:06:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:29 [] ? apic_timer_interrupt+0xe/0x20 2014-01-07 19:06:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] kthread+0x96/0xa0 2014-01-07 19:06:29 [] child_rip+0xa/0x20 2014-01-07 19:06:29 [] ? kthread+0x0/0xa0 2014-01-07 19:06:29 [] ? child_rip+0x0/0x20 2014-01-07 19:06:29 ffff880ff3397690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:29 ffff880ff33976b0 0000000000000001 0000000000000b4c ffff880e00000000 2014-01-07 19:06:29 ffff880ff3377098 ffff880ff3397fd8 000000000000fb88 ffff880ff3377098 2014-01-07 19:06:29 Call Trace: 2014-01-07 19:06:29 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:29 [] io_schedule+0x73/0xc0 2014-01-07 19:06:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] kthread+0x96/0xa0 2014-01-07 19:06:29 [] child_rip+0xa/0x20 2014-01-07 19:06:29 [] ? kthread+0x0/0xa0 2014-01-07 19:06:29 [] ? child_rip+0x0/0x20 2014-01-07 19:06:29 ffff880ff3399690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:29 ffff880ff33996b0 0000000000000001 0000000000000afa ffff880e00000000 2014-01-07 19:06:29 ffff880ff31af098 ffff880ff3399fd8 000000000000fb88 ffff880ff31af098 2014-01-07 19:06:29 Call Trace: 2014-01-07 19:06:29 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:29 [] io_schedule+0x73/0xc0 2014-01-07 19:06:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:29 scsi host7: SRP abort called 2014-01-07 19:06:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] kthread+0x96/0xa0 2014-01-07 19:06:29 [] child_rip+0xa/0x20 2014-01-07 19:06:29 [] ? kthread+0x0/0xa0 2014-01-07 19:06:29 [] ? child_rip+0x0/0x20 2014-01-07 19:06:29 ffff880ff33f7360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:29 ffff880ff33f72e0 ffffffff8150fa5e ffff8806c33e8900 ffff8806c33e8c18 2014-01-07 19:06:29 ffff880ff31ae638 ffff880ff33f7fd8 000000000000fb88 ffff880ff31ae638 2014-01-07 19:06:29 Call Trace: 2014-01-07 19:06:29 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:29 [] io_schedule+0x73/0xc0 2014-01-07 19:06:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:29 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:29 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:29 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:29 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:29 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:29 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:29 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:29 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:29 [] kthread+0x96/0xa0 2014-01-07 19:06:29 [] child_rip+0xa/0x20 2014-01-07 19:06:29 [] ? kthread+0x0/0xa0 2014-01-07 19:06:29 [] ? child_rip+0x0/0x20 2014-01-07 19:06:29 ffff880ff2c4d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:29 ffff880ff2c4d6b0 0000000000000001 0000000000000d81 ffff880e00000000 2014-01-07 19:06:29 ffff880ff2c4bab8 ffff880ff2c4dfd8 000000000000fb88 ffff880ff2c4bab8 2014-01-07 19:06:29 Call Trace: 2014-01-07 19:06:29 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:29 [] io_schedule+0x73/0xc0 2014-01-07 19:06:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] kthread+0x96/0xa0 2014-01-07 19:06:30 [] child_rip+0xa/0x20 2014-01-07 19:06:30 [] ? kthread+0x0/0xa0 2014-01-07 19:06:30 [] ? child_rip+0x0/0x20 2014-01-07 19:06:30 ffff880ff2c51360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:30 ffff880ff2c512e0 ffffffff8150fa5e ffff8806c31a11c0 ffff8806c31a14d8 2014-01-07 19:06:30 ffff880ff2c4b058 ffff880ff2c51fd8 000000000000fb88 ffff880ff2c4b058 2014-01-07 19:06:30 Call Trace: 2014-01-07 19:06:30 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:30 [] io_schedule+0x73/0xc0 2014-01-07 19:06:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:30 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:30 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:30 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:30 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:30 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:30 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:30 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:30 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] kthread+0x96/0xa0 2014-01-07 19:06:30 [] child_rip+0xa/0x20 2014-01-07 19:06:30 [] ? kthread+0x0/0xa0 2014-01-07 19:06:30 [] ? child_rip+0x0/0x20 2014-01-07 19:06:30 ffff880ff2c75360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:30 ffff880ff2c752e0 ffffffff8150fa5e ffff880e7a032c00 ffff880e7a032f18 2014-01-07 19:06:30 ffff880ff2c4a5f8 ffff880ff2c75fd8 000000000000fb88 ffff880ff2c4a5f8 2014-01-07 19:06:30 Call Trace: 2014-01-07 19:06:30 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:30 [] io_schedule+0x73/0xc0 2014-01-07 19:06:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:30 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:30 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:30 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:30 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:30 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:30 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:30 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:30 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] kthread+0x96/0xa0 2014-01-07 19:06:30 [] child_rip+0xa/0x20 2014-01-07 19:06:30 [] ? kthread+0x0/0xa0 2014-01-07 19:06:30 [] ? child_rip+0x0/0x20 2014-01-07 19:06:30 ffff880ff2cb7690 0000000000000046 ffff880ff2cb76b0 ffffffffa04e9367 2014-01-07 19:06:30 ffff880ff2cb76b0 0000000000000001 0000000000000cb9 ffff880e00000000 2014-01-07 19:06:30 ffff880ff2cb5af8 ffff880ff2cb7fd8 000000000000fb88 ffff880ff2cb5af8 2014-01-07 19:06:30 Call Trace: 2014-01-07 19:06:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:30 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:30 [] io_schedule+0x73/0xc0 2014-01-07 19:06:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:30 scsi host6: SRP abort called 2014-01-07 19:06:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] kthread+0x96/0xa0 2014-01-07 19:06:30 [] child_rip+0xa/0x20 2014-01-07 19:06:30 [] ? kthread+0x0/0xa0 2014-01-07 19:06:30 [] ? child_rip+0x0/0x20 2014-01-07 19:06:30 ffff880ff2d39690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:30 ffff880ff2d396b0 0000000000000001 0000000000000c01 ffff880e00000000 2014-01-07 19:06:30 ffff880ff2cb5098 ffff880ff2d39fd8 000000000000fb88 ffff880ff2cb5098 2014-01-07 19:06:30 Call Trace: 2014-01-07 19:06:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:30 [] io_schedule+0x73/0xc0 2014-01-07 19:06:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:30 [] kthread+0x96/0xa0 2014-01-07 19:06:30 [] child_rip+0xa/0x20 2014-01-07 19:06:30 [] ? kthread+0x0/0xa0 2014-01-07 19:06:30 [] ? child_rip+0x0/0x20 2014-01-07 19:06:30 ffff880ff2d3d690 0000000000000046 ffff880ff2d3d6b0 ffffffffa04e9367 2014-01-07 19:06:30 ffff880ff2d3d6b0 0000000000000001 0000000000000d83 ffff880e00000000 2014-01-07 19:06:30 ffff880ff2cb4638 ffff880ff2d3dfd8 000000000000fb88 ffff880ff2cb4638 2014-01-07 19:06:30 Call Trace: 2014-01-07 19:06:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:30 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:30 [] io_schedule+0x73/0xc0 2014-01-07 19:06:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] kthread+0x96/0xa0 2014-01-07 19:06:31 [] child_rip+0xa/0x20 2014-01-07 19:06:31 [] ? kthread+0x0/0xa0 2014-01-07 19:06:31 [] ? child_rip+0x0/0x20 2014-01-07 19:06:31 ffff880ff2d43690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:31 ffff880ff2d436b0 ffffffff00000001 ffff880182ce1740 ffff880e00000001 2014-01-07 19:06:31 ffff880ff3376638 ffff880ff2d43fd8 000000000000fb88 ffff880ff3376638 2014-01-07 19:06:31 Call Trace: 2014-01-07 19:06:31 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:31 [] io_schedule+0x73/0xc0 2014-01-07 19:06:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_server_post_idle_rqbds+0x38/0xe0 [ptlrpc] 2014-01-07 19:06:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] kthread+0x96/0xa0 2014-01-07 19:06:31 [] child_rip+0xa/0x20 2014-01-07 19:06:31 [] ? kthread+0x0/0xa0 2014-01-07 19:06:31 [] ? child_rip+0x0/0x20 2014-01-07 19:06:31 ffff880ff2da3690 0000000000000046 ffff880ff2da36b0 ffffffffa04e97d6 2014-01-07 19:06:31 ffff880ff2da36b0 ffffffff00000001 ffff880426553430 ffff880700000001 2014-01-07 19:06:31 ffff880ff2da1ab8 ffff880ff2da3fd8 000000000000fb88 ffff880ff2da1ab8 2014-01-07 19:06:31 Call Trace: 2014-01-07 19:06:31 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:31 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:31 [] io_schedule+0x73/0xc0 2014-01-07 19:06:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] kthread+0x96/0xa0 2014-01-07 19:06:31 [] child_rip+0xa/0x20 2014-01-07 19:06:31 [] ? kthread+0x0/0xa0 2014-01-07 19:06:31 [] ? child_rip+0x0/0x20 2014-01-07 19:06:31 ffff880ff2ebb690 0000000000000046 ffff880ff2ebb6b0 ffffffffa04e9367 2014-01-07 19:06:31 ffff880ff2ebb6b0 0000000000000001 0000000000000bdc ffff880e00000000 2014-01-07 19:06:31 ffff880ff2eb9af8 ffff880ff2ebbfd8 000000000000fb88 ffff880ff2eb9af8 2014-01-07 19:06:31 Call Trace: 2014-01-07 19:06:31 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:31 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:31 [] io_schedule+0x73/0xc0 2014-01-07 19:06:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] kthread+0x96/0xa0 2014-01-07 19:06:31 [] child_rip+0xa/0x20 2014-01-07 19:06:31 [] ? kthread+0x0/0xa0 2014-01-07 19:06:31 [] ? child_rip+0x0/0x20 2014-01-07 19:06:31 ffff880ff2f37690 0000000000000046 ffff880ff2f376b0 ffffffffa04e9367 2014-01-07 19:06:31 ffff880ff2f376b0 0000000000000001 0000000000000ebd ffff880e00000000 2014-01-07 19:06:31 ffff880ff2eb9098 ffff880ff2f37fd8 000000000000fb88 ffff880ff2eb9098 2014-01-07 19:06:31 Call Trace: 2014-01-07 19:06:31 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:31 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:31 [] io_schedule+0x73/0xc0 2014-01-07 19:06:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] kthread+0x96/0xa0 2014-01-07 19:06:31 [] child_rip+0xa/0x20 2014-01-07 19:06:31 [] ? kthread+0x0/0xa0 2014-01-07 19:06:31 [] ? child_rip+0x0/0x20 2014-01-07 19:06:31 ffff880ff2f3d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:31 ffff880ff2f3d6b0 0000000000000001 0000000000000d14 ffff880700000000 2014-01-07 19:06:31 ffff880ff2eb8638 ffff880ff2f3dfd8 000000000000fb88 ffff880ff2eb8638 2014-01-07 19:06:31 Call Trace: 2014-01-07 19:06:31 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:31 [] io_schedule+0x73/0xc0 2014-01-07 19:06:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:31 [] kthread+0x96/0xa0 2014-01-07 19:06:31 [] child_rip+0xa/0x20 2014-01-07 19:06:31 [] ? kthread+0x0/0xa0 2014-01-07 19:06:31 [] ? child_rip+0x0/0x20 2014-01-07 19:06:31 ffff880ff2f81690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:31 ffff880ff2f816b0 ffffffff00000001 ffff8806ef25deb0 ffff880e00000001 2014-01-07 19:06:31 ffff880ff2da1058 ffff880ff2f81fd8 000000000000fb88 ffff880ff2da1058 2014-01-07 19:06:31 Call Trace: 2014-01-07 19:06:31 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:31 [] io_schedule+0x73/0xc0 2014-01-07 19:06:32 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:32 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:32 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:32 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:32 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:32 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:32 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:32 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:32 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:32 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:32 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:32 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:32 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:32 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] kthread+0x96/0xa0 2014-01-07 19:06:32 [] child_rip+0xa/0x20 2014-01-07 19:06:32 [] ? kthread+0x0/0xa0 2014-01-07 19:06:32 [] ? child_rip+0x0/0x20 2014-01-07 19:06:32 ffff880ff2f8b690 0000000000000046 ffff880ff2f8b6b0 ffffffffa04e9367 2014-01-07 19:06:32 ffff880ff2f8b6b0 0000000000000001 0000000000000de0 ffff880700000000 2014-01-07 19:06:32 ffff881031215af8 ffff880ff2f8bfd8 000000000000fb88 ffff881031215af8 2014-01-07 19:06:32 Call Trace: 2014-01-07 19:06:32 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:32 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:32 [] io_schedule+0x73/0xc0 2014-01-07 19:06:32 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:32 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:32 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:32 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:32 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:32 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:32 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:32 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:32 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:32 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:32 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:32 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:32 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:32 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:32 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] kthread+0x96/0xa0 2014-01-07 19:06:32 [] child_rip+0xa/0x20 2014-01-07 19:06:32 [] ? kthread+0x0/0xa0 2014-01-07 19:06:32 [] ? child_rip+0x0/0x20 2014-01-07 19:06:32 ffff880ff2fe5550 0000000000000046 0000000000000000 0000000000281826 2014-01-07 19:06:32 0000000200003232 0000000affffffff ffffffffffffffff 000000009adf2d81 2014-01-07 19:06:32 ffff880ff55ef058 ffff880ff2fe5fd8 000000000000fb88 ffff880ff55ef058 2014-01-07 19:06:32 Call Trace: 2014-01-07 19:06:32 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:06:32 [] mutex_lock+0x2b/0x50 2014-01-07 19:06:32 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:06:32 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:32 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:32 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:32 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:32 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:32 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:32 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:32 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:32 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:32 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:32 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:32 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:32 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] kthread+0x96/0xa0 2014-01-07 19:06:32 [] child_rip+0xa/0x20 2014-01-07 19:06:32 [] ? kthread+0x0/0xa0 2014-01-07 19:06:32 [] ? child_rip+0x0/0x20 2014-01-07 19:06:32 ffff880ff2871690 0000000000000046 ffff880ff28716b0 ffffffffa04e9367 2014-01-07 19:06:32 ffff880ff28716b0 0000000000000001 0000000000000ea3 ffff880700000000 2014-01-07 19:06:32 ffff881034216638 ffff880ff2871fd8 000000000000fb88 ffff881034216638 2014-01-07 19:06:32 Call Trace: 2014-01-07 19:06:32 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:32 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:32 [] io_schedule+0x73/0xc0 2014-01-07 19:06:32 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:32 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:32 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:32 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:32 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:32 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:32 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:32 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:32 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:32 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:32 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:32 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:32 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:32 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:32 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] kthread+0x96/0xa0 2014-01-07 19:06:32 [] child_rip+0xa/0x20 2014-01-07 19:06:32 [] ? kthread+0x0/0xa0 2014-01-07 19:06:32 [] ? child_rip+0x0/0x20 2014-01-07 19:06:32 ffff880ff2873690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:32 ffff880ff28736b0 0000000000000001 0000000000000dec ffff880700000000 2014-01-07 19:06:32 ffff881031d2e5f8 ffff880ff2873fd8 000000000000fb88 ffff881031d2e5f8 2014-01-07 19:06:32 Call Trace: 2014-01-07 19:06:32 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:32 [] io_schedule+0x73/0xc0 2014-01-07 19:06:32 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:32 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:32 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:32 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:32 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:32 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:32 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:32 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:32 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:32 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:32 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:32 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:32 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:32 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:32 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:32 [] kthread+0x96/0xa0 2014-01-07 19:06:32 [] child_rip+0xa/0x20 2014-01-07 19:06:32 [] ? kthread+0x0/0xa0 2014-01-07 19:06:32 [] ? child_rip+0x0/0x20 2014-01-07 19:06:32 ffff880ff28ab550 0000000000000046 0000000000000000 0000000000281826 2014-01-07 19:06:32 0000000200003232 0000000affffffff ffffffffffffffff 00000000c3ee9a4a 2014-01-07 19:06:32 ffff880ff28a9ab8 ffff880ff28abfd8 000000000000fb88 ffff880ff28a9ab8 2014-01-07 19:06:32 Call Trace: 2014-01-07 19:06:32 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:06:32 [] mutex_lock+0x2b/0x50 2014-01-07 19:06:32 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:06:32 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:32 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:32 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:32 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:32 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:32 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:32 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:32 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:32 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:32 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:32 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:32 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:32 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:32 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:32 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:32 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] kthread+0x96/0xa0 2014-01-07 19:06:33 [] child_rip+0xa/0x20 2014-01-07 19:06:33 [] ? kthread+0x0/0xa0 2014-01-07 19:06:33 [] ? child_rip+0x0/0x20 2014-01-07 19:06:33 ffff880ff28e3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:33 ffff880ff28e36b0 0000000000000001 ffff8805fb9cf580 ffff880e00000000 2014-01-07 19:06:33 ffff880ff28a9058 ffff880ff28e3fd8 000000000000fb88 ffff880ff28a9058 2014-01-07 19:06:33 Call Trace: 2014-01-07 19:06:33 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:33 [] io_schedule+0x73/0xc0 2014-01-07 19:06:33 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:33 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:33 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:33 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:33 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:33 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:33 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:33 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:33 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:33 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:33 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:33 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:33 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:33 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:33 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] kthread+0x96/0xa0 2014-01-07 19:06:33 [] child_rip+0xa/0x20 2014-01-07 19:06:33 [] ? kthread+0x0/0xa0 2014-01-07 19:06:33 [] ? child_rip+0x0/0x20 2014-01-07 19:06:33 ffff880ff2957690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:33 ffff880ff29576b0 0000000000000001 0000000000000d33 ffff880700000000 2014-01-07 19:06:33 ffff880ff2955af8 ffff880ff2957fd8 000000000000fb88 ffff880ff2955af8 2014-01-07 19:06:33 Call Trace: 2014-01-07 19:06:33 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:33 [] io_schedule+0x73/0xc0 2014-01-07 19:06:33 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:33 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:33 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:33 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:33 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:33 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:33 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:33 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:33 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:33 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:33 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:33 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:33 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:33 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:33 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] kthread+0x96/0xa0 2014-01-07 19:06:33 [] child_rip+0xa/0x20 2014-01-07 19:06:33 [] ? kthread+0x0/0xa0 2014-01-07 19:06:33 [] ? child_rip+0x0/0x20 2014-01-07 19:06:33 ffff880ff2991690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:33 ffff880ff29916b0 0000000000000001 0000000000000e5e ffff880e00000000 2014-01-07 19:06:33 ffff880ff2955098 ffff880ff2991fd8 000000000000fb88 ffff880ff2955098 2014-01-07 19:06:33 Call Trace: 2014-01-07 19:06:33 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:33 [] io_schedule+0x73/0xc0 2014-01-07 19:06:33 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:33 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:33 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:33 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:33 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:33 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:33 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:33 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:33 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:33 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:33 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:33 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:33 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:33 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:33 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] kthread+0x96/0xa0 2014-01-07 19:06:33 [] child_rip+0xa/0x20 2014-01-07 19:06:33 [] ? kthread+0x0/0xa0 2014-01-07 19:06:33 [] ? child_rip+0x0/0x20 2014-01-07 19:06:33 ffff880ff299b360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:33 ffff880ff299b2e0 ffffffff8150fa5e ffff880e8d0f27a0 ffff880e8d0f2ab8 2014-01-07 19:06:33 ffff880ff2954638 ffff880ff299bfd8 000000000000fb88 ffff880ff2954638 2014-01-07 19:06:33 Call Trace: 2014-01-07 19:06:33 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:33 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:33 [] io_schedule+0x73/0xc0 2014-01-07 19:06:33 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:33 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:33 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:33 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:33 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:33 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:33 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:33 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:33 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:33 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:33 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:33 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:33 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:33 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:33 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:33 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:33 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:33 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:33 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:33 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:33 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:33 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:33 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] kthread+0x96/0xa0 2014-01-07 19:06:33 [] child_rip+0xa/0x20 2014-01-07 19:06:33 [] ? kthread+0x0/0xa0 2014-01-07 19:06:33 [] ? child_rip+0x0/0x20 2014-01-07 19:06:33 ffff880ff29e7690 0000000000000046 ffff880ff29e76b0 ffffffffa04e9367 2014-01-07 19:06:33 ffff880ff29e76b0 0000000000000001 0000000000000c6c ffff880e00000000 2014-01-07 19:06:33 ffff880ff29e5ab8 ffff880ff29e7fd8 000000000000fb88 ffff880ff29e5ab8 2014-01-07 19:06:33 Call Trace: 2014-01-07 19:06:33 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:33 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:33 [] io_schedule+0x73/0xc0 2014-01-07 19:06:33 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:33 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:33 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:33 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:33 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:33 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:33 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:33 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:33 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:33 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:33 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:33 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:33 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:33 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:33 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:33 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:33 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:33 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:33 [] kthread+0x96/0xa0 2014-01-07 19:06:33 [] child_rip+0xa/0x20 2014-01-07 19:06:33 [] ? kthread+0x0/0xa0 2014-01-07 19:06:33 [] ? child_rip+0x0/0x20 2014-01-07 19:06:33 ffff880ff2a03360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:33 ffff880ff2a032e0 ffffffff8150fa5e ffff880e80bb91c0 ffff880e80bb94d8 2014-01-07 19:06:33 ffff880ff28a85f8 ffff880ff2a03fd8 000000000000fb88 ffff880ff28a85f8 2014-01-07 19:06:33 Call Trace: 2014-01-07 19:06:33 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:33 [] io_schedule+0x73/0xc0 2014-01-07 19:06:33 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:34 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:34 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:34 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:34 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:34 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:34 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:34 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:34 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:34 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:34 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:34 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:34 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:34 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:34 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:34 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:34 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:34 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:34 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:34 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:34 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:34 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] kthread+0x96/0xa0 2014-01-07 19:06:34 [] child_rip+0xa/0x20 2014-01-07 19:06:34 [] ? kthread+0x0/0xa0 2014-01-07 19:06:34 [] ? child_rip+0x0/0x20 2014-01-07 19:06:34 ffff880ff2ac3360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:34 ffff880ff2ac32e0 ffffffff8150fa5e ffff880700e41a80 ffff880700e41d98 2014-01-07 19:06:34 ffff880ff2ac1af8 ffff880ff2ac3fd8 000000000000fb88 ffff880ff2ac1af8 2014-01-07 19:06:34 Call Trace: 2014-01-07 19:06:34 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:34 [] io_schedule+0x73/0xc0 2014-01-07 19:06:34 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:34 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:34 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:34 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:34 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:34 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:34 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:34 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:34 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:06:34 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:34 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:34 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:34 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:34 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:34 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:34 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:34 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:34 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:34 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:34 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:34 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] kthread+0x96/0xa0 2014-01-07 19:06:34 [] child_rip+0xa/0x20 2014-01-07 19:06:34 [] ? kthread+0x0/0xa0 2014-01-07 19:06:34 [] ? child_rip+0x0/0x20 2014-01-07 19:06:34 ffff8807ab1ab4d8 0000000000000046 0000000000000000 ffff8807ab1ab500 2014-01-07 19:06:34 ffffffff8127fa1e 0000002100000005 ffff8807ce7f6000 ffff8807ab1ab460 2014-01-07 19:06:34 ffff880834311ab8 ffff8807ab1abfd8 000000000000fb88 ffff880834311ab8 2014-01-07 19:06:34 Call Trace: 2014-01-07 19:06:34 [] ? number+0x2ee/0x320 2014-01-07 19:06:34 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:06:34 [] ? vsnprintf+0x336/0x5e0 2014-01-07 19:06:34 [] rwsem_down_read_failed+0x26/0x30 2014-01-07 19:06:34 [] call_rwsem_down_read_failed+0x14/0x30 2014-01-07 19:06:34 [] ? down_read+0x24/0x30 2014-01-07 19:06:34 [] dmu_zfetch+0xb9/0xd70 [zfs] 2014-01-07 19:06:34 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:34 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:34 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:34 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:34 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:34 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:34 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:34 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:34 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:34 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:34 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:34 scsi host7: SRP abort called 2014-01-07 19:06:34 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:34 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] kthread+0x96/0xa0 2014-01-07 19:06:34 [] child_rip+0xa/0x20 2014-01-07 19:06:34 [] ? kthread+0x0/0xa0 2014-01-07 19:06:34 [] ? child_rip+0x0/0x20 2014-01-07 19:06:34 ffff8807aa60b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:34 ffff8807aa60b6b0 0000000000000001 0000000000000adf ffff880e00000000 2014-01-07 19:06:34 ffff8808186f05f8 ffff8807aa60bfd8 000000000000fb88 ffff8808186f05f8 2014-01-07 19:06:34 Call Trace: 2014-01-07 19:06:34 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:34 [] io_schedule+0x73/0xc0 2014-01-07 19:06:34 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:34 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:34 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:34 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:34 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:34 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:34 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:34 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:34 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:34 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:34 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:34 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:34 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:34 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] kthread+0x96/0xa0 2014-01-07 19:06:34 [] child_rip+0xa/0x20 2014-01-07 19:06:34 [] ? kthread+0x0/0xa0 2014-01-07 19:06:34 [] ? child_rip+0x0/0x20 2014-01-07 19:06:34 ffff8807aa225690 0000000000000046 ffff8807aa2256b0 ffffffffa04e9367 2014-01-07 19:06:34 ffff8807aa2256b0 0000000000000001 0000000000000dff ffff880e00000000 2014-01-07 19:06:34 ffff8808334f9058 ffff8807aa225fd8 000000000000fb88 ffff8808334f9058 2014-01-07 19:06:34 Call Trace: 2014-01-07 19:06:34 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:34 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:34 [] io_schedule+0x73/0xc0 2014-01-07 19:06:34 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:34 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:34 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:34 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:34 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:34 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:34 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:34 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:34 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:34 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:34 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:34 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:34 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:34 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:34 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:34 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:34 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:34 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:34 [] kthread+0x96/0xa0 2014-01-07 19:06:34 [] child_rip+0xa/0x20 2014-01-07 19:06:34 [] ? kthread+0x0/0xa0 2014-01-07 19:06:34 [] ? child_rip+0x0/0x20 2014-01-07 19:06:34 ffff8807a9f0d690 0000000000000046 ffff8807a9f0d6b0 ffffffffa04e9367 2014-01-07 19:06:34 ffff8807a9f0d6b0 0000000000000001 0000000000000aff ffff880e00000000 2014-01-07 19:06:34 ffff880833570638 ffff8807a9f0dfd8 000000000000fb88 ffff880833570638 2014-01-07 19:06:34 Call Trace: 2014-01-07 19:06:34 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:34 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:34 [] io_schedule+0x73/0xc0 2014-01-07 19:06:35 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:35 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:35 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:35 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:35 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:35 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:35 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:35 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:35 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:35 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:35 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:35 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:35 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:35 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] kthread+0x96/0xa0 2014-01-07 19:06:35 [] child_rip+0xa/0x20 2014-01-07 19:06:35 [] ? kthread+0x0/0xa0 2014-01-07 19:06:35 [] ? child_rip+0x0/0x20 2014-01-07 19:06:35 ffff8807a99ad690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:35 ffff8807a99ad6b0 0000000000000001 0000000000000c34 ffff880e00000000 2014-01-07 19:06:35 ffff880833571af8 ffff8807a99adfd8 000000000000fb88 ffff880833571af8 2014-01-07 19:06:35 Call Trace: 2014-01-07 19:06:35 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:35 [] io_schedule+0x73/0xc0 2014-01-07 19:06:35 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:35 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:35 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:35 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:35 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:35 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:35 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:35 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:35 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:35 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:35 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:35 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:35 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:35 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] kthread+0x96/0xa0 2014-01-07 19:06:35 [] child_rip+0xa/0x20 2014-01-07 19:06:35 [] ? kthread+0x0/0xa0 2014-01-07 19:06:35 [] ? child_rip+0x0/0x20 2014-01-07 19:06:35 ffff8807a9087690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:35 ffff8807a90876b0 0000000000000001 0000000000000e79 ffff880e00000000 2014-01-07 19:06:35 ffff880831d0dab8 ffff8807a9087fd8 000000000000fb88 ffff880831d0dab8 2014-01-07 19:06:35 Call Trace: 2014-01-07 19:06:35 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:35 [] io_schedule+0x73/0xc0 2014-01-07 19:06:35 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:35 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:35 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:35 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:35 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:35 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:35 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:35 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:35 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:35 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:35 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:35 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:35 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:35 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] kthread+0x96/0xa0 2014-01-07 19:06:35 [] child_rip+0xa/0x20 2014-01-07 19:06:35 [] ? kthread+0x0/0xa0 2014-01-07 19:06:35 [] ? child_rip+0x0/0x20 2014-01-07 19:06:35 ffff8807a9389360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:35 ffff8807a93892e0 ffffffff8150fa5e ffff8806c2da2340 ffff8806c2da2658 2014-01-07 19:06:35 ffff880831d0d058 ffff8807a9389fd8 000000000000fb88 ffff880831d0d058 2014-01-07 19:06:35 Call Trace: 2014-01-07 19:06:35 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:35 [] io_schedule+0x73/0xc0 2014-01-07 19:06:35 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:35 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:35 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:35 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:35 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:35 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:35 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:35 [] dmu_zfetch+0xaaf/0xd70 [zfs] 2014-01-07 19:06:35 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:35 scsi host6: SRP abort called 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:35 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:35 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:35 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:35 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:35 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:35 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:35 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:35 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:35 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:35 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:35 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] kthread+0x96/0xa0 2014-01-07 19:06:35 [] child_rip+0xa/0x20 2014-01-07 19:06:35 [] ? kthread+0x0/0xa0 2014-01-07 19:06:35 [] ? child_rip+0x0/0x20 2014-01-07 19:06:35 ffff8807a83c7360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:35 ffff8807a83c72e0 ffffffff8150fa5e ffff880e78723d80 ffff880e78724098 2014-01-07 19:06:35 ffff880818081058 ffff8807a83c7fd8 000000000000fb88 ffff880818081058 2014-01-07 19:06:35 Call Trace: 2014-01-07 19:06:35 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:35 [] io_schedule+0x73/0xc0 2014-01-07 19:06:35 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:35 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:35 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:35 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:35 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:35 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:35 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:35 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:35 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:35 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:35 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:35 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:35 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:35 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:35 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:35 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:35 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:35 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:35 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:35 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:35 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:35 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:35 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:35 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:35 [] kthread+0x96/0xa0 2014-01-07 19:06:35 [] child_rip+0xa/0x20 2014-01-07 19:06:35 [] ? kthread+0x0/0xa0 2014-01-07 19:06:35 [] ? child_rip+0x0/0x20 2014-01-07 19:06:35 ffff8807a5c63690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:35 ffff8807a5c636b0 0000000000000001 0000000000000d7a ffff880e00000000 2014-01-07 19:06:35 ffff88083254baf8 ffff8807a5c63fd8 000000000000fb88 ffff88083254baf8 2014-01-07 19:06:35 Call Trace: 2014-01-07 19:06:35 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:35 [] io_schedule+0x73/0xc0 2014-01-07 19:06:35 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:35 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:35 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:35 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:35 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:36 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:36 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:36 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:36 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:36 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:36 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:36 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:36 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:36 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:36 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:36 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] kthread+0x96/0xa0 2014-01-07 19:06:36 [] child_rip+0xa/0x20 2014-01-07 19:06:36 [] ? kthread+0x0/0xa0 2014-01-07 19:06:36 [] ? child_rip+0x0/0x20 2014-01-07 19:06:36 ffff8807a588b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:36 ffff8807a588b6b0 0000000000000001 0000000000000b65 ffff880e00000000 2014-01-07 19:06:36 ffff88083254b098 ffff8807a588bfd8 000000000000fb88 ffff88083254b098 2014-01-07 19:06:36 Call Trace: 2014-01-07 19:06:36 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:36 [] io_schedule+0x73/0xc0 2014-01-07 19:06:36 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:36 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:36 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:36 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:36 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:36 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:36 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:36 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:36 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:36 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:36 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:36 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:36 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:36 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] kthread+0x96/0xa0 2014-01-07 19:06:36 [] child_rip+0xa/0x20 2014-01-07 19:06:36 [] ? kthread+0x0/0xa0 2014-01-07 19:06:36 [] ? child_rip+0x0/0x20 2014-01-07 19:06:36 ffff8807a5b8b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:36 ffff8807a5b8b6b0 0000000000000001 0000000000000dff ffff880e00000000 2014-01-07 19:06:36 ffff880833cc65f8 ffff8807a5b8bfd8 000000000000fb88 ffff880833cc65f8 2014-01-07 19:06:36 Call Trace: 2014-01-07 19:06:36 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:36 [] io_schedule+0x73/0xc0 2014-01-07 19:06:36 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:36 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:36 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:36 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:36 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:36 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:36 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:36 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:36 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:36 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:36 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:36 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:36 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:36 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] kthread+0x96/0xa0 2014-01-07 19:06:36 [] child_rip+0xa/0x20 2014-01-07 19:06:36 [] ? kthread+0x0/0xa0 2014-01-07 19:06:36 [] ? child_rip+0x0/0x20 2014-01-07 19:06:36 ffff8807a54fb690 0000000000000046 ffff8807a54fb6b0 ffffffffa04e97d6 2014-01-07 19:06:36 ffff8807a54fb6b0 ffffffff00000001 ffff880e7fef6d20 ffff880e7fef6d18 2014-01-07 19:06:36 ffff880833cfdaf8 ffff8807a54fbfd8 000000000000fb88 ffff880833cfdaf8 2014-01-07 19:06:36 Call Trace: 2014-01-07 19:06:36 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:36 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:36 [] io_schedule+0x73/0xc0 2014-01-07 19:06:36 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:36 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:36 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:36 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:36 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:36 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:36 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:36 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:36 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:36 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:36 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:36 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:36 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:36 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] kthread+0x96/0xa0 2014-01-07 19:06:36 [] child_rip+0xa/0x20 2014-01-07 19:06:36 [] ? kthread+0x0/0xa0 2014-01-07 19:06:36 [] ? child_rip+0x0/0x20 2014-01-07 19:06:36 ffff8807a5513690 0000000000000046 0000000000000000 ffff8807a5513654 2014-01-07 19:06:36 ffff880700000000 ffff88083fe81200 ffff880044696740 0000000000000400 2014-01-07 19:06:36 ffff88081788c5f8 ffff8807a5513fd8 000000000000fb88 ffff88081788c5f8 2014-01-07 19:06:36 Call Trace: 2014-01-07 19:06:36 [] io_schedule+0x73/0xc0 2014-01-07 19:06:36 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:36 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:36 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:36 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:36 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:36 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:36 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:36 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:36 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:36 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:36 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:36 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:36 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:36 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] kthread+0x96/0xa0 2014-01-07 19:06:36 [] child_rip+0xa/0x20 2014-01-07 19:06:36 [] ? kthread+0x0/0xa0 2014-01-07 19:06:36 [] ? child_rip+0x0/0x20 2014-01-07 19:06:36 ffff8807a512d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:36 ffff8807a512d6b0 0000000000000001 0000000000000cf7 ffff880e00000000 2014-01-07 19:06:36 ffff8808319cfab8 ffff8807a512dfd8 000000000000fb88 ffff8808319cfab8 2014-01-07 19:06:36 Call Trace: 2014-01-07 19:06:36 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:36 [] io_schedule+0x73/0xc0 2014-01-07 19:06:36 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:36 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:36 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:36 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:36 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:36 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:36 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:36 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:36 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:36 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:36 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:36 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:36 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:36 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:36 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:36 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:36 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:36 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:36 [] kthread+0x96/0xa0 2014-01-07 19:06:37 [] child_rip+0xa/0x20 2014-01-07 19:06:37 [] ? kthread+0x0/0xa0 2014-01-07 19:06:37 [] ? child_rip+0x0/0x20 2014-01-07 19:06:37 ffff8807a512f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:37 ffff8807a512f6b0 0000000000000001 0000000000000d3b ffff880e00000000 2014-01-07 19:06:37 ffff8808319cf058 ffff8807a512ffd8 000000000000fb88 ffff8808319cf058 2014-01-07 19:06:37 Call Trace: 2014-01-07 19:06:37 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:37 [] io_schedule+0x73/0xc0 2014-01-07 19:06:37 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:37 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:37 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:37 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:37 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:37 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:37 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:37 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:37 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:37 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:37 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:37 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:37 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:37 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] kthread+0x96/0xa0 2014-01-07 19:06:37 [] child_rip+0xa/0x20 2014-01-07 19:06:37 [] ? kthread+0x0/0xa0 2014-01-07 19:06:37 [] ? child_rip+0x0/0x20 2014-01-07 19:06:37 ffff8807a5145360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:37 ffff8807a51452e0 ffffffff8150fa5e ffff880e8eae1ee0 ffff880e8eae21f8 2014-01-07 19:06:37 ffff88083434dab8 ffff8807a5145fd8 000000000000fb88 ffff88083434dab8 2014-01-07 19:06:37 Call Trace: 2014-01-07 19:06:37 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:37 [] io_schedule+0x73/0xc0 2014-01-07 19:06:37 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:37 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:37 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:37 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:37 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:37 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:37 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:37 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:37 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:37 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:37 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:37 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:37 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:37 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:37 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:37 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:37 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:37 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:37 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:37 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:37 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:37 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] kthread+0x96/0xa0 2014-01-07 19:06:37 [] child_rip+0xa/0x20 2014-01-07 19:06:37 [] ? kthread+0x0/0xa0 2014-01-07 19:06:37 [] ? child_rip+0x0/0x20 2014-01-07 19:06:37 ffff8807a4cdf690 0000000000000046 ffff8807a4cdf6b0 ffffffffa04e9367 2014-01-07 19:06:37 ffff8807a4cdf6b0 0000000000000001 0000000000000bb1 ffff880e00000000 2014-01-07 19:06:37 ffff880818649058 ffff8807a4cdffd8 000000000000fb88 ffff880818649058 2014-01-07 19:06:37 Call Trace: 2014-01-07 19:06:37 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:37 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:37 [] io_schedule+0x73/0xc0 2014-01-07 19:06:37 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:37 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:37 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:37 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:37 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:37 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:37 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:37 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:37 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:37 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:37 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:37 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:37 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:37 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] kthread+0x96/0xa0 2014-01-07 19:06:37 [] child_rip+0xa/0x20 2014-01-07 19:06:37 [] ? kthread+0x0/0xa0 2014-01-07 19:06:37 [] ? child_rip+0x0/0x20 2014-01-07 19:06:37 ffff8807a4d5d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:37 ffff8807a4d5d6b0 0000000000000001 0000000000000d4b ffff880700000000 2014-01-07 19:06:37 ffff880833e8b098 ffff8807a4d5dfd8 000000000000fb88 ffff880833e8b098 2014-01-07 19:06:37 Call Trace: 2014-01-07 19:06:37 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:37 [] io_schedule+0x73/0xc0 2014-01-07 19:06:37 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:37 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:37 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:37 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:37 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:37 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:37 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:37 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:37 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:37 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:37 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:37 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:37 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:37 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] kthread+0x96/0xa0 2014-01-07 19:06:37 [] child_rip+0xa/0x20 2014-01-07 19:06:37 [] ? kthread+0x0/0xa0 2014-01-07 19:06:37 [] ? child_rip+0x0/0x20 2014-01-07 19:06:37 ffff8807a4d5f550 0000000000000046 0000000000000000 0000000000281826 2014-01-07 19:06:37 0000000200003232 0000000affffffff ffffffffffffffff 00000000c1f0bebb 2014-01-07 19:06:37 ffff880833e8a638 ffff8807a4d5ffd8 000000000000fb88 ffff880833e8a638 2014-01-07 19:06:37 Call Trace: 2014-01-07 19:06:37 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:06:37 [] mutex_lock+0x2b/0x50 2014-01-07 19:06:37 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:06:37 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:37 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:37 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:37 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:37 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:37 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:37 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:37 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:37 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:37 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:37 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:37 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:37 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:37 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:37 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:37 [] kthread+0x96/0xa0 2014-01-07 19:06:37 [] child_rip+0xa/0x20 2014-01-07 19:06:37 [] ? kthread+0x0/0xa0 2014-01-07 19:06:37 [] ? child_rip+0x0/0x20 2014-01-07 19:06:37 ffff8807a49a9690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:37 ffff8807a49a96b0 ffffffff00000001 ffff88074a5a7c10 ffff880e00000001 2014-01-07 19:06:37 ffff880818539ab8 ffff8807a49a9fd8 000000000000fb88 ffff880818539ab8 2014-01-07 19:06:37 Call Trace: 2014-01-07 19:06:37 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:37 [] io_schedule+0x73/0xc0 2014-01-07 19:06:37 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:37 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:37 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:37 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:37 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:38 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:38 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:38 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:38 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:38 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:38 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:38 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:38 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:38 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:38 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:38 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] kthread+0x96/0xa0 2014-01-07 19:06:38 [] child_rip+0xa/0x20 2014-01-07 19:06:38 [] ? kthread+0x0/0xa0 2014-01-07 19:06:38 [] ? child_rip+0x0/0x20 2014-01-07 19:06:38 ffff8807a49ab690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:38 ffff8807a49ab6b0 0000000000000001 0000000000000bce ffff880e00000000 2014-01-07 19:06:38 ffff880833ffbaf8 ffff8807a49abfd8 000000000000fb88 ffff880833ffbaf8 2014-01-07 19:06:38 Call Trace: 2014-01-07 19:06:38 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:38 [] io_schedule+0x73/0xc0 2014-01-07 19:06:38 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:38 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:38 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:38 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:38 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:38 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:38 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:38 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:38 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:38 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:38 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:38 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:38 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:38 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] kthread+0x96/0xa0 2014-01-07 19:06:38 [] child_rip+0xa/0x20 2014-01-07 19:06:38 [] ? kthread+0x0/0xa0 2014-01-07 19:06:38 [] ? child_rip+0x0/0x20 2014-01-07 19:06:38 ffff8807a49ad360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:38 ffff8807a49ad2e0 ffffffff8150fa5e ffff8807415a57c0 ffff8807415a5ad8 2014-01-07 19:06:38 ffff8808310e3098 ffff8807a49adfd8 000000000000fb88 ffff8808310e3098 2014-01-07 19:06:38 Call Trace: 2014-01-07 19:06:38 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:38 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:38 [] io_schedule+0x73/0xc0 2014-01-07 19:06:38 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:38 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:38 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:38 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:38 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:38 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:38 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:38 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:38 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:38 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:38 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:38 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:38 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:38 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:38 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:38 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:38 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:38 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:38 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:38 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:38 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:38 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] kthread+0x96/0xa0 2014-01-07 19:06:38 [] child_rip+0xa/0x20 2014-01-07 19:06:38 [] ? kthread+0x0/0xa0 2014-01-07 19:06:38 [] ? child_rip+0x0/0x20 2014-01-07 19:06:38 ffff8807a49c9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:38 ffff8807a49c96b0 0000000000000001 0000000000000c5f ffff880e00000000 2014-01-07 19:06:38 ffff880818165098 ffff8807a49c9fd8 000000000000fb88 ffff880818165098 2014-01-07 19:06:38 Call Trace: 2014-01-07 19:06:38 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:38 [] io_schedule+0x73/0xc0 2014-01-07 19:06:38 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:38 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:38 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:38 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:38 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:38 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:38 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:38 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:38 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:38 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:38 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:38 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:38 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] kthread+0x96/0xa0 2014-01-07 19:06:38 [] child_rip+0xa/0x20 2014-01-07 19:06:38 [] ? kthread+0x0/0xa0 2014-01-07 19:06:38 [] ? child_rip+0x0/0x20 2014-01-07 19:06:38 ffff8807a49cb690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:38 ffff8807a49cb6b0 0000000000000001 0000000000000ea5 ffff880700000000 2014-01-07 19:06:38 ffff880818165af8 ffff8807a49cbfd8 000000000000fb88 ffff880818165af8 2014-01-07 19:06:38 Call Trace: 2014-01-07 19:06:38 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:38 [] io_schedule+0x73/0xc0 2014-01-07 19:06:38 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:38 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:38 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:38 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:38 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:38 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:38 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:38 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:38 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:38 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:38 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:38 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:38 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:38 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:38 [] kthread+0x96/0xa0 2014-01-07 19:06:38 [] child_rip+0xa/0x20 2014-01-07 19:06:38 [] ? kthread+0x0/0xa0 2014-01-07 19:06:38 [] ? child_rip+0x0/0x20 2014-01-07 19:06:38 ffff8807a4ab9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:38 ffff8807a4ab96b0 0000000000000001 0000000000000b6c ffff880e00000000 2014-01-07 19:06:38 ffff88081856f098 ffff8807a4ab9fd8 000000000000fb88 ffff88081856f098 2014-01-07 19:06:38 Call Trace: 2014-01-07 19:06:38 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:38 [] io_schedule+0x73/0xc0 2014-01-07 19:06:38 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:38 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:38 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:38 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:38 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:38 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:38 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:38 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:38 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:38 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:38 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:38 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:38 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:39 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:39 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:39 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:39 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:39 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] kthread+0x96/0xa0 2014-01-07 19:06:39 [] child_rip+0xa/0x20 2014-01-07 19:06:39 [] ? kthread+0x0/0xa0 2014-01-07 19:06:39 [] ? child_rip+0x0/0x20 2014-01-07 19:06:39 ffff8807a45f7690 0000000000000046 0000000000000000 ffff8807a45f7654 2014-01-07 19:06:39 ffff880700000000 ffff88083fe81000 ffff88085c436740 0000000000000400 2014-01-07 19:06:39 ffff880829397ab8 ffff8807a45f7fd8 000000000000fb88 ffff880829397ab8 2014-01-07 19:06:39 Call Trace: 2014-01-07 19:06:39 [] io_schedule+0x73/0xc0 2014-01-07 19:06:39 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:39 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:39 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:39 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:39 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:39 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:39 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:39 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:39 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:39 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:39 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:39 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:39 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:39 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] kthread+0x96/0xa0 2014-01-07 19:06:39 [] child_rip+0xa/0x20 2014-01-07 19:06:39 [] ? kthread+0x0/0xa0 2014-01-07 19:06:39 [] ? child_rip+0x0/0x20 2014-01-07 19:06:39 ffff8807a45fd690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:39 ffff8807a45fd6b0 0000000000000001 0000000000000bd0 ffff880e00000000 2014-01-07 19:06:39 ffff88081818f058 ffff8807a45fdfd8 000000000000fb88 ffff88081818f058 2014-01-07 19:06:39 Call Trace: 2014-01-07 19:06:39 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:39 [] io_schedule+0x73/0xc0 2014-01-07 19:06:39 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:39 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:39 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:39 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:39 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:39 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:39 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:39 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:39 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:39 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:39 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:39 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:39 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:39 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] kthread+0x96/0xa0 2014-01-07 19:06:39 [] child_rip+0xa/0x20 2014-01-07 19:06:39 [] ? kthread+0x0/0xa0 2014-01-07 19:06:39 [] ? child_rip+0x0/0x20 2014-01-07 19:06:39 ffff8807a4629690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:39 ffff8807a46296b0 0000000000000001 0000000000000e7f ffff880e00000000 2014-01-07 19:06:39 ffff8808180ee638 ffff8807a4629fd8 000000000000fb88 ffff8808180ee638 2014-01-07 19:06:39 Call Trace: 2014-01-07 19:06:39 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:39 [] io_schedule+0x73/0xc0 2014-01-07 19:06:39 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:39 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:39 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:39 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:39 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:39 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:39 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:39 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:39 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:39 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:39 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:39 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:39 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:39 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] kthread+0x96/0xa0 2014-01-07 19:06:39 scsi host7: SRP abort called 2014-01-07 19:06:39 [] child_rip+0xa/0x20 2014-01-07 19:06:39 [] ? kthread+0x0/0xa0 2014-01-07 19:06:39 [] ? child_rip+0x0/0x20 2014-01-07 19:06:39 ffff8807a47b3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:39 ffff8807a47b36b0 0000000000000001 0000000000000db6 ffff880e00000000 2014-01-07 19:06:39 ffff880833c1bab8 ffff8807a47b3fd8 000000000000fb88 ffff880833c1bab8 2014-01-07 19:06:39 Call Trace: 2014-01-07 19:06:39 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:39 [] io_schedule+0x73/0xc0 2014-01-07 19:06:39 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:39 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:39 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:39 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:39 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:39 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:39 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:39 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:39 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:39 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:39 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:39 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:39 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:39 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] kthread+0x96/0xa0 2014-01-07 19:06:39 [] child_rip+0xa/0x20 2014-01-07 19:06:39 [] ? kthread+0x0/0xa0 2014-01-07 19:06:39 [] ? child_rip+0x0/0x20 2014-01-07 19:06:39 ffff8807a4245690 0000000000000046 ffff8807a4245658 ffff8807a4245654 2014-01-07 19:06:39 ffff8807a42456b0 ffff88083fe82400 ffff88085c436740 00000000000002af 2014-01-07 19:06:39 ffff88083357b058 ffff8807a4245fd8 000000000000fb88 ffff88083357b058 2014-01-07 19:06:39 Call Trace: 2014-01-07 19:06:39 [] io_schedule+0x73/0xc0 2014-01-07 19:06:39 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:39 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:39 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:39 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:39 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:39 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:39 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:39 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:39 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:39 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:39 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:39 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:39 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:39 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:39 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:39 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:39 [] kthread+0x96/0xa0 2014-01-07 19:06:39 [] child_rip+0xa/0x20 2014-01-07 19:06:39 [] ? kthread+0x0/0xa0 2014-01-07 19:06:39 [] ? child_rip+0x0/0x20 2014-01-07 19:06:39 ffff8807a4249690 0000000000000046 ffff8807a42496b0 ffffffffa04e9367 2014-01-07 19:06:39 ffff8807a42496b0 0000000000000001 0000000000000c12 ffff880e00000000 2014-01-07 19:06:39 ffff88083357a5f8 ffff8807a4249fd8 000000000000fb88 ffff88083357a5f8 2014-01-07 19:06:39 Call Trace: 2014-01-07 19:06:39 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:39 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:39 [] io_schedule+0x73/0xc0 2014-01-07 19:06:39 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:39 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:39 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:39 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:39 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:40 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:40 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:40 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:40 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:40 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:40 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:40 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:40 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:40 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:40 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:40 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] kthread+0x96/0xa0 2014-01-07 19:06:40 [] child_rip+0xa/0x20 2014-01-07 19:06:40 [] ? kthread+0x0/0xa0 2014-01-07 19:06:40 [] ? child_rip+0x0/0x20 2014-01-07 19:06:40 ffff8807a424b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:40 ffff8807a424b6b0 0000000000000001 0000000000000cb1 ffff880e00000000 2014-01-07 19:06:40 ffff88083109f098 ffff8807a424bfd8 000000000000fb88 ffff88083109f098 2014-01-07 19:06:40 Call Trace: 2014-01-07 19:06:40 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:40 [] io_schedule+0x73/0xc0 2014-01-07 19:06:40 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:40 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:40 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:40 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:40 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:40 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:40 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:40 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:40 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:40 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:40 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:40 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:40 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:40 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] kthread+0x96/0xa0 2014-01-07 19:06:40 [] child_rip+0xa/0x20 2014-01-07 19:06:40 [] ? kthread+0x0/0xa0 2014-01-07 19:06:40 [] ? child_rip+0x0/0x20 2014-01-07 19:06:40 ffff8807a3d73690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:40 ffff8807a3d736b0 ffffffff00000001 ffff880f5ed54b30 ffff880e00000001 2014-01-07 19:06:40 ffff88083109e638 ffff8807a3d73fd8 000000000000fb88 ffff88083109e638 2014-01-07 19:06:40 Call Trace: 2014-01-07 19:06:40 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:40 [] io_schedule+0x73/0xc0 2014-01-07 19:06:40 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:40 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:40 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:40 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:40 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:40 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:40 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:40 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:40 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:40 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:40 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:40 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:40 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:40 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] kthread+0x96/0xa0 2014-01-07 19:06:40 [] child_rip+0xa/0x20 2014-01-07 19:06:40 [] ? kthread+0x0/0xa0 2014-01-07 19:06:40 [] ? child_rip+0x0/0x20 2014-01-07 19:06:40 ffff8807a3e6d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:40 ffff8807a3e6d6b0 0000000000000001 0000000000000b66 ffff880e00000000 2014-01-07 19:06:40 ffff880833609af8 ffff8807a3e6dfd8 000000000000fb88 ffff880833609af8 2014-01-07 19:06:40 Call Trace: 2014-01-07 19:06:40 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:40 [] io_schedule+0x73/0xc0 2014-01-07 19:06:40 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:40 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:40 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:40 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:40 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:40 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:40 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:40 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:40 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 scsi host6: SRP abort called 2014-01-07 19:06:40 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:40 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:40 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:40 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:40 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:40 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] kthread+0x96/0xa0 2014-01-07 19:06:40 [] child_rip+0xa/0x20 2014-01-07 19:06:40 [] ? kthread+0x0/0xa0 2014-01-07 19:06:40 [] ? child_rip+0x0/0x20 2014-01-07 19:06:40 ffff8807a3e71690 0000000000000046 ffff8807a3e716b0 ffffffffa04e9367 2014-01-07 19:06:40 ffff8807a3e716b0 0000000000000001 0000000000000c5f ffff880e00000000 2014-01-07 19:06:40 ffff8808334e25f8 ffff8807a3e71fd8 000000000000fb88 ffff8808334e25f8 2014-01-07 19:06:40 Call Trace: 2014-01-07 19:06:40 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:40 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:40 [] io_schedule+0x73/0xc0 2014-01-07 19:06:40 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:40 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:40 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:40 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:40 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:40 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:40 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:40 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:40 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:40 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:40 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:40 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:40 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:40 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:40 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] kthread+0x96/0xa0 2014-01-07 19:06:40 [] child_rip+0xa/0x20 2014-01-07 19:06:40 [] ? kthread+0x0/0xa0 2014-01-07 19:06:40 [] ? child_rip+0x0/0x20 2014-01-07 19:06:40 ffff8807a3e734e0 0000000000000046 ffff8807a3e73500 ffffffff8127fa1e 2014-01-07 19:06:40 0000002100000005 ffff880ff355d000 ffff8807a3e73460 ffff8807a3e73480 2014-01-07 19:06:40 ffff8808334e3ab8 ffff8807a3e73fd8 000000000000fb88 ffff8808334e3ab8 2014-01-07 19:06:40 Call Trace: 2014-01-07 19:06:40 [] ? number+0x2ee/0x320 2014-01-07 19:06:40 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:06:40 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:06:40 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:06:40 [] ? down_write+0x32/0x40 2014-01-07 19:06:40 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:06:40 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:40 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:40 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:40 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:40 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:40 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:40 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:40 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:40 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:40 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:40 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:40 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:40 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:40 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:40 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:40 [] kthread+0x96/0xa0 2014-01-07 19:06:41 [] child_rip+0xa/0x20 2014-01-07 19:06:41 [] ? kthread+0x0/0xa0 2014-01-07 19:06:41 [] ? child_rip+0x0/0x20 2014-01-07 19:06:41 ffff8807a3e79690 0000000000000046 ffff8807a3e796b0 ffffffffa04e9367 2014-01-07 19:06:41 ffff8807a3e796b0 0000000000000001 0000000000000b9a ffff880e00000000 2014-01-07 19:06:41 ffff880833585098 ffff8807a3e79fd8 000000000000fb88 ffff880833585098 2014-01-07 19:06:41 Call Trace: 2014-01-07 19:06:41 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:41 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:41 [] io_schedule+0x73/0xc0 2014-01-07 19:06:41 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:41 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:41 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:41 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:41 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:41 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:41 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:41 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:41 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:41 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:41 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:41 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:41 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:41 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] kthread+0x96/0xa0 2014-01-07 19:06:41 [] child_rip+0xa/0x20 2014-01-07 19:06:41 [] ? kthread+0x0/0xa0 2014-01-07 19:06:41 [] ? child_rip+0x0/0x20 2014-01-07 19:06:41 ffff8807a3ff3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:41 ffff8807a3ff36b0 0000000000000001 0000000000000cb4 ffff880e00000000 2014-01-07 19:06:41 ffff880833585af8 ffff8807a3ff3fd8 000000000000fb88 ffff880833585af8 2014-01-07 19:06:41 Call Trace: 2014-01-07 19:06:41 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:41 [] io_schedule+0x73/0xc0 2014-01-07 19:06:41 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:41 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:41 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:41 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:41 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:41 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:41 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:41 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:41 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:41 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:41 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:41 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:41 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:41 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] kthread+0x96/0xa0 2014-01-07 19:06:41 [] child_rip+0xa/0x20 2014-01-07 19:06:41 [] ? kthread+0x0/0xa0 2014-01-07 19:06:41 [] ? child_rip+0x0/0x20 2014-01-07 19:06:41 ffff8807a3ad5690 0000000000000046 ffff8807a3ad56b0 ffffffffa04e9367 2014-01-07 19:06:41 ffff8807a3ad56b0 0000000000000001 0000000000000c4f ffff880e00000000 2014-01-07 19:06:41 ffff8808343bb058 ffff8807a3ad5fd8 000000000000fb88 ffff8808343bb058 2014-01-07 19:06:41 Call Trace: 2014-01-07 19:06:41 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:41 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:41 [] io_schedule+0x73/0xc0 2014-01-07 19:06:41 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:41 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:41 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:41 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:41 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:41 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:41 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:41 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:41 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:41 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:41 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:41 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:41 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:41 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] kthread+0x96/0xa0 2014-01-07 19:06:41 [] child_rip+0xa/0x20 2014-01-07 19:06:41 [] ? kthread+0x0/0xa0 2014-01-07 19:06:41 [] ? child_rip+0x0/0x20 2014-01-07 19:06:41 ffff8807a3ad9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:41 ffff8807a3ad96b0 0000000000000001 0000000000000eb4 ffff880700000000 2014-01-07 19:06:41 ffff88083355a638 ffff8807a3ad9fd8 000000000000fb88 ffff88083355a638 2014-01-07 19:06:41 Call Trace: 2014-01-07 19:06:41 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:41 [] io_schedule+0x73/0xc0 2014-01-07 19:06:41 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:41 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:41 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:41 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:41 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:41 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:41 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:41 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:41 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:41 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:41 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:41 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:41 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:41 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] kthread+0x96/0xa0 2014-01-07 19:06:41 [] child_rip+0xa/0x20 2014-01-07 19:06:41 [] ? kthread+0x0/0xa0 2014-01-07 19:06:41 [] ? child_rip+0x0/0x20 2014-01-07 19:06:41 ffff8807a3adb690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:41 ffff8807a3adb6b0 ffffffff00000001 ffff880e8c83f878 ffff880e8c83f870 2014-01-07 19:06:41 ffff88083263c638 ffff8807a3adbfd8 000000000000fb88 ffff88083263c638 2014-01-07 19:06:41 Call Trace: 2014-01-07 19:06:41 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:41 [] io_schedule+0x73/0xc0 2014-01-07 19:06:41 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:41 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:41 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:41 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:41 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:41 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:41 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:41 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:41 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:41 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:41 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:41 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:41 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:41 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:41 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:41 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:41 [] kthread+0x96/0xa0 2014-01-07 19:06:41 [] child_rip+0xa/0x20 2014-01-07 19:06:41 [] ? kthread+0x0/0xa0 2014-01-07 19:06:41 [] ? child_rip+0x0/0x20 2014-01-07 19:06:41 ffff8807a365f690 0000000000000046 ffff8807a365f6b0 ffffffffa04e97d6 2014-01-07 19:06:41 ffff8807a365f6b0 ffffffff00000001 ffff8807d14974b0 ffff8807d14974a8 2014-01-07 19:06:41 ffff880831b5faf8 ffff8807a365ffd8 000000000000fb88 ffff880831b5faf8 2014-01-07 19:06:41 Call Trace: 2014-01-07 19:06:41 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:41 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:41 [] io_schedule+0x73/0xc0 2014-01-07 19:06:41 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:41 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:41 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:41 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:41 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:41 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:41 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:41 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:42 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:42 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:42 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:42 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:42 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:42 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:42 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] kthread+0x96/0xa0 2014-01-07 19:06:42 [] child_rip+0xa/0x20 2014-01-07 19:06:42 [] ? kthread+0x0/0xa0 2014-01-07 19:06:42 [] ? child_rip+0x0/0x20 2014-01-07 19:06:42 ffff8807a36dd690 0000000000000046 ffff8807a36dd6b0 ffffffffa04e9367 2014-01-07 19:06:42 ffff8807a36dd6b0 0000000000000001 0000000000000cdd ffff880e00000000 2014-01-07 19:06:42 ffff8808342f7058 ffff8807a36ddfd8 000000000000fb88 ffff8808342f7058 2014-01-07 19:06:42 Call Trace: 2014-01-07 19:06:42 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:42 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:42 [] io_schedule+0x73/0xc0 2014-01-07 19:06:42 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:42 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:42 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:42 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:42 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:42 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:42 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:42 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:42 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:42 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:42 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:42 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:42 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:42 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] kthread+0x96/0xa0 2014-01-07 19:06:42 [] child_rip+0xa/0x20 2014-01-07 19:06:42 [] ? kthread+0x0/0xa0 2014-01-07 19:06:42 [] ? child_rip+0x0/0x20 2014-01-07 19:06:42 ffff8807a36f7690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:42 ffff8807a36f76b0 ffffffff00000001 ffff880529f173c0 ffff880e00000001 2014-01-07 19:06:42 ffff8808342f7ab8 ffff8807a36f7fd8 000000000000fb88 ffff8808342f7ab8 2014-01-07 19:06:42 Call Trace: 2014-01-07 19:06:42 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:42 [] io_schedule+0x73/0xc0 2014-01-07 19:06:42 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:42 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:42 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:42 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:42 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:42 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:42 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:42 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:42 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:42 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:42 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:42 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:42 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:42 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] kthread+0x96/0xa0 2014-01-07 19:06:42 [] child_rip+0xa/0x20 2014-01-07 19:06:42 [] ? kthread+0x0/0xa0 2014-01-07 19:06:42 [] ? child_rip+0x0/0x20 2014-01-07 19:06:42 ffff8807a32f9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:42 ffff8807a32f96b0 0000000000000001 0000000000000c24 ffff880e00000000 2014-01-07 19:06:42 ffff880829231ab8 ffff8807a32f9fd8 000000000000fb88 ffff880829231ab8 2014-01-07 19:06:42 Call Trace: 2014-01-07 19:06:42 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:42 [] io_schedule+0x73/0xc0 2014-01-07 19:06:42 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:42 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:42 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:42 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:42 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:42 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:42 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:42 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:42 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:42 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:42 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:42 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:42 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] kthread+0x96/0xa0 2014-01-07 19:06:42 [] child_rip+0xa/0x20 2014-01-07 19:06:42 [] ? kthread+0x0/0xa0 2014-01-07 19:06:42 [] ? child_rip+0x0/0x20 2014-01-07 19:06:42 ffff8807a32fb360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:42 ffff8807a32fb2e0 ffffffff8150fa5e ffff880e794a2340 ffff880e794a2658 2014-01-07 19:06:42 ffff880829231058 ffff8807a32fbfd8 000000000000fb88 ffff880829231058 2014-01-07 19:06:42 Call Trace: 2014-01-07 19:06:42 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:42 [] io_schedule+0x73/0xc0 2014-01-07 19:06:42 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:42 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:42 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:42 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:42 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:42 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:42 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:42 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:42 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:42 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:42 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:42 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:42 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:42 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:42 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:42 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:42 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:42 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:42 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:42 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:42 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:42 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:42 [] kthread+0x96/0xa0 2014-01-07 19:06:42 [] child_rip+0xa/0x20 2014-01-07 19:06:42 [] ? kthread+0x0/0xa0 2014-01-07 19:06:42 [] ? child_rip+0x0/0x20 2014-01-07 19:06:42 ffff8807a3311690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:42 ffff8807a33116b0 0000000000000001 0000000000000bcc ffff880e00000000 2014-01-07 19:06:42 ffff880834340638 ffff8807a3311fd8 000000000000fb88 ffff880834340638 2014-01-07 19:06:42 Call Trace: 2014-01-07 19:06:42 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:42 [] io_schedule+0x73/0xc0 2014-01-07 19:06:42 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:42 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:42 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:42 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:42 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:42 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:42 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:42 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:42 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:42 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:42 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:42 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:42 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:42 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:42 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:42 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:42 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:42 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] kthread+0x96/0xa0 2014-01-07 19:06:43 [] child_rip+0xa/0x20 2014-01-07 19:06:43 [] ? kthread+0x0/0xa0 2014-01-07 19:06:43 [] ? child_rip+0x0/0x20 2014-01-07 19:06:43 ffff8807a331b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:43 ffff8807a331b6b0 0000000000000001 0000000000000b75 ffff880e00000000 2014-01-07 19:06:43 ffff880834341098 ffff8807a331bfd8 000000000000fb88 ffff880834341098 2014-01-07 19:06:43 Call Trace: 2014-01-07 19:06:43 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:43 [] io_schedule+0x73/0xc0 2014-01-07 19:06:43 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:43 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:43 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:43 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:43 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:43 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:43 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:43 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:43 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:43 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:43 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:43 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:43 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:43 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] kthread+0x96/0xa0 2014-01-07 19:06:43 [] child_rip+0xa/0x20 2014-01-07 19:06:43 [] ? kthread+0x0/0xa0 2014-01-07 19:06:43 [] ? child_rip+0x0/0x20 2014-01-07 19:06:43 ffff8807a2f3f690 0000000000000046 ffff8807a2f3f6b0 ffffffffa04e9367 2014-01-07 19:06:43 ffff8807a2f3f6b0 0000000000000001 0000000000000b5d ffff880e00000000 2014-01-07 19:06:43 ffff880832575ab8 ffff8807a2f3ffd8 000000000000fb88 ffff880832575ab8 2014-01-07 19:06:43 Call Trace: 2014-01-07 19:06:43 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:43 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:43 [] io_schedule+0x73/0xc0 2014-01-07 19:06:43 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:43 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:43 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:43 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:43 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:43 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:43 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:43 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:43 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:43 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:43 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:43 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:43 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:43 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] kthread+0x96/0xa0 2014-01-07 19:06:43 [] child_rip+0xa/0x20 2014-01-07 19:06:43 [] ? kthread+0x0/0xa0 2014-01-07 19:06:43 [] ? child_rip+0x0/0x20 2014-01-07 19:06:43 ffff8807a2f59690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:43 ffff8807a2f596b0 0000000000000001 0000000000000c5b ffff880e00000000 2014-01-07 19:06:43 ffff880832575058 ffff8807a2f59fd8 000000000000fb88 ffff880832575058 2014-01-07 19:06:43 Call Trace: 2014-01-07 19:06:43 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:43 [] io_schedule+0x73/0xc0 2014-01-07 19:06:43 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:43 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:43 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:43 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:43 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:43 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:43 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:43 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:43 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:43 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:43 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:43 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:43 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:43 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] kthread+0x96/0xa0 2014-01-07 19:06:43 [] child_rip+0xa/0x20 2014-01-07 19:06:43 [] ? kthread+0x0/0xa0 2014-01-07 19:06:43 [] ? child_rip+0x0/0x20 2014-01-07 19:06:43 ffff8807a2f71690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:43 ffff8807a2f716b0 0000000000000002 0000000000000b0b ffff880e00000000 2014-01-07 19:06:43 ffff880831dc9af8 ffff8807a2f71fd8 000000000000fb88 ffff880831dc9af8 2014-01-07 19:06:43 Call Trace: 2014-01-07 19:06:43 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:43 [] io_schedule+0x73/0xc0 2014-01-07 19:06:43 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:43 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:43 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:43 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:43 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:43 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:43 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:43 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:43 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:43 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:43 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:43 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:43 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:43 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] kthread+0x96/0xa0 2014-01-07 19:06:43 [] child_rip+0xa/0x20 2014-01-07 19:06:43 [] ? kthread+0x0/0xa0 2014-01-07 19:06:43 [] ? child_rip+0x0/0x20 2014-01-07 19:06:43 ffff8807a2b87da0 0000000000000046 0000000000000000 ffff8807c547d2c0 2014-01-07 19:06:43 ffff8807d0a43000 0000000000000000 0000000000000001 ffff8810338651c0 2014-01-07 19:06:43 ffff8808293b9098 ffff8807a2b87fd8 000000000000fb88 ffff8808293b9098 2014-01-07 19:06:43 Call Trace: 2014-01-07 19:06:43 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:43 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:43 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] kthread+0x96/0xa0 2014-01-07 19:06:43 [] child_rip+0xa/0x20 2014-01-07 19:06:43 [] ? kthread+0x0/0xa0 2014-01-07 19:06:43 [] ? child_rip+0x0/0x20 2014-01-07 19:06:43 ffff8807a2b8d360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:43 ffff8807a2b8d2e0 ffffffff8150fa5e ffff880e7a958d60 ffff880e7a959078 2014-01-07 19:06:43 ffff8808293b8638 ffff8807a2b8dfd8 000000000000fb88 ffff8808293b8638 2014-01-07 19:06:43 Call Trace: 2014-01-07 19:06:43 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:43 [] io_schedule+0x73/0xc0 2014-01-07 19:06:43 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:43 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:43 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:43 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:43 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:43 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:43 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:43 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:43 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:43 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:43 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:43 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:43 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:43 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:43 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:43 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:43 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:43 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:43 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:43 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:43 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:43 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:43 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:43 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:43 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:43 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] kthread+0x96/0xa0 2014-01-07 19:06:44 [] child_rip+0xa/0x20 2014-01-07 19:06:44 [] ? kthread+0x0/0xa0 2014-01-07 19:06:44 [] ? child_rip+0x0/0x20 2014-01-07 19:06:44 ffff8807a2bd1690 0000000000000046 ffff8807a2bd16b0 ffffffffa04e9367 2014-01-07 19:06:44 ffff8807a2bd16b0 0000000000000001 0000000000000e78 ffff880e00000000 2014-01-07 19:06:44 ffff88083103b058 ffff8807a2bd1fd8 000000000000fb88 ffff88083103b058 2014-01-07 19:06:44 Call Trace: 2014-01-07 19:06:44 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:44 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:44 [] io_schedule+0x73/0xc0 2014-01-07 19:06:44 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:44 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:44 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:44 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:44 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:44 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:44 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:44 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:44 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:44 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:44 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:44 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:44 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:44 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] kthread+0x96/0xa0 2014-01-07 19:06:44 [] child_rip+0xa/0x20 2014-01-07 19:06:44 [] ? kthread+0x0/0xa0 2014-01-07 19:06:44 [] ? child_rip+0x0/0x20 2014-01-07 19:06:44 ffff8807a2bd9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:44 ffff8807a2bd96b0 0000000000000001 0000000000000e21 ffff880700000000 2014-01-07 19:06:44 ffff8808334edaf8 ffff8807a2bd9fd8 000000000000fb88 ffff8808334edaf8 2014-01-07 19:06:44 Call Trace: 2014-01-07 19:06:44 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:44 [] io_schedule+0x73/0xc0 2014-01-07 19:06:44 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:44 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:44 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:44 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:44 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:44 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:44 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:44 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:44 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:44 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:44 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:44 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:44 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:44 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] kthread+0x96/0xa0 2014-01-07 19:06:44 [] child_rip+0xa/0x20 2014-01-07 19:06:44 [] ? kthread+0x0/0xa0 2014-01-07 19:06:44 [] ? child_rip+0x0/0x20 2014-01-07 19:06:44 ffff8807a201d360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:44 ffff8807a201d2e0 ffffffff8150fa5e ffff880e8e5fd7c0 ffff880e8e5fdad8 2014-01-07 19:06:44 ffff8808334ed098 ffff8807a201dfd8 000000000000fb88 ffff8808334ed098 2014-01-07 19:06:44 Call Trace: 2014-01-07 19:06:44 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:44 [] io_schedule+0x73/0xc0 2014-01-07 19:06:44 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:44 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:44 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:44 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:44 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:44 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:44 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:44 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:44 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:44 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:44 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:44 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:44 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:44 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:44 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:44 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:44 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:44 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:44 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:44 scsi host7: SRP abort called 2014-01-07 19:06:44 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:44 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:44 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] kthread+0x96/0xa0 2014-01-07 19:06:44 [] child_rip+0xa/0x20 2014-01-07 19:06:44 [] ? kthread+0x0/0xa0 2014-01-07 19:06:44 [] ? child_rip+0x0/0x20 2014-01-07 19:06:44 ffff8807a201f690 0000000000000046 ffff8807a201f6b0 ffffffffa04e9367 2014-01-07 19:06:44 ffff8807a201f6b0 0000000000000001 0000000000000e48 ffff880e00000000 2014-01-07 19:06:44 ffff880831dc8638 ffff8807a201ffd8 000000000000fb88 ffff880831dc8638 2014-01-07 19:06:44 Call Trace: 2014-01-07 19:06:44 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:44 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:44 [] io_schedule+0x73/0xc0 2014-01-07 19:06:44 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:44 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:44 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:44 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:44 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:44 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:44 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:44 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:44 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:44 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:44 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:44 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:44 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:44 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] kthread+0x96/0xa0 2014-01-07 19:06:44 [] child_rip+0xa/0x20 2014-01-07 19:06:44 [] ? kthread+0x0/0xa0 2014-01-07 19:06:44 [] ? child_rip+0x0/0x20 2014-01-07 19:06:44 ffff8807a2055690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:44 ffff8807a20556b0 0000000000000001 0000000000000d12 ffff880700000000 2014-01-07 19:06:44 ffff880829397058 ffff8807a2055fd8 000000000000fb88 ffff880829397058 2014-01-07 19:06:44 Call Trace: 2014-01-07 19:06:44 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:44 [] io_schedule+0x73/0xc0 2014-01-07 19:06:44 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:44 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:44 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:44 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:44 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:44 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:44 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:44 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:44 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:44 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:44 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:44 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:44 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:44 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:44 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:44 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:44 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:44 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:44 [] kthread+0x96/0xa0 2014-01-07 19:06:44 [] child_rip+0xa/0x20 2014-01-07 19:06:44 [] ? kthread+0x0/0xa0 2014-01-07 19:06:44 [] ? child_rip+0x0/0x20 2014-01-07 19:06:44 ffff8807a2059690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:44 ffff8807a20596b0 0000000000000001 0000000000000d23 ffff880e00000000 2014-01-07 19:06:44 ffff8807a2057ab8 ffff8807a2059fd8 000000000000fb88 ffff8807a2057ab8 2014-01-07 19:06:44 Call Trace: 2014-01-07 19:06:44 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:45 [] io_schedule+0x73/0xc0 2014-01-07 19:06:45 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:45 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:45 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:45 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:45 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:45 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] kthread+0x96/0xa0 2014-01-07 19:06:45 [] child_rip+0xa/0x20 2014-01-07 19:06:45 [] ? kthread+0x0/0xa0 2014-01-07 19:06:45 [] ? child_rip+0x0/0x20 2014-01-07 19:06:45 ffff8807a205d360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:45 ffff8807a205d2e0 ffffffff8150fa5e ffff880e8f1bb4c0 ffff880e8f1bb7d8 2014-01-07 19:06:45 ffff8807a2057058 ffff8807a205dfd8 000000000000fb88 ffff8807a2057058 2014-01-07 19:06:45 Call Trace: 2014-01-07 19:06:45 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:45 [] io_schedule+0x73/0xc0 2014-01-07 19:06:45 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:45 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:45 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:45 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:45 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:45 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:45 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:45 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:45 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:45 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:45 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:45 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:45 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:45 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] kthread+0x96/0xa0 2014-01-07 19:06:45 [] child_rip+0xa/0x20 2014-01-07 19:06:45 [] ? kthread+0x0/0xa0 2014-01-07 19:06:45 [] ? child_rip+0x0/0x20 2014-01-07 19:06:45 ffff8807a2263da0 0000000000000046 0000000000000000 ffff8807a2263d64 2014-01-07 19:06:45 ffff880700000000 ffff88083fe81c00 ffff880044616740 000000000000015a 2014-01-07 19:06:45 ffff8807a20565f8 ffff8807a2263fd8 000000000000fb88 ffff8807a20565f8 2014-01-07 19:06:45 Call Trace: 2014-01-07 19:06:45 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:45 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:45 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] kthread+0x96/0xa0 2014-01-07 19:06:45 [] child_rip+0xa/0x20 2014-01-07 19:06:45 [] ? kthread+0x0/0xa0 2014-01-07 19:06:45 [] ? child_rip+0x0/0x20 2014-01-07 19:06:45 ffff8807a1cab690 0000000000000046 ffff8807a1cab658 ffff8807a1cab654 2014-01-07 19:06:45 ffff8807a1cab6b0 ffff88083fe82200 ffff88085c456740 0000000000000400 2014-01-07 19:06:45 ffff8807a1ca9af8 ffff8807a1cabfd8 000000000000fb88 ffff8807a1ca9af8 2014-01-07 19:06:45 Call Trace: 2014-01-07 19:06:45 [] io_schedule+0x73/0xc0 2014-01-07 19:06:45 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:45 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:45 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:45 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:45 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:45 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:45 scsi host6: SRP abort called 2014-01-07 19:06:45 [] kthread+0x96/0xa0 2014-01-07 19:06:45 [] child_rip+0xa/0x20 2014-01-07 19:06:45 [] ? kthread+0x0/0xa0 2014-01-07 19:06:45 [] ? child_rip+0x0/0x20 2014-01-07 19:06:45 ffff8807a1cb1690 0000000000000046 ffff8807a1cb16b0 ffffffffa04e9367 2014-01-07 19:06:45 ffff8807a1cb16b0 0000000000000001 0000000000000d10 ffff880700000000 2014-01-07 19:06:45 ffff8807a1ca9098 ffff8807a1cb1fd8 000000000000fb88 ffff8807a1ca9098 2014-01-07 19:06:45 Call Trace: 2014-01-07 19:06:45 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:45 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:45 [] io_schedule+0x73/0xc0 2014-01-07 19:06:45 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:45 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:45 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:45 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:45 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:45 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:45 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] kthread+0x96/0xa0 2014-01-07 19:06:45 [] child_rip+0xa/0x20 2014-01-07 19:06:45 [] ? kthread+0x0/0xa0 2014-01-07 19:06:45 [] ? child_rip+0x0/0x20 2014-01-07 19:06:45 ffff8807a18b3550 0000000000000046 ffff8807ffffffff 0000000000281826 2014-01-07 19:06:45 0000000200003232 0000000affffffff ffffffffffffffff 0000000076758928 2014-01-07 19:06:45 ffff8807a1ca8638 ffff8807a18b3fd8 000000000000fb88 ffff8807a1ca8638 2014-01-07 19:06:45 Call Trace: 2014-01-07 19:06:45 [] ? vsnprintf+0x336/0x5e0 2014-01-07 19:06:45 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:06:45 [] mutex_lock+0x2b/0x50 2014-01-07 19:06:45 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:06:45 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:45 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:45 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:45 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:45 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:45 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:45 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:45 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:45 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:45 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:45 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:45 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:45 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:45 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:45 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:45 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:45 [] kthread+0x96/0xa0 2014-01-07 19:06:45 [] child_rip+0xa/0x20 2014-01-07 19:06:45 [] ? kthread+0x0/0xa0 2014-01-07 19:06:45 [] ? child_rip+0x0/0x20 2014-01-07 19:06:45 ffff8807a18b7690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:45 ffff8807a18b76b0 ffffffff00000001 ffff8807d1a874b0 ffff8807d1a874a8 2014-01-07 19:06:45 ffff8807a18b5ab8 ffff8807a18b7fd8 000000000000fb88 ffff8807a18b5ab8 2014-01-07 19:06:45 Call Trace: 2014-01-07 19:06:45 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:45 [] io_schedule+0x73/0xc0 2014-01-07 19:06:45 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:46 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:46 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:46 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:46 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:46 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] kthread+0x96/0xa0 2014-01-07 19:06:46 [] child_rip+0xa/0x20 2014-01-07 19:06:46 [] ? kthread+0x0/0xa0 2014-01-07 19:06:46 [] ? child_rip+0x0/0x20 2014-01-07 19:06:46 ffff8807a18bb690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:46 ffff8807a18bb6b0 0000000000000001 0000000000000de9 ffff880700000000 2014-01-07 19:06:46 ffff8807a18b5058 ffff8807a18bbfd8 000000000000fb88 ffff8807a18b5058 2014-01-07 19:06:46 Call Trace: 2014-01-07 19:06:46 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:46 [] io_schedule+0x73/0xc0 2014-01-07 19:06:46 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:46 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:46 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:46 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:46 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:46 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] kthread+0x96/0xa0 2014-01-07 19:06:46 [] child_rip+0xa/0x20 2014-01-07 19:06:46 [] ? kthread+0x0/0xa0 2014-01-07 19:06:46 [] ? child_rip+0x0/0x20 2014-01-07 19:06:46 ffff8807a18d3690 0000000000000046 ffff8807a18d36b0 ffffffffa04e9367 2014-01-07 19:06:46 ffff8807a18d36b0 0000000000000001 0000000000000c6e ffff880e00000000 2014-01-07 19:06:46 ffff8807a18b45f8 ffff8807a18d3fd8 000000000000fb88 ffff8807a18b45f8 2014-01-07 19:06:46 Call Trace: 2014-01-07 19:06:46 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:46 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:46 [] io_schedule+0x73/0xc0 2014-01-07 19:06:46 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:46 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:46 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:46 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:46 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:46 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] kthread+0x96/0xa0 2014-01-07 19:06:46 [] child_rip+0xa/0x20 2014-01-07 19:06:46 [] ? kthread+0x0/0xa0 2014-01-07 19:06:46 [] ? child_rip+0x0/0x20 2014-01-07 19:06:46 ffff8807a14f5690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:46 ffff8807a14f56b0 0000000000000001 0000000000000dec ffff880700000000 2014-01-07 19:06:46 ffff8807a14f3af8 ffff8807a14f5fd8 000000000000fb88 ffff8807a14f3af8 2014-01-07 19:06:46 Call Trace: 2014-01-07 19:06:46 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:46 [] io_schedule+0x73/0xc0 2014-01-07 19:06:46 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:46 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:46 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:46 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:46 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:46 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] kthread+0x96/0xa0 2014-01-07 19:06:46 [] child_rip+0xa/0x20 2014-01-07 19:06:46 [] ? kthread+0x0/0xa0 2014-01-07 19:06:46 [] ? child_rip+0x0/0x20 2014-01-07 19:06:46 ffff8807a16b1690 0000000000000046 0000000000000000 ffff8807a16b1654 2014-01-07 19:06:46 ffff880700000000 ffff88083fe82800 ffff880044696740 0000000000000400 2014-01-07 19:06:46 ffff8807a14f3098 ffff8807a16b1fd8 000000000000fb88 ffff8807a14f3098 2014-01-07 19:06:46 Call Trace: 2014-01-07 19:06:46 [] io_schedule+0x73/0xc0 2014-01-07 19:06:46 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:46 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:46 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:46 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:46 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:46 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:46 [] kthread+0x96/0xa0 2014-01-07 19:06:46 [] child_rip+0xa/0x20 2014-01-07 19:06:46 [] ? kthread+0x0/0xa0 2014-01-07 19:06:46 [] ? child_rip+0x0/0x20 2014-01-07 19:06:46 ffff8807a1101690 0000000000000046 ffff8807a11016b0 ffffffffa04e9367 2014-01-07 19:06:46 ffff8807a11016b0 0000000000000001 0000000000000bac ffff880e00000000 2014-01-07 19:06:46 ffff8807a14f2638 ffff8807a1101fd8 000000000000fb88 ffff8807a14f2638 2014-01-07 19:06:46 Call Trace: 2014-01-07 19:06:46 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:46 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:46 [] io_schedule+0x73/0xc0 2014-01-07 19:06:46 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:46 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:46 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:46 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:46 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:46 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:46 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:46 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:46 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:46 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:46 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:46 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:46 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:46 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:46 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:47 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:47 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:47 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] kthread+0x96/0xa0 2014-01-07 19:06:47 [] child_rip+0xa/0x20 2014-01-07 19:06:47 [] ? kthread+0x0/0xa0 2014-01-07 19:06:47 [] ? child_rip+0x0/0x20 2014-01-07 19:06:47 ffff8807a1105690 0000000000000046 ffff8807a11056b0 ffffffffa04e9367 2014-01-07 19:06:47 ffff8807a11056b0 0000000000000001 0000000000000b4d ffff880e00000000 2014-01-07 19:06:47 ffff8807a1103ab8 ffff8807a1105fd8 000000000000fb88 ffff8807a1103ab8 2014-01-07 19:06:47 Call Trace: 2014-01-07 19:06:47 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:47 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:47 [] io_schedule+0x73/0xc0 2014-01-07 19:06:47 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:47 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:47 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:47 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:47 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:47 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:47 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:47 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:47 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:47 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:47 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:47 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:47 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:47 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] kthread+0x96/0xa0 2014-01-07 19:06:47 [] child_rip+0xa/0x20 2014-01-07 19:06:47 [] ? kthread+0x0/0xa0 2014-01-07 19:06:47 [] ? child_rip+0x0/0x20 2014-01-07 19:06:47 ffff8807a1109360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:47 ffff8807a11092e0 ffffffff8150fa5e ffff880e79f0b920 ffff880e79f0bc38 2014-01-07 19:06:47 ffff8807a1103058 ffff8807a1109fd8 000000000000fb88 ffff8807a1103058 2014-01-07 19:06:47 Call Trace: 2014-01-07 19:06:47 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:47 [] io_schedule+0x73/0xc0 2014-01-07 19:06:47 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:47 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:47 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:47 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:47 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:47 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:47 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:47 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:47 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:47 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:47 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:47 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:47 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:47 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:47 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:47 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:47 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:47 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:47 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:47 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:47 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] kthread+0x96/0xa0 2014-01-07 19:06:47 [] child_rip+0xa/0x20 2014-01-07 19:06:47 [] ? kthread+0x0/0xa0 2014-01-07 19:06:47 [] ? child_rip+0x0/0x20 2014-01-07 19:06:47 ffff8807a0d0d690 0000000000000046 ffff8807a0d0d6b0 ffffffffa04e9367 2014-01-07 19:06:47 ffff8807a0d0d6b0 0000000000000001 0000000000000d69 ffff880e00000000 2014-01-07 19:06:47 ffff8807a11025f8 ffff8807a0d0dfd8 000000000000fb88 ffff8807a11025f8 2014-01-07 19:06:47 Call Trace: 2014-01-07 19:06:47 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:47 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:47 [] io_schedule+0x73/0xc0 2014-01-07 19:06:47 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:47 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:47 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:47 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:47 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:47 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:47 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:47 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:47 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:47 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:47 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:47 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:47 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] kthread+0x96/0xa0 2014-01-07 19:06:47 [] child_rip+0xa/0x20 2014-01-07 19:06:47 [] ? kthread+0x0/0xa0 2014-01-07 19:06:47 [] ? child_rip+0x0/0x20 2014-01-07 19:06:47 ffff8807a095b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:47 ffff8807a095b6b0 0000000000000001 0000000000000e32 ffff880700000000 2014-01-07 19:06:47 ffff8807a0959af8 ffff8807a095bfd8 000000000000fb88 ffff8807a0959af8 2014-01-07 19:06:47 Call Trace: 2014-01-07 19:06:47 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:47 [] io_schedule+0x73/0xc0 2014-01-07 19:06:47 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:47 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:47 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:47 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:47 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:47 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:47 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:47 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:47 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:47 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:47 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:47 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:47 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] kthread+0x96/0xa0 2014-01-07 19:06:47 [] child_rip+0xa/0x20 2014-01-07 19:06:47 [] ? kthread+0x0/0xa0 2014-01-07 19:06:47 [] ? child_rip+0x0/0x20 2014-01-07 19:06:47 ffff8807a055f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:47 ffff8807a055f6b0 0000000000000001 0000000000000e2e ffff880700000000 2014-01-07 19:06:47 ffff8807a0959098 ffff8807a055ffd8 000000000000fb88 ffff8807a0959098 2014-01-07 19:06:47 Call Trace: 2014-01-07 19:06:47 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:47 [] io_schedule+0x73/0xc0 2014-01-07 19:06:47 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:47 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:47 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:47 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:47 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:47 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:47 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:47 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:47 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:47 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:47 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:47 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:47 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:47 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:47 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:47 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:47 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:47 [] kthread+0x96/0xa0 2014-01-07 19:06:47 [] child_rip+0xa/0x20 2014-01-07 19:06:47 [] ? kthread+0x0/0xa0 2014-01-07 19:06:47 [] ? child_rip+0x0/0x20 2014-01-07 19:06:47 ffff8807a0165690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:47 ffff8807a01656b0 0000000000000001 0000000000000d9a ffff880e00000000 2014-01-07 19:06:47 ffff8807a0958638 ffff8807a0165fd8 000000000000fb88 ffff8807a0958638 2014-01-07 19:06:47 Call Trace: 2014-01-07 19:06:47 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:47 [] io_schedule+0x73/0xc0 2014-01-07 19:06:47 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:47 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:48 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:48 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:48 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:48 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:48 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:48 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:48 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:48 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:48 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:48 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:48 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:48 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] kthread+0x96/0xa0 2014-01-07 19:06:48 [] child_rip+0xa/0x20 2014-01-07 19:06:48 [] ? kthread+0x0/0xa0 2014-01-07 19:06:48 [] ? child_rip+0x0/0x20 2014-01-07 19:06:48 ffff88079fd69690 0000000000000046 ffff88079fd696b0 ffffffffa04e9367 2014-01-07 19:06:48 ffff88079fd696b0 0000000000000001 0000000000000bb3 ffff880e00000000 2014-01-07 19:06:48 ffff88079fd67ab8 ffff88079fd69fd8 000000000000fb88 ffff88079fd67ab8 2014-01-07 19:06:48 Call Trace: 2014-01-07 19:06:48 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:48 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:48 [] io_schedule+0x73/0xc0 2014-01-07 19:06:48 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:48 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:48 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:48 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:48 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:48 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:48 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:48 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:48 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:48 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:48 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:48 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:48 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:48 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] kthread+0x96/0xa0 2014-01-07 19:06:48 [] child_rip+0xa/0x20 2014-01-07 19:06:48 [] ? kthread+0x0/0xa0 2014-01-07 19:06:48 [] ? child_rip+0x0/0x20 2014-01-07 19:06:48 ffff88079f973690 0000000000000046 ffff88079f9736b0 ffffffffa04e9367 2014-01-07 19:06:48 ffff88079f9736b0 0000000000000001 0000000000000e8e ffff880700000000 2014-01-07 19:06:48 ffff88079fd67058 ffff88079f973fd8 000000000000fb88 ffff88079fd67058 2014-01-07 19:06:48 Call Trace: 2014-01-07 19:06:48 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:48 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:48 [] io_schedule+0x73/0xc0 2014-01-07 19:06:48 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:48 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:48 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:48 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:48 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:48 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:48 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:48 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:48 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:48 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:48 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:48 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:48 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:48 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] kthread+0x96/0xa0 2014-01-07 19:06:48 [] child_rip+0xa/0x20 2014-01-07 19:06:48 [] ? kthread+0x0/0xa0 2014-01-07 19:06:48 [] ? child_rip+0x0/0x20 2014-01-07 19:06:48 ffff88079fa6d690 0000000000000046 ffff88079fa6d6b0 ffffffffa04e9367 2014-01-07 19:06:48 ffff88079fa6d6b0 0000000000000001 0000000000000c9e ffff880e00000000 2014-01-07 19:06:48 ffff88079fd665f8 ffff88079fa6dfd8 000000000000fb88 ffff88079fd665f8 2014-01-07 19:06:48 Call Trace: 2014-01-07 19:06:48 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:48 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:48 [] io_schedule+0x73/0xc0 2014-01-07 19:06:48 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:48 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:48 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:48 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:48 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:48 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:48 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:48 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:48 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:48 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:48 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:48 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:48 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:48 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] kthread+0x96/0xa0 2014-01-07 19:06:48 [] child_rip+0xa/0x20 2014-01-07 19:06:48 [] ? kthread+0x0/0xa0 2014-01-07 19:06:48 [] ? child_rip+0x0/0x20 2014-01-07 19:06:48 ffff88079f5c3690 0000000000000046 ffff88079f5c36b0 ffffffffa04e9367 2014-01-07 19:06:48 ffff88079f5c36b0 0000000000000001 0000000000000b9d ffff880e00000000 2014-01-07 19:06:48 ffff88079f5c1af8 ffff88079f5c3fd8 000000000000fb88 ffff88079f5c1af8 2014-01-07 19:06:48 Call Trace: 2014-01-07 19:06:48 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:48 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:48 [] io_schedule+0x73/0xc0 2014-01-07 19:06:48 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:48 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:48 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:48 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:48 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:48 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:48 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:48 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:48 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:48 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:48 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:48 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:48 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:48 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:48 [] kthread+0x96/0xa0 2014-01-07 19:06:48 [] child_rip+0xa/0x20 2014-01-07 19:06:48 [] ? kthread+0x0/0xa0 2014-01-07 19:06:48 [] ? child_rip+0x0/0x20 2014-01-07 19:06:48 ffff88079f5c7690 0000000000000046 ffff88079f5c76b0 ffffffffa04e9367 2014-01-07 19:06:48 ffff88079f5c76b0 0000000000000001 0000000000000ce7 ffff880e00000000 2014-01-07 19:06:48 ffff88079f5c1098 ffff88079f5c7fd8 000000000000fb88 ffff88079f5c1098 2014-01-07 19:06:48 Call Trace: 2014-01-07 19:06:48 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:48 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:48 [] io_schedule+0x73/0xc0 2014-01-07 19:06:48 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:48 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:48 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:48 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:48 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:48 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:48 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:48 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:48 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:48 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:48 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:48 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:48 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:48 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:49 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:49 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:49 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:49 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] kthread+0x96/0xa0 2014-01-07 19:06:49 [] child_rip+0xa/0x20 2014-01-07 19:06:49 [] ? kthread+0x0/0xa0 2014-01-07 19:06:49 [] ? child_rip+0x0/0x20 2014-01-07 19:06:49 ffff88079f123360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:49 ffff88079f1232e0 ffffffff8150fa5e ffff880e842c1ee0 ffff880e842c21f8 2014-01-07 19:06:49 ffff8808319a5058 ffff88079f123fd8 000000000000fb88 ffff8808319a5058 2014-01-07 19:06:49 Call Trace: 2014-01-07 19:06:49 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:49 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:49 [] io_schedule+0x73/0xc0 2014-01-07 19:06:49 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:49 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:49 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:49 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:49 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:49 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:49 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:49 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:49 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:49 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:49 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:49 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:49 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:49 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:49 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:49 [] ? lprocfs_counter_add+0xa6/0x1d6 [lvfs] 2014-01-07 19:06:49 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:49 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:49 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:49 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:49 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:49 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:49 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:49 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] kthread+0x96/0xa0 2014-01-07 19:06:49 [] child_rip+0xa/0x20 2014-01-07 19:06:49 [] ? kthread+0x0/0xa0 2014-01-07 19:06:49 [] ? child_rip+0x0/0x20 2014-01-07 19:06:49 ffff88079f229690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:49 ffff88079f2296b0 ffffffff00000001 ffff8807c672a1c8 ffff8807c672a1c0 2014-01-07 19:06:49 ffff88079f5c0638 ffff88079f229fd8 000000000000fb88 ffff88079f5c0638 2014-01-07 19:06:49 Call Trace: 2014-01-07 19:06:49 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:49 [] io_schedule+0x73/0xc0 2014-01-07 19:06:49 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:49 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:49 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:49 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:49 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:49 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:49 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:49 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:49 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:49 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:49 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:49 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:49 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:49 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] kthread+0x96/0xa0 2014-01-07 19:06:49 [] child_rip+0xa/0x20 2014-01-07 19:06:49 [] ? kthread+0x0/0xa0 2014-01-07 19:06:49 [] ? child_rip+0x0/0x20 2014-01-07 19:06:49 ffff88079e26b360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:49 ffff88079e26b2e0 ffffffff8150fa5e ffff8807dd12ac00 ffff8807dd12af18 2014-01-07 19:06:49 ffff88079e269ab8 ffff88079e26bfd8 000000000000fb88 ffff88079e269ab8 2014-01-07 19:06:49 Call Trace: 2014-01-07 19:06:49 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:49 [] io_schedule+0x73/0xc0 2014-01-07 19:06:49 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:49 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:49 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:49 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:49 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:49 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:49 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:49 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:49 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:06:49 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:49 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:49 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:49 scsi host7: SRP abort called 2014-01-07 19:06:49 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:49 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:49 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:49 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:49 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:49 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:49 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:49 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:49 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] kthread+0x96/0xa0 2014-01-07 19:06:49 [] child_rip+0xa/0x20 2014-01-07 19:06:49 [] ? kthread+0x0/0xa0 2014-01-07 19:06:49 [] ? child_rip+0x0/0x20 2014-01-07 19:06:49 ffff88079de8d690 0000000000000046 ffff88079de8d6b0 ffffffffa04e9367 2014-01-07 19:06:49 ffff88079de8d6b0 0000000000000001 0000000000000dfe ffff880e00000000 2014-01-07 19:06:49 ffff88079de8baf8 ffff88079de8dfd8 000000000000fb88 ffff88079de8baf8 2014-01-07 19:06:49 Call Trace: 2014-01-07 19:06:49 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:49 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:49 [] io_schedule+0x73/0xc0 2014-01-07 19:06:49 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:49 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:49 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:49 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:49 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:49 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:49 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:49 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:49 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:49 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:49 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:49 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:49 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:49 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:49 [] kthread+0x96/0xa0 2014-01-07 19:06:49 [] child_rip+0xa/0x20 2014-01-07 19:06:49 [] ? kthread+0x0/0xa0 2014-01-07 19:06:49 [] ? child_rip+0x0/0x20 2014-01-07 19:06:49 ffff88079d72f360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:49 ffff88079d72f2e0 ffffffff8150fa5e ffff880e796bd360 ffff880e796bd678 2014-01-07 19:06:49 ffff88079de8b098 ffff88079d72ffd8 000000000000fb88 ffff88079de8b098 2014-01-07 19:06:49 Call Trace: 2014-01-07 19:06:49 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:49 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:49 [] io_schedule+0x73/0xc0 2014-01-07 19:06:49 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:49 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:49 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:49 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:49 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:49 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:49 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:49 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:49 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:49 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:49 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:49 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:49 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:49 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:49 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:49 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:49 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:49 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:49 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:50 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:50 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:50 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:50 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:50 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:50 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:50 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] kthread+0x96/0xa0 2014-01-07 19:06:50 [] child_rip+0xa/0x20 2014-01-07 19:06:50 [] ? kthread+0x0/0xa0 2014-01-07 19:06:50 [] ? child_rip+0x0/0x20 2014-01-07 19:06:50 ffff880796b83da0 0000000000000046 0000000000000000 ffff880ff2a82840 2014-01-07 19:06:50 ffff880ff54aa000 0000000000000000 0000000000000061 ffff8810343b6580 2014-01-07 19:06:50 ffff88079de8a638 ffff880796b83fd8 000000000000fb88 ffff88079de8a638 2014-01-07 19:06:50 Call Trace: 2014-01-07 19:06:50 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:50 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:50 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] kthread+0x96/0xa0 2014-01-07 19:06:50 [] child_rip+0xa/0x20 2014-01-07 19:06:50 [] ? kthread+0x0/0xa0 2014-01-07 19:06:50 [] ? child_rip+0x0/0x20 2014-01-07 19:06:50 ffff88078fd21690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:50 ffff88078fd216b0 0000000000000001 0000000000000e1f ffff880700000000 2014-01-07 19:06:50 ffff88078fd1fab8 ffff88078fd21fd8 000000000000fb88 ffff88078fd1fab8 2014-01-07 19:06:50 Call Trace: 2014-01-07 19:06:50 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:50 [] io_schedule+0x73/0xc0 2014-01-07 19:06:50 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:50 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:50 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:50 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:50 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:50 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:50 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:50 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:50 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:50 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:50 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:50 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:50 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:50 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] kthread+0x96/0xa0 2014-01-07 19:06:50 [] child_rip+0xa/0x20 2014-01-07 19:06:50 [] ? kthread+0x0/0xa0 2014-01-07 19:06:50 [] ? child_rip+0x0/0x20 2014-01-07 19:06:50 ffff88078e977690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:50 ffff88078e9776b0 ffffffff00000001 ffff88063ff3d890 ffff880e00000001 2014-01-07 19:06:50 ffff880833ce7af8 ffff88078e977fd8 000000000000fb88 ffff880833ce7af8 2014-01-07 19:06:50 Call Trace: 2014-01-07 19:06:50 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:50 [] io_schedule+0x73/0xc0 2014-01-07 19:06:50 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:50 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:50 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:50 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:50 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:50 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:50 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:50 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:50 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:50 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:50 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:50 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:50 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:50 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] kthread+0x96/0xa0 2014-01-07 19:06:50 [] child_rip+0xa/0x20 2014-01-07 19:06:50 [] ? kthread+0x0/0xa0 2014-01-07 19:06:50 [] ? child_rip+0x0/0x20 2014-01-07 19:06:50 ffff88078b5754e0 0000000000000046 0000000000000000 ffffffff8127fa1e 2014-01-07 19:06:50 0000002100000005 ffff880ff3b49000 ffff88078b575460 ffff88078b575480 2014-01-07 19:06:50 ffff8808183ee5f8 ffff88078b575fd8 000000000000fb88 ffff8808183ee5f8 2014-01-07 19:06:50 Call Trace: 2014-01-07 19:06:50 [] ? number+0x2ee/0x320 2014-01-07 19:06:50 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:06:50 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:06:50 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:06:50 [] ? down_write+0x32/0x40 2014-01-07 19:06:50 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:06:50 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:50 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:50 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:50 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:50 scsi host6: SRP abort called 2014-01-07 19:06:50 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:50 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:50 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:50 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:50 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:50 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:50 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:50 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] kthread+0x96/0xa0 2014-01-07 19:06:50 [] child_rip+0xa/0x20 2014-01-07 19:06:50 [] ? kthread+0x0/0xa0 2014-01-07 19:06:50 [] ? child_rip+0x0/0x20 2014-01-07 19:06:50 ffff88078b1dd690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:50 ffff88078b1dd6b0 0000000000000001 0000000000000d7a ffff880e00000000 2014-01-07 19:06:50 ffff8808183ef058 ffff88078b1ddfd8 000000000000fb88 ffff8808183ef058 2014-01-07 19:06:50 Call Trace: 2014-01-07 19:06:50 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:50 [] io_schedule+0x73/0xc0 2014-01-07 19:06:50 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:50 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:50 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:50 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:50 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:50 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:50 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:50 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:50 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:50 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:50 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:50 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:50 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:50 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:50 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:50 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:50 [] kthread+0x96/0xa0 2014-01-07 19:06:50 [] child_rip+0xa/0x20 2014-01-07 19:06:50 [] ? kthread+0x0/0xa0 2014-01-07 19:06:50 [] ? child_rip+0x0/0x20 2014-01-07 19:06:50 ffff88078aed9360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:50 ffff88078aed92e0 ffffffff8150fa5e ffff880e79ba84a0 ffff880e79ba87b8 2014-01-07 19:06:50 ffff880831a57098 ffff88078aed9fd8 000000000000fb88 ffff880831a57098 2014-01-07 19:06:50 Call Trace: 2014-01-07 19:06:50 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:50 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:50 [] io_schedule+0x73/0xc0 2014-01-07 19:06:50 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:50 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:50 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:50 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:50 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:50 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:50 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:50 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:50 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:50 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:50 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:50 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:50 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:50 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:50 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:50 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:50 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:51 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:51 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:51 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:51 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:51 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:51 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:51 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] kthread+0x96/0xa0 2014-01-07 19:06:51 [] child_rip+0xa/0x20 2014-01-07 19:06:51 [] ? kthread+0x0/0xa0 2014-01-07 19:06:51 [] ? child_rip+0x0/0x20 2014-01-07 19:06:51 ffff88078aedb360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:51 ffff88078aedb2e0 ffffffff8150fa5e ffff880e78c98900 ffff880e78c98c18 2014-01-07 19:06:51 ffff880831a56638 ffff88078aedbfd8 000000000000fb88 ffff880831a56638 2014-01-07 19:06:51 Call Trace: 2014-01-07 19:06:51 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:51 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:51 [] io_schedule+0x73/0xc0 2014-01-07 19:06:51 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:51 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:51 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:51 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:51 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:51 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:51 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:51 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:51 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:51 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:51 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:51 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:51 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:51 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:51 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:51 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:51 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:51 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:51 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:51 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:51 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:51 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] kthread+0x96/0xa0 2014-01-07 19:06:51 [] child_rip+0xa/0x20 2014-01-07 19:06:51 [] ? kthread+0x0/0xa0 2014-01-07 19:06:51 [] ? child_rip+0x0/0x20 2014-01-07 19:06:51 ffff88078aedd690 0000000000000046 ffff88078aedd6b0 ffffffffa04e9367 2014-01-07 19:06:51 ffff88078aedd6b0 0000000000000001 0000000000000c7c ffff880e00000000 2014-01-07 19:06:51 ffff8808327f9ab8 ffff88078aeddfd8 000000000000fb88 ffff8808327f9ab8 2014-01-07 19:06:51 Call Trace: 2014-01-07 19:06:51 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:51 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:51 [] io_schedule+0x73/0xc0 2014-01-07 19:06:51 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:51 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:51 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:51 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:51 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:51 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:51 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:51 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:51 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:51 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:51 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:51 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:51 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:51 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] kthread+0x96/0xa0 2014-01-07 19:06:51 [] child_rip+0xa/0x20 2014-01-07 19:06:51 [] ? kthread+0x0/0xa0 2014-01-07 19:06:51 [] ? child_rip+0x0/0x20 2014-01-07 19:06:51 ffff88078a61b690 0000000000000046 ffff88078a61b6b0 ffffffffa04e9367 2014-01-07 19:06:51 ffff88078a61b6b0 0000000000000001 0000000000000d95 ffff880e00000000 2014-01-07 19:06:51 ffff8808326d9058 ffff88078a61bfd8 000000000000fb88 ffff8808326d9058 2014-01-07 19:06:51 Call Trace: 2014-01-07 19:06:51 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:51 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:51 [] io_schedule+0x73/0xc0 2014-01-07 19:06:51 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:51 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:51 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:51 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:51 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:51 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:51 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:51 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:51 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:51 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:51 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:51 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:51 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:51 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] kthread+0x96/0xa0 2014-01-07 19:06:51 [] child_rip+0xa/0x20 2014-01-07 19:06:51 [] ? kthread+0x0/0xa0 2014-01-07 19:06:51 [] ? child_rip+0x0/0x20 2014-01-07 19:06:51 ffff88078a7e3690 0000000000000046 ffff88078a7e36b0 ffffffffa04e9367 2014-01-07 19:06:51 ffff88078a7e36b0 0000000000000001 0000000000000dcc ffff880700000000 2014-01-07 19:06:51 ffff880833ff1058 ffff88078a7e3fd8 000000000000fb88 ffff880833ff1058 2014-01-07 19:06:51 Call Trace: 2014-01-07 19:06:51 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:51 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:51 [] io_schedule+0x73/0xc0 2014-01-07 19:06:51 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:51 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:51 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:51 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:51 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:51 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:51 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:51 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:51 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:51 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:51 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:51 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:51 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:51 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:51 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:51 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:51 [] kthread+0x96/0xa0 2014-01-07 19:06:51 [] child_rip+0xa/0x20 2014-01-07 19:06:51 [] ? kthread+0x0/0xa0 2014-01-07 19:06:51 [] ? child_rip+0x0/0x20 2014-01-07 19:06:51 ffff88078a233360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:51 ffff88078a2332e0 ffffffff8150fa5e ffff88061189a7a0 ffff88061189aab8 2014-01-07 19:06:51 ffff880833ff05f8 ffff88078a233fd8 000000000000fb88 ffff880833ff05f8 2014-01-07 19:06:51 Call Trace: 2014-01-07 19:06:51 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:51 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:51 [] io_schedule+0x73/0xc0 2014-01-07 19:06:51 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:51 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:51 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:51 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:51 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:51 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:51 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:51 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:51 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:51 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:51 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:51 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:51 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:51 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:51 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:51 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:52 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:52 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:52 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:52 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:52 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:52 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:52 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:52 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] kthread+0x96/0xa0 2014-01-07 19:06:52 [] child_rip+0xa/0x20 2014-01-07 19:06:52 [] ? kthread+0x0/0xa0 2014-01-07 19:06:52 [] ? child_rip+0x0/0x20 2014-01-07 19:06:52 ffff88078a239690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:52 ffff88078a2396b0 0000000000000001 0000000000000d76 ffff880e00000000 2014-01-07 19:06:52 ffff8808343fb098 ffff88078a239fd8 000000000000fb88 ffff8808343fb098 2014-01-07 19:06:52 Call Trace: 2014-01-07 19:06:52 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:52 [] io_schedule+0x73/0xc0 2014-01-07 19:06:52 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:52 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:52 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:52 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:52 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:52 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:52 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:52 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:52 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:52 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:52 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:52 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:52 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:52 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] kthread+0x96/0xa0 2014-01-07 19:06:52 [] child_rip+0xa/0x20 2014-01-07 19:06:52 [] ? kthread+0x0/0xa0 2014-01-07 19:06:52 [] ? child_rip+0x0/0x20 2014-01-07 19:06:52 ffff880789e7f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:52 ffff880789e7f6b0 0000000000000001 0000000000000ba2 ffff880e00000000 2014-01-07 19:06:52 ffff8808343fbaf8 ffff880789e7ffd8 000000000000fb88 ffff8808343fbaf8 2014-01-07 19:06:52 Call Trace: 2014-01-07 19:06:52 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:52 [] io_schedule+0x73/0xc0 2014-01-07 19:06:52 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:52 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:52 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:52 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:52 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:52 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:52 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:52 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:52 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:52 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:52 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:52 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:52 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:52 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] kthread+0x96/0xa0 2014-01-07 19:06:52 [] child_rip+0xa/0x20 2014-01-07 19:06:52 [] ? kthread+0x0/0xa0 2014-01-07 19:06:52 [] ? child_rip+0x0/0x20 2014-01-07 19:06:52 ffff880789e85690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:52 ffff880789e856b0 0000000000000001 0000000000000d08 ffff880e00000000 2014-01-07 19:06:52 ffff880789e83af8 ffff880789e85fd8 000000000000fb88 ffff880789e83af8 2014-01-07 19:06:52 Call Trace: 2014-01-07 19:06:52 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:52 [] io_schedule+0x73/0xc0 2014-01-07 19:06:52 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:52 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:52 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:52 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:52 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:52 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:52 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:52 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:52 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:52 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:52 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:52 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:52 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:52 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] kthread+0x96/0xa0 2014-01-07 19:06:52 [] child_rip+0xa/0x20 2014-01-07 19:06:52 [] ? kthread+0x0/0xa0 2014-01-07 19:06:52 [] ? child_rip+0x0/0x20 2014-01-07 19:06:52 ffff880789e89360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:52 ffff880789e892e0 ffffffff8150fa5e ffff8806c2c11a80 ffff8806c2c11d98 2014-01-07 19:06:52 ffff880831922638 ffff880789e89fd8 000000000000fb88 ffff880831922638 2014-01-07 19:06:52 Call Trace: 2014-01-07 19:06:52 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:52 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:52 [] io_schedule+0x73/0xc0 2014-01-07 19:06:52 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:52 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:52 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:52 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:52 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:52 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:52 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:52 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:52 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:52 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:06:52 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:52 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:52 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:52 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:52 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:52 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:52 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:52 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:52 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:52 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:52 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:52 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:52 [] kthread+0x96/0xa0 2014-01-07 19:06:52 [] child_rip+0xa/0x20 2014-01-07 19:06:52 [] ? kthread+0x0/0xa0 2014-01-07 19:06:52 [] ? child_rip+0x0/0x20 2014-01-07 19:06:52 ffff880789e8b4e0 0000000000000046 0000000000000000 ffffffff8127fa1e 2014-01-07 19:06:52 0000002100000005 ffff8807cda41000 ffff880789e8b460 ffff880789e8b480 2014-01-07 19:06:52 ffff8808288e5058 ffff880789e8bfd8 000000000000fb88 ffff8808288e5058 2014-01-07 19:06:52 Call Trace: 2014-01-07 19:06:52 [] ? number+0x2ee/0x320 2014-01-07 19:06:52 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:06:52 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:06:52 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:06:52 [] ? down_write+0x32/0x40 2014-01-07 19:06:52 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:06:52 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:52 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:52 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:52 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:52 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:52 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:52 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:52 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:52 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:52 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:52 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:52 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:52 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:52 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_server_post_idle_rqbds+0x38/0xe0 [ptlrpc] 2014-01-07 19:06:53 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] kthread+0x96/0xa0 2014-01-07 19:06:53 [] child_rip+0xa/0x20 2014-01-07 19:06:53 [] ? kthread+0x0/0xa0 2014-01-07 19:06:53 [] ? child_rip+0x0/0x20 2014-01-07 19:06:53 ffff880789ab3da0 0000000000000046 0000000000000000 ffff880789ab3d64 2014-01-07 19:06:53 ffff880ff5709000 ffff88083fe82600 ffff88085c416740 00000000000002af 2014-01-07 19:06:53 ffff88081840a638 ffff880789ab3fd8 000000000000fb88 ffff88081840a638 2014-01-07 19:06:53 Call Trace: 2014-01-07 19:06:53 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:06:53 [] ? default_wake_function+0x0/0x20 2014-01-07 19:06:53 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] kthread+0x96/0xa0 2014-01-07 19:06:53 [] child_rip+0xa/0x20 2014-01-07 19:06:53 [] ? kthread+0x0/0xa0 2014-01-07 19:06:53 [] ? child_rip+0x0/0x20 2014-01-07 19:06:53 ffff880789ab5690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:53 ffff880789ab56b0 0000000000000001 0000000000000b5c ffff880e00000000 2014-01-07 19:06:53 ffff88081840baf8 ffff880789ab5fd8 000000000000fb88 ffff88081840baf8 2014-01-07 19:06:53 Call Trace: 2014-01-07 19:06:53 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:53 [] io_schedule+0x73/0xc0 2014-01-07 19:06:53 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:53 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:53 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:53 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:53 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:53 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:53 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:53 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:53 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:53 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:53 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:53 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:53 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:53 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] kthread+0x96/0xa0 2014-01-07 19:06:53 [] child_rip+0xa/0x20 2014-01-07 19:06:53 [] ? kthread+0x0/0xa0 2014-01-07 19:06:53 [] ? child_rip+0x0/0x20 2014-01-07 19:06:53 ffff880789ab9360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:53 ffff880789ab92e0 ffffffff8150fa5e ffff880e840b04a0 ffff880e840b07b8 2014-01-07 19:06:53 ffff880789ab7ab8 ffff880789ab9fd8 000000000000fb88 ffff880789ab7ab8 2014-01-07 19:06:53 Call Trace: 2014-01-07 19:06:53 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:53 [] io_schedule+0x73/0xc0 2014-01-07 19:06:53 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:53 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:53 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:53 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:53 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:53 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:53 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:53 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:53 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:53 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:53 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:53 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:53 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:53 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:53 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:53 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:53 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:53 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:53 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:53 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:53 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:53 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] kthread+0x96/0xa0 2014-01-07 19:06:53 [] child_rip+0xa/0x20 2014-01-07 19:06:53 [] ? kthread+0x0/0xa0 2014-01-07 19:06:53 [] ? child_rip+0x0/0x20 2014-01-07 19:06:53 ffff880789ac1690 0000000000000046 ffff880789ac16b0 ffffffffa04e9367 2014-01-07 19:06:53 ffff880789ac16b0 0000000000000001 0000000000000cfb ffff880e00000000 2014-01-07 19:06:53 ffff880789abfaf8 ffff880789ac1fd8 000000000000fb88 ffff880789abfaf8 2014-01-07 19:06:53 Call Trace: 2014-01-07 19:06:53 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:53 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:53 [] io_schedule+0x73/0xc0 2014-01-07 19:06:53 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:53 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:53 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:53 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:53 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:53 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:53 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:53 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:53 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:53 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:53 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:53 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:53 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:53 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] kthread+0x96/0xa0 2014-01-07 19:06:53 [] child_rip+0xa/0x20 2014-01-07 19:06:53 [] ? kthread+0x0/0xa0 2014-01-07 19:06:53 [] ? child_rip+0x0/0x20 2014-01-07 19:06:53 ffff8807896d7360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:53 ffff8807896d72e0 ffffffff8150fa5e ffff880e8e6c7200 ffff880e8e6c7518 2014-01-07 19:06:53 ffff880831923098 ffff8807896d7fd8 000000000000fb88 ffff880831923098 2014-01-07 19:06:53 Call Trace: 2014-01-07 19:06:53 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:53 [] io_schedule+0x73/0xc0 2014-01-07 19:06:53 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:53 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:53 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:53 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:53 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:53 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:53 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:53 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:53 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:53 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:53 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:53 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:53 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:53 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:53 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:53 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:53 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:53 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:53 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:53 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:53 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:53 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:53 [] kthread+0x96/0xa0 2014-01-07 19:06:53 [] child_rip+0xa/0x20 2014-01-07 19:06:53 [] ? kthread+0x0/0xa0 2014-01-07 19:06:53 [] ? child_rip+0x0/0x20 2014-01-07 19:06:53 ffff8807896d9690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:53 ffff8807896d96b0 ffffffff00000001 ffff8807bfd99e00 ffff8807bfd99df8 2014-01-07 19:06:53 ffff88081825d098 ffff8807896d9fd8 000000000000fb88 ffff88081825d098 2014-01-07 19:06:53 Call Trace: 2014-01-07 19:06:53 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:53 [] io_schedule+0x73/0xc0 2014-01-07 19:06:53 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:53 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:53 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:53 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:53 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:53 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:53 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:53 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:53 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:53 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:53 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:53 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:54 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:54 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:54 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:54 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:54 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:54 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] kthread+0x96/0xa0 2014-01-07 19:06:54 [] child_rip+0xa/0x20 2014-01-07 19:06:54 [] ? kthread+0x0/0xa0 2014-01-07 19:06:54 [] ? child_rip+0x0/0x20 2014-01-07 19:06:54 ffff8807896f9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:54 ffff8807896f96b0 0000000000000001 0000000000000da0 ffff880e00000000 2014-01-07 19:06:54 ffff880834305098 ffff8807896f9fd8 000000000000fb88 ffff880834305098 2014-01-07 19:06:54 Call Trace: 2014-01-07 19:06:54 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:54 [] io_schedule+0x73/0xc0 2014-01-07 19:06:54 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:54 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:54 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:54 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:54 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:54 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:54 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:54 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:54 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:54 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:54 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:54 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:54 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:54 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] kthread+0x96/0xa0 2014-01-07 19:06:54 [] child_rip+0xa/0x20 2014-01-07 19:06:54 [] ? kthread+0x0/0xa0 2014-01-07 19:06:54 [] ? child_rip+0x0/0x20 2014-01-07 19:06:54 ffff8807896fb360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:54 ffff8807896fb2e0 ffffffff8150fa5e ffff880e7a126da0 ffff880e7a1270b8 2014-01-07 19:06:54 ffff88081838baf8 ffff8807896fbfd8 000000000000fb88 ffff88081838baf8 2014-01-07 19:06:54 Call Trace: 2014-01-07 19:06:54 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:54 [] io_schedule+0x73/0xc0 2014-01-07 19:06:54 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:54 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:54 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:54 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:54 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:54 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:54 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:54 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:54 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:54 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:54 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:54 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:54 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:54 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:54 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:54 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:54 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:54 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:54 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:54 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:54 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] kthread+0x96/0xa0 2014-01-07 19:06:54 [] child_rip+0xa/0x20 2014-01-07 19:06:54 [] ? kthread+0x0/0xa0 2014-01-07 19:06:54 [] ? child_rip+0x0/0x20 2014-01-07 19:06:54 ffff8807890b1690 0000000000000046 ffff8807890b16b0 ffffffffa04e9367 2014-01-07 19:06:54 ffff8807890b16b0 0000000000000001 0000000000000ebb ffff880700000000 2014-01-07 19:06:54 ffff8807890afab8 ffff8807890b1fd8 000000000000fb88 ffff8807890afab8 2014-01-07 19:06:54 Call Trace: 2014-01-07 19:06:54 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:54 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:54 [] io_schedule+0x73/0xc0 2014-01-07 19:06:54 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:54 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:54 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:54 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:54 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:54 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:54 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:54 scsi host7: SRP abort called 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:54 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:54 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:54 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:54 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:54 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:54 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:54 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] kthread+0x96/0xa0 2014-01-07 19:06:54 [] child_rip+0xa/0x20 2014-01-07 19:06:54 [] ? kthread+0x0/0xa0 2014-01-07 19:06:54 [] ? child_rip+0x0/0x20 2014-01-07 19:06:54 ffff880789305690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:54 ffff8807893056b0 0000000000000001 0000000000000cc8 ffff880700000000 2014-01-07 19:06:54 ffff8807890af058 ffff880789305fd8 000000000000fb88 ffff8807890af058 2014-01-07 19:06:54 Call Trace: 2014-01-07 19:06:54 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:54 [] io_schedule+0x73/0xc0 2014-01-07 19:06:54 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:54 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:54 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:54 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:54 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:54 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:54 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:54 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:54 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:54 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:54 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:54 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:54 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:54 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] kthread+0x96/0xa0 2014-01-07 19:06:54 [] child_rip+0xa/0x20 2014-01-07 19:06:54 [] ? kthread+0x0/0xa0 2014-01-07 19:06:54 [] ? child_rip+0x0/0x20 2014-01-07 19:06:54 ffff880788f07690 0000000000000046 ffff880788f076b0 ffffffffa04e9367 2014-01-07 19:06:54 ffff880788f076b0 0000000000000001 0000000000000b2c ffff880e00000000 2014-01-07 19:06:54 ffff8807890ae5f8 ffff880788f07fd8 000000000000fb88 ffff8807890ae5f8 2014-01-07 19:06:54 Call Trace: 2014-01-07 19:06:54 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:54 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:54 [] io_schedule+0x73/0xc0 2014-01-07 19:06:54 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:54 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:54 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:54 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:54 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:54 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:54 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:54 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:54 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:54 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:54 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:54 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:54 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:54 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:54 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:54 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:54 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:54 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:54 [] kthread+0x96/0xa0 2014-01-07 19:06:55 [] child_rip+0xa/0x20 2014-01-07 19:06:55 [] ? kthread+0x0/0xa0 2014-01-07 19:06:55 [] ? child_rip+0x0/0x20 2014-01-07 19:06:55 ffff880788f0f690 0000000000000046 ffff880788f0f6b0 ffffffffa04e9367 2014-01-07 19:06:55 ffff880788f0f6b0 0000000000000001 0000000000000ebd ffff880e00000000 2014-01-07 19:06:55 ffff880788f0daf8 ffff880788f0ffd8 000000000000fb88 ffff880788f0daf8 2014-01-07 19:06:55 Call Trace: 2014-01-07 19:06:55 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:55 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:55 [] io_schedule+0x73/0xc0 2014-01-07 19:06:55 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:55 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:55 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:55 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:55 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:55 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:55 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:55 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:55 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:55 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:55 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:55 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:55 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] kthread+0x96/0xa0 2014-01-07 19:06:55 [] child_rip+0xa/0x20 2014-01-07 19:06:55 [] ? kthread+0x0/0xa0 2014-01-07 19:06:55 [] ? child_rip+0x0/0x20 2014-01-07 19:06:55 ffff880788f234b0 0000000000000046 0000000000000000 ffffffffa0567253 2014-01-07 19:06:55 ffffc908000000c0 ffff880fafc62500 ffff880788f23440 ffff8807242e5930 2014-01-07 19:06:55 ffff880788f0d098 ffff880788f23fd8 000000000000fb88 ffff880788f0d098 2014-01-07 19:06:55 Call Trace: 2014-01-07 19:06:55 [] ? zio_nowait+0xb3/0x170 [zfs] 2014-01-07 19:06:55 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:06:55 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:06:55 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:06:55 [] ? down_write+0x32/0x40 2014-01-07 19:06:55 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:06:55 [] dbuf_read+0x6a1/0x750 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:55 [] dmu_read+0x97/0x180 [zfs] 2014-01-07 19:06:55 [] osd_read+0x18f/0x240 [osd_zfs] 2014-01-07 19:06:55 [] osd_read_prep+0x183/0x240 [osd_zfs] 2014-01-07 19:06:55 [] ofd_preprw_read+0x253/0x7f0 [ofd] 2014-01-07 19:06:55 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:55 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:55 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:55 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:55 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:55 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:55 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:55 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] kthread+0x96/0xa0 2014-01-07 19:06:55 [] child_rip+0xa/0x20 2014-01-07 19:06:55 [] ? kthread+0x0/0xa0 2014-01-07 19:06:55 [] ? child_rip+0x0/0x20 2014-01-07 19:06:55 ffff880788ae7690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:55 ffff880788ae76b0 0000000000000001 0000000000000b04 ffff880e00000000 2014-01-07 19:06:55 ffff880788f0c638 ffff880788ae7fd8 000000000000fb88 ffff880788f0c638 2014-01-07 19:06:55 Call Trace: 2014-01-07 19:06:55 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:55 [] io_schedule+0x73/0xc0 2014-01-07 19:06:55 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:55 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:55 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:55 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:55 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:55 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:55 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:55 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:55 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:55 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:55 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:55 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:55 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:55 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] kthread+0x96/0xa0 2014-01-07 19:06:55 [] child_rip+0xa/0x20 2014-01-07 19:06:55 [] ? kthread+0x0/0xa0 2014-01-07 19:06:55 [] ? child_rip+0x0/0x20 2014-01-07 19:06:55 ffff880788b29690 0000000000000046 ffff880788b296b0 ffffffffa04e9367 2014-01-07 19:06:55 ffff880788b296b0 0000000000000001 0000000000000d09 ffff880e00000000 2014-01-07 19:06:55 ffff880788b27ab8 ffff880788b29fd8 000000000000fb88 ffff880788b27ab8 2014-01-07 19:06:55 Call Trace: 2014-01-07 19:06:55 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:55 scsi host6: SRP abort called 2014-01-07 19:06:55 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:55 [] io_schedule+0x73/0xc0 2014-01-07 19:06:55 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:55 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:55 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:55 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:55 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:55 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:55 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:55 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:55 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:55 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:55 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:55 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:55 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:55 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] kthread+0x96/0xa0 2014-01-07 19:06:55 [] child_rip+0xa/0x20 2014-01-07 19:06:55 [] ? kthread+0x0/0xa0 2014-01-07 19:06:55 [] ? child_rip+0x0/0x20 2014-01-07 19:06:55 ffff880788b2d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:55 ffff880788b2d6b0 0000000000000001 0000000000000cff ffff880e00000000 2014-01-07 19:06:55 ffff880788b27058 ffff880788b2dfd8 000000000000fb88 ffff880788b27058 2014-01-07 19:06:55 Call Trace: 2014-01-07 19:06:55 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:55 [] io_schedule+0x73/0xc0 2014-01-07 19:06:55 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:55 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:55 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:55 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:55 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:55 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:55 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:55 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:55 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:55 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:55 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:55 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:55 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:55 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:55 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:55 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:55 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:55 [] kthread+0x96/0xa0 2014-01-07 19:06:55 [] child_rip+0xa/0x20 2014-01-07 19:06:55 [] ? kthread+0x0/0xa0 2014-01-07 19:06:55 [] ? child_rip+0x0/0x20 2014-01-07 19:06:55 ffff88078860b360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:55 ffff88078860b2e0 ffffffff8150fa5e ffff880e839f8d60 ffff880e839f9078 2014-01-07 19:06:55 ffff880788b265f8 ffff88078860bfd8 000000000000fb88 ffff880788b265f8 2014-01-07 19:06:55 Call Trace: 2014-01-07 19:06:55 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:55 [] io_schedule+0x73/0xc0 2014-01-07 19:06:55 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:55 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:55 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:55 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:55 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:55 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:55 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:55 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:55 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:56 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:56 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:56 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:56 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:56 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:56 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:56 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:56 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:56 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:56 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:56 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:56 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:56 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:56 [] ? ptlrpc_server_post_idle_rqbds+0x38/0xe0 [ptlrpc] 2014-01-07 19:06:56 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] kthread+0x96/0xa0 2014-01-07 19:06:56 [] child_rip+0xa/0x20 2014-01-07 19:06:56 [] ? kthread+0x0/0xa0 2014-01-07 19:06:56 [] ? child_rip+0x0/0x20 2014-01-07 19:06:56 ffff88078877b360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:56 ffff88078877b2e0 ffffffff8150fa5e ffff880e8f5384a0 ffff880e8f5387b8 2014-01-07 19:06:56 ffff880788779af8 ffff88078877bfd8 000000000000fb88 ffff880788779af8 2014-01-07 19:06:56 Call Trace: 2014-01-07 19:06:56 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:56 [] io_schedule+0x73/0xc0 2014-01-07 19:06:56 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:56 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:56 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:56 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:56 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:56 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:56 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:56 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:56 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:56 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:56 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:56 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:56 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:56 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:56 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:56 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:56 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:56 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:56 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:56 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:56 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:56 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:56 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] kthread+0x96/0xa0 2014-01-07 19:06:56 [] child_rip+0xa/0x20 2014-01-07 19:06:56 [] ? kthread+0x0/0xa0 2014-01-07 19:06:56 [] ? child_rip+0x0/0x20 2014-01-07 19:06:56 ffff880788781690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:56 ffff8807887816b0 0000000000000001 0000000000000c8a ffff880e00000000 2014-01-07 19:06:56 ffff880788779098 ffff880788781fd8 000000000000fb88 ffff880788779098 2014-01-07 19:06:56 Call Trace: 2014-01-07 19:06:56 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:56 [] io_schedule+0x73/0xc0 2014-01-07 19:06:56 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:56 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:56 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:56 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:56 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:56 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:56 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:56 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:56 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:56 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:56 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:56 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:56 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:56 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:56 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] kthread+0x96/0xa0 2014-01-07 19:06:56 [] child_rip+0xa/0x20 2014-01-07 19:06:56 [] ? kthread+0x0/0xa0 2014-01-07 19:06:56 [] ? child_rip+0x0/0x20 2014-01-07 19:06:56 ffff880788785690 0000000000000046 ffff8807887856b0 ffffffffa04e9367 2014-01-07 19:06:56 ffff8807887856b0 0000000000000001 0000000000000ed3 ffff880e00000000 2014-01-07 19:06:56 ffff880788778638 ffff880788785fd8 000000000000fb88 ffff880788778638 2014-01-07 19:06:56 Call Trace: 2014-01-07 19:06:56 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:56 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:56 [] io_schedule+0x73/0xc0 2014-01-07 19:06:56 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:56 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:56 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:56 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:56 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:56 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:56 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:56 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:56 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:56 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:56 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:56 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:56 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:56 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:56 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] kthread+0x96/0xa0 2014-01-07 19:06:56 [] child_rip+0xa/0x20 2014-01-07 19:06:56 [] ? kthread+0x0/0xa0 2014-01-07 19:06:56 [] ? child_rip+0x0/0x20 2014-01-07 19:06:56 ffff88078878d690 0000000000000046 ffff88078878d6b0 ffffffffa04e9367 2014-01-07 19:06:56 ffff88078878d6b0 0000000000000001 0000000000000d31 ffff880700000000 2014-01-07 19:06:56 ffff880788787ab8 ffff88078878dfd8 000000000000fb88 ffff880788787ab8 2014-01-07 19:06:56 Call Trace: 2014-01-07 19:06:56 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:56 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:56 [] io_schedule+0x73/0xc0 2014-01-07 19:06:56 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:56 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:56 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:56 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:56 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:56 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:56 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:56 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:56 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:56 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:56 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:56 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:56 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:56 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:56 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:56 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:56 [] kthread+0x96/0xa0 2014-01-07 19:06:56 [] child_rip+0xa/0x20 2014-01-07 19:06:56 [] ? kthread+0x0/0xa0 2014-01-07 19:06:56 [] ? child_rip+0x0/0x20 2014-01-07 19:06:56 ffff8807887bf690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:06:56 ffff8807887bf6b0 ffffffff00000001 ffff8807a7fd5510 ffff880700000001 2014-01-07 19:06:56 ffff880788787058 ffff8807887bffd8 000000000000fb88 ffff880788787058 2014-01-07 19:06:56 Call Trace: 2014-01-07 19:06:56 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:06:56 [] io_schedule+0x73/0xc0 2014-01-07 19:06:56 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:56 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:56 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:56 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:56 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:56 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:56 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:56 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:56 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:57 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:57 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:57 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:57 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:57 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:57 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:57 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] kthread+0x96/0xa0 2014-01-07 19:06:57 [] child_rip+0xa/0x20 2014-01-07 19:06:57 [] ? kthread+0x0/0xa0 2014-01-07 19:06:57 [] ? child_rip+0x0/0x20 2014-01-07 19:06:57 ffff8807883c3360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:57 ffff8807883c32e0 ffffffff8150fa5e ffff880e7a04b4c0 ffff880e7a04b7d8 2014-01-07 19:06:57 ffff880789abf098 ffff8807883c3fd8 000000000000fb88 ffff880789abf098 2014-01-07 19:06:57 Call Trace: 2014-01-07 19:06:57 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:57 [] io_schedule+0x73/0xc0 2014-01-07 19:06:57 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:57 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:57 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:57 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:57 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:57 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:57 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:57 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:57 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:57 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:06:57 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:57 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:57 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:57 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:57 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:57 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:57 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:57 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:57 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:57 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:57 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] kthread+0x96/0xa0 2014-01-07 19:06:57 [] child_rip+0xa/0x20 2014-01-07 19:06:57 [] ? kthread+0x0/0xa0 2014-01-07 19:06:57 [] ? child_rip+0x0/0x20 2014-01-07 19:06:57 ffff8807883c5690 0000000000000046 ffff8807883c56b0 ffffffffa04e9367 2014-01-07 19:06:57 ffff8807883c56b0 0000000000000001 0000000000000caa ffff880e00000000 2014-01-07 19:06:57 ffff880789abe638 ffff8807883c5fd8 000000000000fb88 ffff880789abe638 2014-01-07 19:06:57 Call Trace: 2014-01-07 19:06:57 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:57 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:57 [] io_schedule+0x73/0xc0 2014-01-07 19:06:57 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:57 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:57 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:57 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:57 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:57 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:57 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:57 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:57 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:57 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:57 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:57 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:57 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:57 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:57 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] kthread+0x96/0xa0 2014-01-07 19:06:57 [] child_rip+0xa/0x20 2014-01-07 19:06:57 [] ? kthread+0x0/0xa0 2014-01-07 19:06:57 [] ? child_rip+0x0/0x20 2014-01-07 19:06:57 ffff880787ffb690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:57 ffff880787ffb6b0 0000000000000001 0000000000000c88 ffff880e00000000 2014-01-07 19:06:57 ffff880787ff9af8 ffff880787ffbfd8 000000000000fb88 ffff880787ff9af8 2014-01-07 19:06:57 Call Trace: 2014-01-07 19:06:57 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:57 [] io_schedule+0x73/0xc0 2014-01-07 19:06:57 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:57 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:57 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:57 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:57 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:57 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:57 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:57 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:57 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:57 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:57 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:57 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:57 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:57 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:57 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] kthread+0x96/0xa0 2014-01-07 19:06:57 [] child_rip+0xa/0x20 2014-01-07 19:06:57 [] ? kthread+0x0/0xa0 2014-01-07 19:06:57 [] ? child_rip+0x0/0x20 2014-01-07 19:06:57 ffff880787815690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:57 ffff8807878156b0 0000000000000001 0000000000000b62 ffff880e00000000 2014-01-07 19:06:57 ffff880787ff9098 ffff880787815fd8 000000000000fb88 ffff880787ff9098 2014-01-07 19:06:57 Call Trace: 2014-01-07 19:06:57 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:57 [] io_schedule+0x73/0xc0 2014-01-07 19:06:57 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:57 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:57 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:57 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:57 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:57 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:57 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:57 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:57 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:57 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:57 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:57 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:57 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:57 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:57 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] kthread+0x96/0xa0 2014-01-07 19:06:57 [] child_rip+0xa/0x20 2014-01-07 19:06:57 [] ? kthread+0x0/0xa0 2014-01-07 19:06:57 [] ? child_rip+0x0/0x20 2014-01-07 19:06:57 ffff880787817690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:57 ffff8807878176b0 0000000000000001 0000000000000b30 ffff880e00000000 2014-01-07 19:06:57 ffff880787ff8638 ffff880787817fd8 000000000000fb88 ffff880787ff8638 2014-01-07 19:06:57 Call Trace: 2014-01-07 19:06:57 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:57 [] io_schedule+0x73/0xc0 2014-01-07 19:06:57 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:57 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:57 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:57 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:57 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:57 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:57 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:57 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:57 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:57 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:57 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:57 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:57 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:57 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:57 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:57 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:57 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:57 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:57 [] kthread+0x96/0xa0 2014-01-07 19:06:57 [] child_rip+0xa/0x20 2014-01-07 19:06:58 [] ? kthread+0x0/0xa0 2014-01-07 19:06:58 [] ? child_rip+0x0/0x20 2014-01-07 19:06:58 ffff880787483690 0000000000000046 ffff8807874836b0 ffffffffa04e9367 2014-01-07 19:06:58 ffff8807874836b0 0000000000000001 0000000000000d86 ffff880e00000000 2014-01-07 19:06:58 ffff8807887865f8 ffff880787483fd8 000000000000fb88 ffff8807887865f8 2014-01-07 19:06:58 Call Trace: 2014-01-07 19:06:58 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:58 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:58 [] io_schedule+0x73/0xc0 2014-01-07 19:06:58 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:58 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:58 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:58 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:58 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:58 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:58 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:58 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:58 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:58 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:58 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:58 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:58 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:58 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] kthread+0x96/0xa0 2014-01-07 19:06:58 [] child_rip+0xa/0x20 2014-01-07 19:06:58 [] ? kthread+0x0/0xa0 2014-01-07 19:06:58 [] ? child_rip+0x0/0x20 2014-01-07 19:06:58 ffff880ff1a17360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:58 ffff880ff1a172e0 ffffffff8150fa5e ffff880e8e557ac0 ffff880e8e557dd8 2014-01-07 19:06:58 ffff880ff2da05f8 ffff880ff1a17fd8 000000000000fb88 ffff880ff2da05f8 2014-01-07 19:06:58 Call Trace: 2014-01-07 19:06:58 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:58 [] io_schedule+0x73/0xc0 2014-01-07 19:06:58 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:58 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:58 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:58 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:58 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:58 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:58 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:58 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:58 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:58 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:58 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:58 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:58 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:58 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:58 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:58 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:58 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:58 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:58 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:58 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:58 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] kthread+0x96/0xa0 2014-01-07 19:06:58 [] child_rip+0xa/0x20 2014-01-07 19:06:58 [] ? kthread+0x0/0xa0 2014-01-07 19:06:58 [] ? child_rip+0x0/0x20 2014-01-07 19:06:58 ffff880ff1a3f360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:58 ffff880ff1a3f2e0 ffffffff8150fa5e ffff880e7914cf00 ffff880e7914d218 2014-01-07 19:06:58 ffff880ff1a3dab8 ffff880ff1a3ffd8 000000000000fb88 ffff880ff1a3dab8 2014-01-07 19:06:58 Call Trace: 2014-01-07 19:06:58 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:58 [] io_schedule+0x73/0xc0 2014-01-07 19:06:58 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:58 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:58 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:58 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:58 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:58 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:58 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:58 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:58 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:58 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:58 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:58 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:58 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:58 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:58 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:58 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:58 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:58 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:58 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:58 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:58 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:58 [] ? osd_key_exit+0x2f/0xa0 [osd_zfs] 2014-01-07 19:06:58 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] kthread+0x96/0xa0 2014-01-07 19:06:58 [] child_rip+0xa/0x20 2014-01-07 19:06:58 [] ? kthread+0x0/0xa0 2014-01-07 19:06:58 [] ? child_rip+0x0/0x20 2014-01-07 19:06:58 ffff880ff1a53360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:58 ffff880ff1a532e0 ffffffff8150fa5e ffff880e7a63e4e0 ffff880e7a63e7f8 2014-01-07 19:06:58 ffff880ff2ac1098 ffff880ff1a53fd8 000000000000fb88 ffff880ff2ac1098 2014-01-07 19:06:58 Call Trace: 2014-01-07 19:06:58 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:58 [] io_schedule+0x73/0xc0 2014-01-07 19:06:58 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:58 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:58 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:58 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:58 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:58 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:58 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:58 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:58 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:58 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:58 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:58 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:58 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:58 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:58 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:58 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:58 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:58 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:58 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:58 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:58 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:58 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:58 [] kthread+0x96/0xa0 2014-01-07 19:06:58 [] child_rip+0xa/0x20 2014-01-07 19:06:58 [] ? kthread+0x0/0xa0 2014-01-07 19:06:58 [] ? child_rip+0x0/0x20 2014-01-07 19:06:58 ffff880ff1a59690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:58 ffff880ff1a596b0 0000000000000001 0000000000000b4d ffff880e00000000 2014-01-07 19:06:58 ffff880ff2ac0638 ffff880ff1a59fd8 000000000000fb88 ffff880ff2ac0638 2014-01-07 19:06:58 Call Trace: 2014-01-07 19:06:58 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:58 [] io_schedule+0x73/0xc0 2014-01-07 19:06:58 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:58 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:58 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:58 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:58 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:58 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:58 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:58 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:58 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:58 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:58 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:58 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:58 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:58 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:58 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:59 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:59 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:59 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] kthread+0x96/0xa0 2014-01-07 19:06:59 [] child_rip+0xa/0x20 2014-01-07 19:06:59 [] ? kthread+0x0/0xa0 2014-01-07 19:06:59 [] ? child_rip+0x0/0x20 2014-01-07 19:06:59 ffff880ff1a5b360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:06:59 ffff880ff1a5b2e0 ffffffff8150fa5e ffff880490b34640 ffff880490b34958 2014-01-07 19:06:59 ffff880ff1a3d058 ffff880ff1a5bfd8 000000000000fb88 ffff880ff1a3d058 2014-01-07 19:06:59 Call Trace: 2014-01-07 19:06:59 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:59 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:06:59 [] io_schedule+0x73/0xc0 2014-01-07 19:06:59 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:59 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:59 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:59 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:59 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:59 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:59 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:59 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:59 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:59 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:59 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:59 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:59 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:59 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:59 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:59 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:59 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:59 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:59 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:59 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] kthread+0x96/0xa0 2014-01-07 19:06:59 [] child_rip+0xa/0x20 2014-01-07 19:06:59 [] ? kthread+0x0/0xa0 2014-01-07 19:06:59 [] ? child_rip+0x0/0x20 2014-01-07 19:06:59 ffff880ff1a83360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:59 ffff880ff1a832e0 ffffffff8150fa5e ffff880e79a64f00 ffff880e79a65218 2014-01-07 19:06:59 ffff880ff1a81af8 ffff880ff1a83fd8 000000000000fb88 ffff880ff1a81af8 2014-01-07 19:06:59 Call Trace: 2014-01-07 19:06:59 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:59 [] io_schedule+0x73/0xc0 2014-01-07 19:06:59 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:59 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:59 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:59 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:59 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:59 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:59 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:59 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:59 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:59 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:59 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:59 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:59 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:59 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:59 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:59 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:59 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:59 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:59 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:59 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] kthread+0x96/0xa0 2014-01-07 19:06:59 [] child_rip+0xa/0x20 2014-01-07 19:06:59 [] ? kthread+0x0/0xa0 2014-01-07 19:06:59 [] ? child_rip+0x0/0x20 2014-01-07 19:06:59 ffff880ff1a87360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:06:59 ffff880ff1a872e0 ffffffff8150fa5e ffff88077d742340 ffff88077d742658 2014-01-07 19:06:59 ffff880ff1a81098 ffff880ff1a87fd8 000000000000fb88 ffff880ff1a81098 2014-01-07 19:06:59 Call Trace: 2014-01-07 19:06:59 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:06:59 [] io_schedule+0x73/0xc0 2014-01-07 19:06:59 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:59 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:59 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:06:59 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:06:59 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:06:59 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:06:59 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:06:59 scsi host7: SRP abort called 2014-01-07 19:06:59 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:06:59 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:59 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:59 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:59 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:59 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:59 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:59 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:59 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:59 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:59 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:59 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:59 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] kthread+0x96/0xa0 2014-01-07 19:06:59 [] child_rip+0xa/0x20 2014-01-07 19:06:59 [] ? kthread+0x0/0xa0 2014-01-07 19:06:59 [] ? child_rip+0x0/0x20 2014-01-07 19:06:59 ffff880ff1abf690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:06:59 ffff880ff1abf6b0 0000000000000001 0000000000000c9a ffff880e00000000 2014-01-07 19:06:59 ffff880ff1a80638 ffff880ff1abffd8 000000000000fb88 ffff880ff1a80638 2014-01-07 19:06:59 Call Trace: 2014-01-07 19:06:59 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:06:59 [] io_schedule+0x73/0xc0 2014-01-07 19:06:59 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:06:59 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:06:59 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:06:59 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:59 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:59 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:59 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:59 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:59 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:59 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:06:59 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:06:59 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:06:59 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:06:59 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:06:59 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:06:59 [] kthread+0x96/0xa0 2014-01-07 19:06:59 [] child_rip+0xa/0x20 2014-01-07 19:06:59 [] ? kthread+0x0/0xa0 2014-01-07 19:06:59 [] ? child_rip+0x0/0x20 2014-01-07 19:06:59 ffff880ff1ac5550 0000000000000046 ffff880fffffffff 0000000000281826 2014-01-07 19:06:59 0000000200003232 0000000affffffff ffffffffffffffff 00000000637dce89 2014-01-07 19:06:59 ffff880ff1ac3ab8 ffff880ff1ac5fd8 000000000000fb88 ffff880ff1ac3ab8 2014-01-07 19:06:59 Call Trace: 2014-01-07 19:06:59 [] ? vsnprintf+0x336/0x5e0 2014-01-07 19:06:59 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:06:59 [] mutex_lock+0x2b/0x50 2014-01-07 19:06:59 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:06:59 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:06:59 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:06:59 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:06:59 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:06:59 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:06:59 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:06:59 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:06:59 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:06:59 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:06:59 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:06:59 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:00 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:00 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:00 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:00 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:00 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] kthread+0x96/0xa0 2014-01-07 19:07:00 [] child_rip+0xa/0x20 2014-01-07 19:07:00 [] ? kthread+0x0/0xa0 2014-01-07 19:07:00 [] ? child_rip+0x0/0x20 2014-01-07 19:07:00 ffff880ff1bed690 0000000000000046 ffff880ff1bed6b0 ffffffffa04e9367 2014-01-07 19:07:00 ffff880ff1bed6b0 0000000000000001 0000000000000b09 ffff880e00000000 2014-01-07 19:07:00 ffff880ff29e5058 ffff880ff1bedfd8 000000000000fb88 ffff880ff29e5058 2014-01-07 19:07:00 Call Trace: 2014-01-07 19:07:00 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:00 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:00 [] io_schedule+0x73/0xc0 2014-01-07 19:07:00 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:00 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:00 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:00 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:00 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:00 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:00 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:00 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:00 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:00 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:00 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:00 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:00 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:00 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] kthread+0x96/0xa0 2014-01-07 19:07:00 [] child_rip+0xa/0x20 2014-01-07 19:07:00 [] ? kthread+0x0/0xa0 2014-01-07 19:07:00 [] ? child_rip+0x0/0x20 2014-01-07 19:07:00 ffff880ff1bef690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:00 ffff880ff1bef6b0 0000000000000001 0000000000000cdd ffff880e00000000 2014-01-07 19:07:00 ffff880ff29e45f8 ffff880ff1beffd8 000000000000fb88 ffff880ff29e45f8 2014-01-07 19:07:00 Call Trace: 2014-01-07 19:07:00 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:00 [] io_schedule+0x73/0xc0 2014-01-07 19:07:00 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:00 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:00 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:00 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:00 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:00 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:00 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:00 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:00 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:00 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:00 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:00 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:00 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] kthread+0x96/0xa0 2014-01-07 19:07:00 [] child_rip+0xa/0x20 2014-01-07 19:07:00 [] ? kthread+0x0/0xa0 2014-01-07 19:07:00 [] ? child_rip+0x0/0x20 2014-01-07 19:07:00 ffff880ff1407690 0000000000000046 ffff880ff14076b0 ffffffffa04e9367 2014-01-07 19:07:00 ffff880ff14076b0 0000000000000001 ffff880641309e40 ffff880e00000000 2014-01-07 19:07:00 ffff880ff1405af8 ffff880ff1407fd8 000000000000fb88 ffff880ff1405af8 2014-01-07 19:07:00 Call Trace: 2014-01-07 19:07:00 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:00 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:00 [] io_schedule+0x73/0xc0 2014-01-07 19:07:00 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:00 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:00 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:00 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:00 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:00 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:00 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:00 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:00 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:00 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:00 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:00 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:00 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] kthread+0x96/0xa0 2014-01-07 19:07:00 [] child_rip+0xa/0x20 2014-01-07 19:07:00 scsi host6: SRP abort called 2014-01-07 19:07:00 [] ? kthread+0x0/0xa0 2014-01-07 19:07:00 [] ? child_rip+0x0/0x20 2014-01-07 19:07:00 ffff880ff140b690 0000000000000046 ffff880ff140b6b0 ffffffffa04e97d6 2014-01-07 19:07:00 ffff880ff140b6b0 ffffffff00000001 ffff8803cbfe0190 ffff880e00000001 2014-01-07 19:07:00 ffff880ff1405098 ffff880ff140bfd8 000000000000fb88 ffff880ff1405098 2014-01-07 19:07:00 Call Trace: 2014-01-07 19:07:00 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:00 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:00 [] io_schedule+0x73/0xc0 2014-01-07 19:07:00 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:00 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:00 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:00 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:00 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:00 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:00 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:00 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:00 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:00 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:00 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:00 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:00 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:00 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] kthread+0x96/0xa0 2014-01-07 19:07:00 [] child_rip+0xa/0x20 2014-01-07 19:07:00 [] ? kthread+0x0/0xa0 2014-01-07 19:07:00 [] ? child_rip+0x0/0x20 2014-01-07 19:07:00 ffff880ff140f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:00 ffff880ff140f6b0 0000000000000001 0000000000000be9 ffff880e00000000 2014-01-07 19:07:00 ffff880ff1404638 ffff880ff140ffd8 000000000000fb88 ffff880ff1404638 2014-01-07 19:07:00 Call Trace: 2014-01-07 19:07:00 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:00 [] io_schedule+0x73/0xc0 2014-01-07 19:07:00 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:00 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:00 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:00 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:00 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:00 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:00 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:00 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:00 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:00 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:00 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:00 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:00 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:00 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:00 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:00 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:00 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:00 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:00 [] kthread+0x96/0xa0 2014-01-07 19:07:00 [] child_rip+0xa/0x20 2014-01-07 19:07:00 [] ? kthread+0x0/0xa0 2014-01-07 19:07:00 [] ? child_rip+0x0/0x20 2014-01-07 19:07:00 ffff880ff1413690 0000000000000046 ffff880ff14136b0 ffffffffa04e9367 2014-01-07 19:07:00 ffff880ff14136b0 0000000000000001 0000000000000e69 ffff880e00000000 2014-01-07 19:07:00 ffff880ff1411ab8 ffff880ff1413fd8 000000000000fb88 ffff880ff1411ab8 2014-01-07 19:07:00 Call Trace: 2014-01-07 19:07:00 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:00 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:00 [] io_schedule+0x73/0xc0 2014-01-07 19:07:01 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:01 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:01 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:01 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:01 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:01 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:01 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:01 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:01 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:01 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:01 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:01 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:01 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:01 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] kthread+0x96/0xa0 2014-01-07 19:07:01 [] child_rip+0xa/0x20 2014-01-07 19:07:01 [] ? kthread+0x0/0xa0 2014-01-07 19:07:01 [] ? child_rip+0x0/0x20 2014-01-07 19:07:01 ffff880ff1417690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:01 ffff880ff14176b0 0000000000000001 0000000000000b3f ffff880e00000000 2014-01-07 19:07:01 ffff880ff1411058 ffff880ff1417fd8 000000000000fb88 ffff880ff1411058 2014-01-07 19:07:01 Call Trace: 2014-01-07 19:07:01 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:01 [] io_schedule+0x73/0xc0 2014-01-07 19:07:01 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:01 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:01 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:01 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:01 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:01 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:01 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:01 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:01 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:01 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:01 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:01 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:01 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:01 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] kthread+0x96/0xa0 2014-01-07 19:07:01 [] child_rip+0xa/0x20 2014-01-07 19:07:01 [] ? kthread+0x0/0xa0 2014-01-07 19:07:01 [] ? child_rip+0x0/0x20 2014-01-07 19:07:01 ffff880ff1419360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:01 ffff880ff14192e0 ffffffff8150fa5e ffff880e83ec2340 ffff880e83ec2658 2014-01-07 19:07:01 ffff880ff14105f8 ffff880ff1419fd8 000000000000fb88 ffff880ff14105f8 2014-01-07 19:07:01 Call Trace: 2014-01-07 19:07:01 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:01 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:01 [] io_schedule+0x73/0xc0 2014-01-07 19:07:01 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:01 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:01 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:01 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:01 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:01 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:01 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:01 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:01 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:01 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:01 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:01 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:01 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:01 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:01 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:01 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:01 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:01 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:01 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:01 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:01 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:01 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] kthread+0x96/0xa0 2014-01-07 19:07:01 [] child_rip+0xa/0x20 2014-01-07 19:07:01 [] ? kthread+0x0/0xa0 2014-01-07 19:07:01 [] ? child_rip+0x0/0x20 2014-01-07 19:07:01 ffff880ff141d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:01 ffff880ff141d6b0 0000000000000001 0000000000000d1a ffff880e00000000 2014-01-07 19:07:01 ffff880ff141baf8 ffff880ff141dfd8 000000000000fb88 ffff880ff141baf8 2014-01-07 19:07:01 Call Trace: 2014-01-07 19:07:01 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:01 [] io_schedule+0x73/0xc0 2014-01-07 19:07:01 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:01 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:01 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:01 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:01 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:01 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:01 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:01 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:01 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:01 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:01 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:01 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:01 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:01 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] kthread+0x96/0xa0 2014-01-07 19:07:01 [] child_rip+0xa/0x20 2014-01-07 19:07:01 [] ? kthread+0x0/0xa0 2014-01-07 19:07:01 [] ? child_rip+0x0/0x20 2014-01-07 19:07:01 ffff880ff1435690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:01 ffff880ff14356b0 0000000000000001 0000000000000aec ffff880e00000000 2014-01-07 19:07:01 ffff880ff141b098 ffff880ff1435fd8 000000000000fb88 ffff880ff141b098 2014-01-07 19:07:01 Call Trace: 2014-01-07 19:07:01 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:01 [] io_schedule+0x73/0xc0 2014-01-07 19:07:01 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:01 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:01 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:01 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:01 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:01 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:01 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:01 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:01 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:01 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:01 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:01 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:01 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:01 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:01 [] kthread+0x96/0xa0 2014-01-07 19:07:01 [] child_rip+0xa/0x20 2014-01-07 19:07:01 [] ? kthread+0x0/0xa0 2014-01-07 19:07:01 [] ? child_rip+0x0/0x20 2014-01-07 19:07:01 ffff880ff146b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:01 ffff880ff146b6b0 0000000000000001 0000000000000b6e ffff880e00000000 2014-01-07 19:07:01 ffff880ff141a638 ffff880ff146bfd8 000000000000fb88 ffff880ff141a638 2014-01-07 19:07:01 Call Trace: 2014-01-07 19:07:01 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:01 [] io_schedule+0x73/0xc0 2014-01-07 19:07:01 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:01 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:01 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:01 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:01 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:01 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:01 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:01 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:01 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:01 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:01 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:02 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:02 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:02 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:02 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:02 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:02 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:02 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] kthread+0x96/0xa0 2014-01-07 19:07:02 [] child_rip+0xa/0x20 2014-01-07 19:07:02 [] ? kthread+0x0/0xa0 2014-01-07 19:07:02 [] ? child_rip+0x0/0x20 2014-01-07 19:07:02 ffff880ff1485690 0000000000000046 ffff880ff14856b0 ffffffffa04e97d6 2014-01-07 19:07:02 ffff880ff14856b0 ffffffff00000001 ffff88033f512190 ffff880e00000001 2014-01-07 19:07:02 ffff880ff146fab8 ffff880ff1485fd8 000000000000fb88 ffff880ff146fab8 2014-01-07 19:07:02 Call Trace: 2014-01-07 19:07:02 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:02 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:02 [] io_schedule+0x73/0xc0 2014-01-07 19:07:02 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:02 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:02 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:02 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:02 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:02 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:02 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:02 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:02 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:02 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:02 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:02 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:02 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:02 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:02 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] kthread+0x96/0xa0 2014-01-07 19:07:02 [] child_rip+0xa/0x20 2014-01-07 19:07:02 [] ? kthread+0x0/0xa0 2014-01-07 19:07:02 [] ? child_rip+0x0/0x20 2014-01-07 19:07:02 ffff880ff14894e0 0000000000000046 0000000000000000 ffffffff8127fa1e 2014-01-07 19:07:02 0000002100000005 ffff8807d1e04000 ffff880ff1489460 ffff880ff1489480 2014-01-07 19:07:02 ffff880ff146f058 ffff880ff1489fd8 000000000000fb88 ffff880ff146f058 2014-01-07 19:07:02 Call Trace: 2014-01-07 19:07:02 [] ? number+0x2ee/0x320 2014-01-07 19:07:02 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:07:02 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:07:02 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:07:02 [] ? down_write+0x32/0x40 2014-01-07 19:07:02 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:07:02 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:02 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:02 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:02 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:02 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:02 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:02 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:02 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:02 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:02 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:02 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:02 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] kthread+0x96/0xa0 2014-01-07 19:07:02 [] child_rip+0xa/0x20 2014-01-07 19:07:02 [] ? kthread+0x0/0xa0 2014-01-07 19:07:02 [] ? child_rip+0x0/0x20 2014-01-07 19:07:02 ffff880ff14bd690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:02 ffff880ff14bd6b0 0000000000000001 0000000000000b91 ffff880e00000000 2014-01-07 19:07:02 ffff880ff146e5f8 ffff880ff14bdfd8 000000000000fb88 ffff880ff146e5f8 2014-01-07 19:07:02 Call Trace: 2014-01-07 19:07:02 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:02 [] io_schedule+0x73/0xc0 2014-01-07 19:07:02 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:02 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:02 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:02 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:02 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:02 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:02 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:02 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:02 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:02 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:02 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:02 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:02 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:02 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:02 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] kthread+0x96/0xa0 2014-01-07 19:07:02 [] child_rip+0xa/0x20 2014-01-07 19:07:02 [] ? kthread+0x0/0xa0 2014-01-07 19:07:02 [] ? child_rip+0x0/0x20 2014-01-07 19:07:02 ffff880ff14d5690 0000000000000046 ffff880ff14d56b0 ffffffffa04e9367 2014-01-07 19:07:02 ffff880ff14d56b0 0000000000000001 0000000000000b44 ffff880e00000000 2014-01-07 19:07:02 ffff880ff14bfaf8 ffff880ff14d5fd8 000000000000fb88 ffff880ff14bfaf8 2014-01-07 19:07:02 Call Trace: 2014-01-07 19:07:02 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:02 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:02 [] io_schedule+0x73/0xc0 2014-01-07 19:07:02 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:02 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:02 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:02 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:02 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:02 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:02 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:02 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:02 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:02 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:02 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:02 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:02 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:02 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:02 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:02 [] kthread+0x96/0xa0 2014-01-07 19:07:02 [] child_rip+0xa/0x20 2014-01-07 19:07:02 [] ? kthread+0x0/0xa0 2014-01-07 19:07:02 [] ? child_rip+0x0/0x20 2014-01-07 19:07:02 ffff880ff14d9360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:02 ffff880ff14d92e0 ffffffff8150fa5e ffff8806c3b7ac00 ffff8806c3b7af18 2014-01-07 19:07:02 ffff880ff14bf098 ffff880ff14d9fd8 000000000000fb88 ffff880ff14bf098 2014-01-07 19:07:02 Call Trace: 2014-01-07 19:07:02 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:02 [] io_schedule+0x73/0xc0 2014-01-07 19:07:02 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:02 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:02 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:02 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:02 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:02 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:02 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:02 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:02 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:02 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:02 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:02 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:02 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:02 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:02 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:02 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:02 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:02 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:02 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:02 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:02 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:02 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:02 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:02 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:02 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:03 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] kthread+0x96/0xa0 2014-01-07 19:07:03 [] child_rip+0xa/0x20 2014-01-07 19:07:03 [] ? kthread+0x0/0xa0 2014-01-07 19:07:03 [] ? child_rip+0x0/0x20 2014-01-07 19:07:03 ffff880ff14db690 0000000000000046 ffff880ff14db6b0 ffffffffa04e9367 2014-01-07 19:07:03 ffff880ff14db6b0 0000000000000001 0000000000000cd1 ffff880700000000 2014-01-07 19:07:03 ffff880ff14be638 ffff880ff14dbfd8 000000000000fb88 ffff880ff14be638 2014-01-07 19:07:03 Call Trace: 2014-01-07 19:07:03 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:03 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:03 [] io_schedule+0x73/0xc0 2014-01-07 19:07:03 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:03 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:03 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:03 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:03 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:03 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:03 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:03 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:03 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:03 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:03 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:03 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:03 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:03 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:03 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] kthread+0x96/0xa0 2014-01-07 19:07:03 [] child_rip+0xa/0x20 2014-01-07 19:07:03 [] ? kthread+0x0/0xa0 2014-01-07 19:07:03 [] ? child_rip+0x0/0x20 2014-01-07 19:07:03 ffff880ff14f34e0 0000000000000046 ffff880ff14f3500 ffffffff8127fa1e 2014-01-07 19:07:03 0000002100000005 ffff880ff1d56000 ffff880ff14f3460 ffff880ff14f3480 2014-01-07 19:07:03 ffff880ff14f1ab8 ffff880ff14f3fd8 000000000000fb88 ffff880ff14f1ab8 2014-01-07 19:07:03 Call Trace: 2014-01-07 19:07:03 [] ? number+0x2ee/0x320 2014-01-07 19:07:03 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:07:03 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:07:03 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:07:03 [] ? down_write+0x32/0x40 2014-01-07 19:07:03 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:07:03 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:03 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:03 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:03 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:03 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:03 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:03 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:03 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:03 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:03 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:03 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:03 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] kthread+0x96/0xa0 2014-01-07 19:07:03 [] child_rip+0xa/0x20 2014-01-07 19:07:03 [] ? kthread+0x0/0xa0 2014-01-07 19:07:03 [] ? child_rip+0x0/0x20 2014-01-07 19:07:03 ffff880ff14fd690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:03 ffff880ff14fd6b0 0000000000000001 0000000000000c5b ffff880e00000000 2014-01-07 19:07:03 ffff880ff14f1058 ffff880ff14fdfd8 000000000000fb88 ffff880ff14f1058 2014-01-07 19:07:03 Call Trace: 2014-01-07 19:07:03 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:03 [] io_schedule+0x73/0xc0 2014-01-07 19:07:03 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:03 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:03 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:03 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:03 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:03 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:03 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:03 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:03 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:03 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:03 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:03 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:03 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:03 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:03 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] kthread+0x96/0xa0 2014-01-07 19:07:03 [] child_rip+0xa/0x20 2014-01-07 19:07:03 [] ? kthread+0x0/0xa0 2014-01-07 19:07:03 [] ? child_rip+0x0/0x20 2014-01-07 19:07:03 ffff880ff14ff690 0000000000000046 ffff880ff14ff6b0 ffffffffa04e9367 2014-01-07 19:07:03 ffff880ff14ff6b0 0000000000000001 0000000000000c2d ffff880e00000000 2014-01-07 19:07:03 ffff880ff14f05f8 ffff880ff14fffd8 000000000000fb88 ffff880ff14f05f8 2014-01-07 19:07:03 Call Trace: 2014-01-07 19:07:03 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:03 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:03 [] io_schedule+0x73/0xc0 2014-01-07 19:07:03 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:03 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:03 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:03 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:03 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:03 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:03 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:03 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:03 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:03 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:03 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:03 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:03 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:03 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:03 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] kthread+0x96/0xa0 2014-01-07 19:07:03 [] child_rip+0xa/0x20 2014-01-07 19:07:03 [] ? kthread+0x0/0xa0 2014-01-07 19:07:03 [] ? child_rip+0x0/0x20 2014-01-07 19:07:03 ffff880ff1513690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:03 ffff880ff15136b0 0000000000000001 0000000000000bc7 ffff880e00000000 2014-01-07 19:07:03 ffff880ff1511af8 ffff880ff1513fd8 000000000000fb88 ffff880ff1511af8 2014-01-07 19:07:03 Call Trace: 2014-01-07 19:07:03 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:03 [] io_schedule+0x73/0xc0 2014-01-07 19:07:03 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:03 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:03 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:03 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:03 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:03 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:03 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:03 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:03 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:03 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:03 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:03 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:03 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:03 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:03 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:03 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:03 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:03 [] kthread+0x96/0xa0 2014-01-07 19:07:03 [] child_rip+0xa/0x20 2014-01-07 19:07:03 [] ? kthread+0x0/0xa0 2014-01-07 19:07:03 [] ? child_rip+0x0/0x20 2014-01-07 19:07:03 ffff880ff1517690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:03 ffff880ff15176b0 ffffffff00000001 ffff880e80ac8750 ffff880e80ac8748 2014-01-07 19:07:03 ffff880ff1511098 ffff880ff1517fd8 000000000000fb88 ffff880ff1511098 2014-01-07 19:07:03 Call Trace: 2014-01-07 19:07:03 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:03 [] io_schedule+0x73/0xc0 2014-01-07 19:07:03 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:03 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:03 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:03 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:03 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:04 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:04 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:04 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:04 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:04 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:04 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:04 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:04 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:04 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:04 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:04 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] kthread+0x96/0xa0 2014-01-07 19:07:04 [] child_rip+0xa/0x20 2014-01-07 19:07:04 [] ? kthread+0x0/0xa0 2014-01-07 19:07:04 [] ? child_rip+0x0/0x20 2014-01-07 19:07:04 ffff880ff154d690 0000000000000046 ffff880ff154d6b0 ffffffffa04e9367 2014-01-07 19:07:04 ffff880ff154d6b0 0000000000000001 0000000000000c5b ffff880e00000000 2014-01-07 19:07:04 ffff880ff1510638 ffff880ff154dfd8 000000000000fb88 ffff880ff1510638 2014-01-07 19:07:04 Call Trace: 2014-01-07 19:07:04 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:04 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:04 [] io_schedule+0x73/0xc0 2014-01-07 19:07:04 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:04 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:04 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:04 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:04 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:04 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:04 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:04 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:04 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:04 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:04 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:04 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:04 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:04 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:04 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] kthread+0x96/0xa0 2014-01-07 19:07:04 [] child_rip+0xa/0x20 2014-01-07 19:07:04 [] ? kthread+0x0/0xa0 2014-01-07 19:07:04 [] ? child_rip+0x0/0x20 2014-01-07 19:07:04 ffff880ff1551690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:04 ffff880ff15516b0 0000000000000001 0000000000000e57 ffff880e00000000 2014-01-07 19:07:04 ffff880ff154fab8 ffff880ff1551fd8 000000000000fb88 ffff880ff154fab8 2014-01-07 19:07:04 Call Trace: 2014-01-07 19:07:04 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:04 [] io_schedule+0x73/0xc0 2014-01-07 19:07:04 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:04 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:04 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:04 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:04 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:04 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:04 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:04 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:04 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:04 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:04 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:04 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:04 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:04 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:04 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] kthread+0x96/0xa0 2014-01-07 19:07:04 [] child_rip+0xa/0x20 2014-01-07 19:07:04 [] ? kthread+0x0/0xa0 2014-01-07 19:07:04 [] ? child_rip+0x0/0x20 2014-01-07 19:07:04 ffff880ff1555690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:04 ffff880ff15556b0 0000000000000001 0000000000000b3f ffff880e00000000 2014-01-07 19:07:04 ffff880ff154f058 ffff880ff1555fd8 000000000000fb88 ffff880ff154f058 2014-01-07 19:07:04 Call Trace: 2014-01-07 19:07:04 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:04 [] io_schedule+0x73/0xc0 2014-01-07 19:07:04 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:04 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:04 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:04 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:04 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:04 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:04 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:04 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:04 scsi host7: SRP abort called 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:04 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:04 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:04 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:04 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:04 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:04 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:04 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] kthread+0x96/0xa0 2014-01-07 19:07:04 [] child_rip+0xa/0x20 2014-01-07 19:07:04 [] ? kthread+0x0/0xa0 2014-01-07 19:07:04 [] ? child_rip+0x0/0x20 2014-01-07 19:07:04 ffff88076becb4e0 0000000000000046 0000000000000000 ffff88076becb4a4 2014-01-07 19:07:04 0000002100000000 ffff88083fe81800 ffff880044656740 0000000000000400 2014-01-07 19:07:04 ffff880834387058 ffff88076becbfd8 000000000000fb88 ffff880834387058 2014-01-07 19:07:04 Call Trace: 2014-01-07 19:07:04 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:07:04 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:07:04 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:07:04 [] ? down_write+0x32/0x40 2014-01-07 19:07:04 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:07:04 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:04 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:04 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:04 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:04 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:04 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:04 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:04 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:04 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:04 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:04 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:04 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] kthread+0x96/0xa0 2014-01-07 19:07:04 [] child_rip+0xa/0x20 2014-01-07 19:07:04 [] ? kthread+0x0/0xa0 2014-01-07 19:07:04 [] ? child_rip+0x0/0x20 2014-01-07 19:07:04 ffff88076bee5690 0000000000000046 ffff88076bee56b0 ffffffffa04e9367 2014-01-07 19:07:04 ffff88076bee56b0 0000000000000001 0000000000000e60 ffff880e00000000 2014-01-07 19:07:04 ffff88083190d098 ffff88076bee5fd8 000000000000fb88 ffff88083190d098 2014-01-07 19:07:04 Call Trace: 2014-01-07 19:07:04 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:04 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:04 [] io_schedule+0x73/0xc0 2014-01-07 19:07:04 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:04 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:04 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:04 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:04 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:04 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:04 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:04 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:04 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:04 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:04 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:04 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:04 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:04 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:04 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:04 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:04 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:04 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:04 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] kthread+0x96/0xa0 2014-01-07 19:07:05 [] child_rip+0xa/0x20 2014-01-07 19:07:05 [] ? kthread+0x0/0xa0 2014-01-07 19:07:05 [] ? child_rip+0x0/0x20 2014-01-07 19:07:05 ffff88076baff690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:05 ffff88076baff6b0 0000000000000001 0000000000000ba1 ffff880e00000000 2014-01-07 19:07:05 ffff8808342825f8 ffff88076bafffd8 000000000000fb88 ffff8808342825f8 2014-01-07 19:07:05 Call Trace: 2014-01-07 19:07:05 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:05 [] io_schedule+0x73/0xc0 2014-01-07 19:07:05 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:05 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:05 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:05 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:05 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:05 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:05 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:05 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:05 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:05 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:05 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:05 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:05 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:05 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:05 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] kthread+0x96/0xa0 2014-01-07 19:07:05 [] child_rip+0xa/0x20 2014-01-07 19:07:05 [] ? kthread+0x0/0xa0 2014-01-07 19:07:05 [] ? child_rip+0x0/0x20 2014-01-07 19:07:05 ffff880ff15b5690 0000000000000046 ffff880ff15b56b0 ffffffffa04e9367 2014-01-07 19:07:05 ffff880ff15b56b0 0000000000000001 0000000000000d08 ffff880e00000000 2014-01-07 19:07:05 ffff881031da65f8 ffff880ff15b5fd8 000000000000fb88 ffff881031da65f8 2014-01-07 19:07:05 Call Trace: 2014-01-07 19:07:05 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:05 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:05 [] io_schedule+0x73/0xc0 2014-01-07 19:07:05 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:05 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:05 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:05 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:05 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:05 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:05 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:05 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:05 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:05 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:05 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:05 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:05 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:05 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:05 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] kthread+0x96/0xa0 2014-01-07 19:07:05 [] child_rip+0xa/0x20 2014-01-07 19:07:05 [] ? kthread+0x0/0xa0 2014-01-07 19:07:05 [] ? child_rip+0x0/0x20 2014-01-07 19:07:05 ffff880ff167b690 0000000000000046 ffff880ff167b6b0 ffffffffa04e9367 2014-01-07 19:07:05 ffff880ff167b6b0 0000000000000001 0000000000000b07 ffff880e00000000 2014-01-07 19:07:05 ffff880ff1679af8 ffff880ff167bfd8 000000000000fb88 ffff880ff1679af8 2014-01-07 19:07:05 Call Trace: 2014-01-07 19:07:05 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:05 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:05 [] io_schedule+0x73/0xc0 2014-01-07 19:07:05 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:05 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:05 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:05 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:05 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:05 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:05 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:05 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:05 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:05 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:05 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:05 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:05 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:05 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:05 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] kthread+0x96/0xa0 2014-01-07 19:07:05 [] child_rip+0xa/0x20 2014-01-07 19:07:05 [] ? kthread+0x0/0xa0 2014-01-07 19:07:05 [] ? child_rip+0x0/0x20 2014-01-07 19:07:05 ffff880ff1695690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:05 ffff880ff16956b0 0000000000000001 0000000000000bf4 ffff880e00000000 2014-01-07 19:07:05 ffff880ff1679098 ffff880ff1695fd8 000000000000fb88 2014-01-07 19:07:05 scsi host6: SRP abort called 2014-01-07 19:07:05 ffff880ff1679098 2014-01-07 19:07:05 Call Trace: 2014-01-07 19:07:05 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:05 [] io_schedule+0x73/0xc0 2014-01-07 19:07:05 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:05 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:05 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:05 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:05 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:05 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:05 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:05 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:05 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:05 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:05 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:05 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:05 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:05 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:05 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] kthread+0x96/0xa0 2014-01-07 19:07:05 [] child_rip+0xa/0x20 2014-01-07 19:07:05 [] ? kthread+0x0/0xa0 2014-01-07 19:07:05 [] ? child_rip+0x0/0x20 2014-01-07 19:07:05 ffff880ff16c9da0 0000000000000046 0000000000000000 ffff880ff1f48c00 2014-01-07 19:07:05 ffff880ff4f71c00 0000000000000000 000000000000003a ffff8810338651c0 2014-01-07 19:07:05 ffff880ff1678638 ffff880ff16c9fd8 000000000000fb88 ffff880ff1678638 2014-01-07 19:07:05 Call Trace: 2014-01-07 19:07:05 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:05 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:05 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:05 [] kthread+0x96/0xa0 2014-01-07 19:07:05 [] child_rip+0xa/0x20 2014-01-07 19:07:05 [] ? kthread+0x0/0xa0 2014-01-07 19:07:05 [] ? child_rip+0x0/0x20 2014-01-07 19:07:05 ffff880ff16e1360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:05 ffff880ff16e12e0 ffffffff8150fa5e ffff880e79fe4aa0 ffff880e79fe4db8 2014-01-07 19:07:05 ffff880ff16cbab8 ffff880ff16e1fd8 000000000000fb88 ffff880ff16cbab8 2014-01-07 19:07:05 Call Trace: 2014-01-07 19:07:05 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:05 [] io_schedule+0x73/0xc0 2014-01-07 19:07:05 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:05 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:05 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:05 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:05 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:05 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:05 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:05 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:05 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:05 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:05 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:05 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:05 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:05 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:05 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:05 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:05 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:05 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:05 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:05 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:05 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:05 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:05 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:05 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:06 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:06 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] kthread+0x96/0xa0 2014-01-07 19:07:06 [] child_rip+0xa/0x20 2014-01-07 19:07:06 [] ? kthread+0x0/0xa0 2014-01-07 19:07:06 [] ? child_rip+0x0/0x20 2014-01-07 19:07:06 ffff880ff16e9690 0000000000000046 ffff880ff16e96b0 ffffffffa04e9367 2014-01-07 19:07:06 ffff880ff16e96b0 0000000000000001 0000000000000d48 ffff880700000000 2014-01-07 19:07:06 ffff880ff1a3c5f8 ffff880ff16e9fd8 000000000000fb88 ffff880ff1a3c5f8 2014-01-07 19:07:06 Call Trace: 2014-01-07 19:07:06 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:06 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:06 [] io_schedule+0x73/0xc0 2014-01-07 19:07:06 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:06 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:06 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:06 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:06 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:06 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:06 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:06 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:06 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:06 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:06 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:06 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:06 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:06 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:06 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] kthread+0x96/0xa0 2014-01-07 19:07:06 [] child_rip+0xa/0x20 2014-01-07 19:07:06 [] ? kthread+0x0/0xa0 2014-01-07 19:07:06 [] ? child_rip+0x0/0x20 2014-01-07 19:07:06 ffff880ff1711690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:06 ffff880ff17116b0 0000000000000001 0000000000000c1e ffff880e00000000 2014-01-07 19:07:06 ffff880ff16ebaf8 ffff880ff1711fd8 000000000000fb88 ffff880ff16ebaf8 2014-01-07 19:07:06 Call Trace: 2014-01-07 19:07:06 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:06 [] io_schedule+0x73/0xc0 2014-01-07 19:07:06 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:06 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:06 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:06 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:06 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:06 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:06 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:06 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:06 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:06 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:06 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:06 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:06 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:06 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:06 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] kthread+0x96/0xa0 2014-01-07 19:07:06 [] child_rip+0xa/0x20 2014-01-07 19:07:06 [] ? kthread+0x0/0xa0 2014-01-07 19:07:06 [] ? child_rip+0x0/0x20 2014-01-07 19:07:06 ffff880ff1715360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:06 ffff880ff17152e0 ffffffff8150fa5e ffff880740e5ac00 ffff880740e5af18 2014-01-07 19:07:06 ffff880ff16eb098 ffff880ff1715fd8 000000000000fb88 ffff880ff16eb098 2014-01-07 19:07:06 Call Trace: 2014-01-07 19:07:06 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:06 [] io_schedule+0x73/0xc0 2014-01-07 19:07:06 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:06 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:06 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:06 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:06 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:06 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:06 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:06 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:06 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:06 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:06 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:06 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:06 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:06 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:06 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:06 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:06 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:06 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:06 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:06 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:06 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:06 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:06 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] kthread+0x96/0xa0 2014-01-07 19:07:06 [] child_rip+0xa/0x20 2014-01-07 19:07:06 [] ? kthread+0x0/0xa0 2014-01-07 19:07:06 [] ? child_rip+0x0/0x20 2014-01-07 19:07:06 ffff880ff1717690 0000000000000046 ffff880ff17176b0 ffffffffa04e9367 2014-01-07 19:07:06 ffff880ff17176b0 0000000000000001 0000000000000dbd ffff880e00000000 2014-01-07 19:07:06 ffff880ff16ea638 ffff880ff1717fd8 000000000000fb88 ffff880ff16ea638 2014-01-07 19:07:06 Call Trace: 2014-01-07 19:07:06 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:06 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:06 [] io_schedule+0x73/0xc0 2014-01-07 19:07:06 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:06 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:06 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:06 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:06 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:06 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:06 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:06 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:06 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:06 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:06 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:06 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:06 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:06 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:06 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] kthread+0x96/0xa0 2014-01-07 19:07:06 [] child_rip+0xa/0x20 2014-01-07 19:07:06 [] ? kthread+0x0/0xa0 2014-01-07 19:07:06 [] ? child_rip+0x0/0x20 2014-01-07 19:07:06 ffff880ff171d690 0000000000000046 0000000000000000 ffff880ff171d654 2014-01-07 19:07:06 ffff880f00000000 ffff88083fe82a00 ffff88085c436740 0000000000000400 2014-01-07 19:07:06 ffff880ff171bab8 ffff880ff171dfd8 000000000000fb88 ffff880ff171bab8 2014-01-07 19:07:06 Call Trace: 2014-01-07 19:07:06 [] io_schedule+0x73/0xc0 2014-01-07 19:07:06 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:06 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:06 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:06 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:06 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:06 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:06 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:06 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:06 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:06 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:06 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:06 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:06 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:06 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:06 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:06 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:06 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:06 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:06 [] kthread+0x96/0xa0 2014-01-07 19:07:06 [] child_rip+0xa/0x20 2014-01-07 19:07:06 [] ? kthread+0x0/0xa0 2014-01-07 19:07:06 [] ? child_rip+0x0/0x20 2014-01-07 19:07:06 ffff880ff1755360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:06 ffff880ff17552e0 ffffffff8150fa5e ffff880e8f56c1e0 ffff880e8f56c4f8 2014-01-07 19:07:06 ffff880ff171b058 ffff880ff1755fd8 000000000000fb88 ffff880ff171b058 2014-01-07 19:07:06 Call Trace: 2014-01-07 19:07:06 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:06 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:06 [] io_schedule+0x73/0xc0 2014-01-07 19:07:07 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:07 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:07 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:07 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:07 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:07 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:07 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:07 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:07 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:07 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:07 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:07 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:07 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:07 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:07 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:07 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:07 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:07 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:07 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:07 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:07 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:07 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:07 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] kthread+0x96/0xa0 2014-01-07 19:07:07 [] child_rip+0xa/0x20 2014-01-07 19:07:07 [] ? kthread+0x0/0xa0 2014-01-07 19:07:07 [] ? child_rip+0x0/0x20 2014-01-07 19:07:07 ffff880ff1757690 0000000000000046 ffff880ff17576b0 ffffffffa04e9367 2014-01-07 19:07:07 ffff880ff17576b0 0000000000000001 0000000000000b59 ffff880e00000000 2014-01-07 19:07:07 ffff880ff171a5f8 ffff880ff1757fd8 000000000000fb88 ffff880ff171a5f8 2014-01-07 19:07:07 Call Trace: 2014-01-07 19:07:07 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:07 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:07 [] io_schedule+0x73/0xc0 2014-01-07 19:07:07 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:07 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:07 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:07 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:07 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:07 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:07 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:07 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:07 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:07 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:07 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:07 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:07 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:07 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:07 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] kthread+0x96/0xa0 2014-01-07 19:07:07 [] child_rip+0xa/0x20 2014-01-07 19:07:07 [] ? kthread+0x0/0xa0 2014-01-07 19:07:07 [] ? child_rip+0x0/0x20 2014-01-07 19:07:07 ffff880ff175b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:07 ffff880ff175b6b0 0000000000000001 0000000000000e21 ffff880700000000 2014-01-07 19:07:07 ffff880ff1759af8 ffff880ff175bfd8 000000000000fb88 ffff880ff1759af8 2014-01-07 19:07:07 Call Trace: 2014-01-07 19:07:07 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:07 [] io_schedule+0x73/0xc0 2014-01-07 19:07:07 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:07 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:07 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:07 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:07 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:07 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:07 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:07 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:07 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:07 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:07 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:07 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:07 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:07 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:07 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] kthread+0x96/0xa0 2014-01-07 19:07:07 [] child_rip+0xa/0x20 2014-01-07 19:07:07 [] ? kthread+0x0/0xa0 2014-01-07 19:07:07 [] ? child_rip+0x0/0x20 2014-01-07 19:07:07 ffff880ff175f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:07 ffff880ff175f6b0 0000000000000001 0000000000000c01 ffff880e00000000 2014-01-07 19:07:07 ffff880ff1759098 ffff880ff175ffd8 000000000000fb88 ffff880ff1759098 2014-01-07 19:07:07 Call Trace: 2014-01-07 19:07:07 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:07 [] io_schedule+0x73/0xc0 2014-01-07 19:07:07 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:07 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:07 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:07 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:07 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:07 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:07 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:07 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:07 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:07 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:07 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:07 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:07 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:07 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:07 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] kthread+0x96/0xa0 2014-01-07 19:07:07 [] child_rip+0xa/0x20 2014-01-07 19:07:07 [] ? kthread+0x0/0xa0 2014-01-07 19:07:07 [] ? child_rip+0x0/0x20 2014-01-07 19:07:07 ffff880ff1761360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:07 ffff880ff17612e0 ffffffff8150fa5e ffff880e9159e4e0 ffff880e9159e7f8 2014-01-07 19:07:07 ffff880ff1758638 ffff880ff1761fd8 000000000000fb88 ffff880ff1758638 2014-01-07 19:07:07 Call Trace: 2014-01-07 19:07:07 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:07 [] io_schedule+0x73/0xc0 2014-01-07 19:07:07 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:07 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:07 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:07 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:07 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:07 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:07 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:07 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:07 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:07 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:07 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:07 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:07 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:07 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:07 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:07 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:07 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:07 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:07 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:07 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:07 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:07 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:07 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:07 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:07 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:07 [] kthread+0x96/0xa0 2014-01-07 19:07:07 [] child_rip+0xa/0x20 2014-01-07 19:07:07 [] ? kthread+0x0/0xa0 2014-01-07 19:07:07 [] ? child_rip+0x0/0x20 2014-01-07 19:07:07 ffff88074c0b9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:07 ffff88074c0b96b0 0000000000000001 0000000000000e81 ffff880e00000000 2014-01-07 19:07:07 ffff880789e83098 ffff88074c0b9fd8 000000000000fb88 ffff880789e83098 2014-01-07 19:07:07 Call Trace: 2014-01-07 19:07:07 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:07 [] io_schedule+0x73/0xc0 2014-01-07 19:07:07 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:07 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:07 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:07 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:08 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:08 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:08 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:08 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:08 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:08 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:08 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:08 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:08 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:08 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880ff1781690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:08 ffff880ff17816b0 0000000000000001 0000000000000b8c ffff880e00000000 2014-01-07 19:07:08 ffff880ff16cb058 ffff880ff1781fd8 000000000000fb88 ffff880ff16cb058 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:08 [] io_schedule+0x73/0xc0 2014-01-07 19:07:08 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:08 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:08 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:08 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:08 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:08 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:08 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:08 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:08 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:08 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:08 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:08 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:08 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880ff102b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:08 ffff880ff102b6b0 0000000000000001 0000000000000b30 ffff880e00000000 2014-01-07 19:07:08 ffff880ff1ac25f8 ffff880ff102bfd8 000000000000fb88 ffff880ff1ac25f8 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:08 [] io_schedule+0x73/0xc0 2014-01-07 19:07:08 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:08 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:08 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:08 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:08 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:08 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:08 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:08 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:08 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:08 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:08 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:08 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:08 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:08 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880ff120f360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:08 ffff880ff120f2e0 ffffffff8150fa5e ffff880e78d8e940 ffff880e78d8ec58 2014-01-07 19:07:08 ffff880ff1ac3058 ffff880ff120ffd8 000000000000fb88 ffff880ff1ac3058 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:08 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:08 [] io_schedule+0x73/0xc0 2014-01-07 19:07:08 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:08 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:08 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:08 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:08 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:08 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:08 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:08 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:08 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:08 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:08 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:08 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:08 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:08 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:08 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:08 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:08 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:08 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:08 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:08 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:08 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:08 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:08 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:08 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:08 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880e8edf1da0 0000000000000046 0000000000000000 ffff8807943f33c0 2014-01-07 19:07:08 ffff8807d0cf2400 0000000000000000 0000000000000003 ffff8810343b6580 2014-01-07 19:07:08 ffff881031da7058 ffff880e8edf1fd8 000000000000fb88 ffff881031da7058 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:08 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880e8df25da0 0000000000000046 ffff880e8df25d68 ffff880e8df25d64 2014-01-07 19:07:08 ffff880ff541e000 ffff88083fe82600 ffff88085c456740 0000000000000207 2014-01-07 19:07:08 ffff880e8cf75ab8 ffff880e8df25fd8 000000000000fb88 ffff880e8cf75ab8 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:08 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880e8c7f5da0 0000000000000046 ffff880e8cf75058 ffff880e8c7f5fd8 2014-01-07 19:07:08 000000000000fb88 ffff880e8cf75060 ffff88081878cae0 ffff880e8cf74aa0 2014-01-07 19:07:08 ffff880e8cf75058 ffff880e8c7f5fd8 000000000000fb88 ffff880e8cf75058 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:08 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880e8fb2bda0 0000000000000046 ffff880e8fb2bd68 ffff880e8fb2bd64 2014-01-07 19:07:08 000000000000fb88 ffff88083fe81800 ffff8800446b6740 0000000000000400 2014-01-07 19:07:08 ffff880e8cf745f8 ffff880e8fb2bfd8 000000000000fb88 ffff880e8cf745f8 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:08 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:08 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:08 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:08 [] kthread+0x96/0xa0 2014-01-07 19:07:08 [] child_rip+0xa/0x20 2014-01-07 19:07:08 [] ? kthread+0x0/0xa0 2014-01-07 19:07:08 [] ? child_rip+0x0/0x20 2014-01-07 19:07:08 ffff880e8ed7fda0 0000000000000046 ffff880e8ed7fd68 ffff880e8ed7fd64 2014-01-07 19:07:08 ffff8807d138fc00 ffff88083fe81e00 ffff880044696740 000000000000af5c 2014-01-07 19:07:08 ffff880e8f98daf8 ffff880e8ed7ffd8 000000000000fb88 ffff880e8f98daf8 2014-01-07 19:07:08 Call Trace: 2014-01-07 19:07:08 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8d5f3da0 0000000000000046 0000000000000000 ffff880e8d5f3d64 2014-01-07 19:07:09 ffff880700000000 ffff88083fe81800 ffff880044616740 000000000000015a 2014-01-07 19:07:09 ffff880e8f98d098 ffff880e8d5f3fd8 000000000000fb88 ffff880e8f98d098 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8e70fda0 0000000000000046 ffff880e8e70fd68 ffff880e8e70fd64 2014-01-07 19:07:09 ffff8807d0cf2400 ffff88083fe81e00 ffff880044616740 0000000000000201 2014-01-07 19:07:09 ffff880e8f98c638 ffff880e8e70ffd8 000000000000fb88 ffff880e8f98c638 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880ff1591da0 0000000000000046 ffff880700000010 ffff8807b40c6900 2014-01-07 19:07:09 ffff8807d0cf2400 0000000000000000 0000000000000013 ffff8810343b6580 2014-01-07 19:07:09 ffff880e8ce35ab8 ffff880ff1591fd8 000000000000fb88 ffff880e8ce35ab8 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:07:09 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8ece3da0 0000000000000046 ffff880e8ece3d68 ffff880e8ece3d64 2014-01-07 19:07:09 ffff8807d0cf2400 ffff88083fe81800 ffff8800446d6740 0000000000000400 2014-01-07 19:07:09 ffff880e8ce35058 ffff880e8ece3fd8 000000000000fb88 ffff880e8ce35058 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8f969da0 0000000000000046 0000000000000000 ffff880e8f969d64 2014-01-07 19:07:09 ffff8807d138f800 ffff88083fe81400 ffff880044616740 0000000000000486 2014-01-07 19:07:09 ffff880e8ce345f8 ffff880e8f969fd8 000000000000fb88 ffff880e8ce345f8 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880fc2d83da0 0000000000000046 0000000000000000 ffff880fc2d83d64 2014-01-07 19:07:09 ffff8807d0cf2400 ffff88083fe81800 ffff8800446f6740 0000000000000400 2014-01-07 19:07:09 ffff881031a27058 ffff880fc2d83fd8 000000000000fb88 ffff881031a27058 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8ed2d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:09 ffff880e8ed2d6b0 0000000000000001 0000000000000e23 ffff880700000000 2014-01-07 19:07:09 ffff880ff154e5f8 ffff880e8ed2dfd8 000000000000fb88 ffff880ff154e5f8 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:09 [] io_schedule+0x73/0xc0 2014-01-07 19:07:09 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:09 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:09 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:09 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:09 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:09 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:09 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:09 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:09 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:09 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:09 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:09 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:09 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:09 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:09 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:09 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:09 scsi host7: SRP abort called 2014-01-07 19:07:09 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:09 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:09 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:09 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8c825da0 0000000000000046 0000000000000000 ffff880e8c825d64 2014-01-07 19:07:09 ffff880700000000 ffff88083fe81800 ffff8800446b6740 0000000000000400 2014-01-07 19:07:09 ffff880ff16ca5f8 ffff880e8c825fd8 000000000000fb88 ffff880ff16ca5f8 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:09 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8c96f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:09 ffff880e8c96f6b0 0000000000000001 0000000000000df0 ffff880700000000 2014-01-07 19:07:09 ffff881033195af8 ffff880e8c96ffd8 000000000000fb88 ffff881033195af8 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:09 [] io_schedule+0x73/0xc0 2014-01-07 19:07:09 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:09 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:09 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:09 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:09 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:09 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:09 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:09 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:09 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:09 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:09 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:09 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:09 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:09 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:09 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:09 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:09 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:09 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:09 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:09 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:09 [] kthread+0x96/0xa0 2014-01-07 19:07:09 [] child_rip+0xa/0x20 2014-01-07 19:07:09 [] ? kthread+0x0/0xa0 2014-01-07 19:07:09 [] ? child_rip+0x0/0x20 2014-01-07 19:07:09 ffff880e8a7e9550 0000000000000046 0000000000000000 0000000000281826 2014-01-07 19:07:09 0000000200003232 0000000affffffff ffffffffffffffff 000000005aa5c87d 2014-01-07 19:07:09 ffff880e8dfa5af8 ffff880e8a7e9fd8 000000000000fb88 ffff880e8dfa5af8 2014-01-07 19:07:09 Call Trace: 2014-01-07 19:07:09 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:07:09 [] mutex_lock+0x2b/0x50 2014-01-07 19:07:09 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:07:09 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:09 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:09 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:09 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:09 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:09 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:09 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:09 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:09 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:09 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:09 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:09 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:09 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:09 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:09 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:09 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:09 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:09 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] kthread+0x96/0xa0 2014-01-07 19:07:10 [] child_rip+0xa/0x20 2014-01-07 19:07:10 [] ? kthread+0x0/0xa0 2014-01-07 19:07:10 [] ? child_rip+0x0/0x20 2014-01-07 19:07:10 ffff880e8cf5f360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:10 ffff880e8cf5f2e0 ffffffff8150fa5e ffff880e8e20d7c0 ffff880e8e20dad8 2014-01-07 19:07:10 ffff880e8c8efab8 ffff880e8cf5ffd8 000000000000fb88 ffff880e8c8efab8 2014-01-07 19:07:10 Call Trace: 2014-01-07 19:07:10 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:10 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:10 [] io_schedule+0x73/0xc0 2014-01-07 19:07:10 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:10 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:10 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:10 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:10 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:10 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:10 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:10 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:10 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:10 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:10 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:10 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:10 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:10 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:10 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:10 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:10 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:10 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:10 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:10 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:10 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:10 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:10 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] kthread+0x96/0xa0 2014-01-07 19:07:10 [] child_rip+0xa/0x20 2014-01-07 19:07:10 [] ? kthread+0x0/0xa0 2014-01-07 19:07:10 [] ? child_rip+0x0/0x20 2014-01-07 19:07:10 ffff880e8fabb690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:10 ffff880e8fabb6b0 ffffffff00000001 ffff880fc298c970 ffff880e00000001 2014-01-07 19:07:10 ffff880e8c8ef058 ffff880e8fabbfd8 000000000000fb88 ffff880e8c8ef058 2014-01-07 19:07:10 Call Trace: 2014-01-07 19:07:10 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:10 [] io_schedule+0x73/0xc0 2014-01-07 19:07:10 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:10 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:10 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:10 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:10 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:10 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:10 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:10 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:10 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:10 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:10 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:10 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:10 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:10 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:10 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] kthread+0x96/0xa0 2014-01-07 19:07:10 [] child_rip+0xa/0x20 2014-01-07 19:07:10 [] ? kthread+0x0/0xa0 2014-01-07 19:07:10 [] ? child_rip+0x0/0x20 2014-01-07 19:07:10 ffff880e8c053690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:10 ffff880e8c0536b0 0000000000000001 0000000000000dea ffff880700000000 2014-01-07 19:07:10 ffff880e8c8ee5f8 ffff880e8c053fd8 000000000000fb88 ffff880e8c8ee5f8 2014-01-07 19:07:10 Call Trace: 2014-01-07 19:07:10 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:10 [] io_schedule+0x73/0xc0 2014-01-07 19:07:10 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:10 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:10 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:10 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:10 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:10 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:10 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:10 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:10 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:10 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:10 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:10 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:10 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:10 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:10 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:10 scsi host6: SRP abort called 2014-01-07 19:07:10 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] kthread+0x96/0xa0 2014-01-07 19:07:10 [] child_rip+0xa/0x20 2014-01-07 19:07:10 [] ? kthread+0x0/0xa0 2014-01-07 19:07:10 [] ? child_rip+0x0/0x20 2014-01-07 19:07:10 ffff880e8df45690 0000000000000046 0000000000000000 ffff880e8df45654 2014-01-07 19:07:10 ffff880e00000000 ffff88083fe81a00 ffff88085c456740 0000000000000400 2014-01-07 19:07:10 ffff880e8ed09af8 ffff880e8df45fd8 000000000000fb88 ffff880e8ed09af8 2014-01-07 19:07:10 Call Trace: 2014-01-07 19:07:10 [] io_schedule+0x73/0xc0 2014-01-07 19:07:10 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:10 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:10 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:10 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:10 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:10 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:10 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:10 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:10 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:10 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:10 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:10 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:10 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:10 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] kthread+0x96/0xa0 2014-01-07 19:07:10 [] child_rip+0xa/0x20 2014-01-07 19:07:10 [] ? kthread+0x0/0xa0 2014-01-07 19:07:10 [] ? child_rip+0x0/0x20 2014-01-07 19:07:10 ffff880e8ce81690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:10 ffff880e8ce816b0 0000000000000001 0000000000000b54 ffff880e00000000 2014-01-07 19:07:10 ffff880e8ed09098 ffff880e8ce81fd8 000000000000fb88 ffff880e8ed09098 2014-01-07 19:07:10 Call Trace: 2014-01-07 19:07:10 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:10 [] io_schedule+0x73/0xc0 2014-01-07 19:07:10 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:10 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:10 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:10 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:10 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:10 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:10 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:10 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:10 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:10 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:10 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:10 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:10 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:10 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:10 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:10 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:10 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:10 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:10 [] kthread+0x96/0xa0 2014-01-07 19:07:10 [] child_rip+0xa/0x20 2014-01-07 19:07:10 [] ? kthread+0x0/0xa0 2014-01-07 19:07:10 [] ? child_rip+0x0/0x20 2014-01-07 19:07:10 ffff880e8c84d690 0000000000000046 ffff880e8c84d6b0 ffffffffa04e9367 2014-01-07 19:07:10 ffff880e8c84d6b0 0000000000000001 0000000000000c0d ffff880e00000000 2014-01-07 19:07:10 ffff880e8ed08638 ffff880e8c84dfd8 000000000000fb88 ffff880e8ed08638 2014-01-07 19:07:10 Call Trace: 2014-01-07 19:07:10 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:10 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:10 [] io_schedule+0x73/0xc0 2014-01-07 19:07:10 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:11 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:11 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:11 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:11 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:11 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:11 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:11 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:11 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:11 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:11 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:11 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] kthread+0x96/0xa0 2014-01-07 19:07:11 [] child_rip+0xa/0x20 2014-01-07 19:07:11 [] ? kthread+0x0/0xa0 2014-01-07 19:07:11 [] ? child_rip+0x0/0x20 2014-01-07 19:07:11 ffff880e8eda3690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:11 ffff880e8eda36b0 0000000000000001 0000000000000cf6 ffff880e00000000 2014-01-07 19:07:11 ffff881005908638 ffff880e8eda3fd8 000000000000fb88 ffff881005908638 2014-01-07 19:07:11 Call Trace: 2014-01-07 19:07:11 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:11 [] io_schedule+0x73/0xc0 2014-01-07 19:07:11 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:11 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:11 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:11 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:11 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:11 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:11 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:11 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:11 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:11 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:11 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:11 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] kthread+0x96/0xa0 2014-01-07 19:07:11 [] child_rip+0xa/0x20 2014-01-07 19:07:11 [] ? kthread+0x0/0xa0 2014-01-07 19:07:11 [] ? child_rip+0x0/0x20 2014-01-07 19:07:11 ffff880e8c88f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:11 ffff880e8c88f6b0 0000000000000001 0000000000000c98 ffff880e00000000 2014-01-07 19:07:11 ffff881005909098 ffff880e8c88ffd8 000000000000fb88 ffff881005909098 2014-01-07 19:07:11 Call Trace: 2014-01-07 19:07:11 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:11 [] io_schedule+0x73/0xc0 2014-01-07 19:07:11 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:11 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:11 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:11 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:11 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:11 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:11 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:11 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:11 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:11 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:11 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:11 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] kthread+0x96/0xa0 2014-01-07 19:07:11 [] child_rip+0xa/0x20 2014-01-07 19:07:11 [] ? kthread+0x0/0xa0 2014-01-07 19:07:11 [] ? child_rip+0x0/0x20 2014-01-07 19:07:11 ffff880e8c51bda0 0000000000000046 0000000000000000 ffff880e8c51bd64 2014-01-07 19:07:11 ffff880f00000000 ffff88083fe82c00 ffff88085c496740 0000000000000207 2014-01-07 19:07:11 ffff880e8c519ab8 ffff880e8c51bfd8 000000000000fb88 ffff880e8c519ab8 2014-01-07 19:07:11 Call Trace: 2014-01-07 19:07:11 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:11 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:11 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] kthread+0x96/0xa0 2014-01-07 19:07:11 [] child_rip+0xa/0x20 2014-01-07 19:07:11 [] ? kthread+0x0/0xa0 2014-01-07 19:07:11 [] ? child_rip+0x0/0x20 2014-01-07 19:07:11 ffff880e8cf45690 0000000000000046 ffff880e8cf456b0 ffffffffa04e9367 2014-01-07 19:07:11 ffff880e8cf456b0 0000000000000001 0000000000000ed1 ffff880e00000000 2014-01-07 19:07:11 ffff880e8dfa5098 ffff880e8cf45fd8 000000000000fb88 ffff880e8dfa5098 2014-01-07 19:07:11 Call Trace: 2014-01-07 19:07:11 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:11 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:11 [] io_schedule+0x73/0xc0 2014-01-07 19:07:11 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:11 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:11 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:11 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:11 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:11 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:11 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:11 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:11 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:11 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:11 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:11 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] kthread+0x96/0xa0 2014-01-07 19:07:11 [] child_rip+0xa/0x20 2014-01-07 19:07:11 [] ? kthread+0x0/0xa0 2014-01-07 19:07:11 [] ? child_rip+0x0/0x20 2014-01-07 19:07:11 ffff880e8a02d690 0000000000000046 ffff880e8a02d6b0 ffffffffa04e9367 2014-01-07 19:07:11 ffff880e8a02d6b0 0000000000000001 0000000000000dca ffff880e00000000 2014-01-07 19:07:11 ffff880e8dee3af8 ffff880e8a02dfd8 000000000000fb88 ffff880e8dee3af8 2014-01-07 19:07:11 Call Trace: 2014-01-07 19:07:11 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:11 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:11 [] io_schedule+0x73/0xc0 2014-01-07 19:07:11 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:11 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:11 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:11 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:11 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:11 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:11 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:11 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:11 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:11 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:11 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:11 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:11 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:11 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:11 [] kthread+0x96/0xa0 2014-01-07 19:07:11 [] child_rip+0xa/0x20 2014-01-07 19:07:11 [] ? kthread+0x0/0xa0 2014-01-07 19:07:11 [] ? child_rip+0x0/0x20 2014-01-07 19:07:11 ffff88102e857690 0000000000000046 ffff88102e8576b0 ffffffffa04e9367 2014-01-07 19:07:11 ffff88102e8576b0 0000000000000001 0000000000000bb6 ffff880e00000000 2014-01-07 19:07:11 ffff880e8dee3098 ffff88102e857fd8 000000000000fb88 ffff880e8dee3098 2014-01-07 19:07:11 Call Trace: 2014-01-07 19:07:11 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:11 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:11 [] io_schedule+0x73/0xc0 2014-01-07 19:07:11 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:11 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:11 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:11 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:11 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:11 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:12 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:12 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:12 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:12 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:12 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:12 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:12 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:12 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:12 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:12 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] kthread+0x96/0xa0 2014-01-07 19:07:12 [] child_rip+0xa/0x20 2014-01-07 19:07:12 [] ? kthread+0x0/0xa0 2014-01-07 19:07:12 [] ? child_rip+0x0/0x20 2014-01-07 19:07:12 ffff880e8df3f690 0000000000000046 ffff880e8df3f6b0 ffffffffa04e9367 2014-01-07 19:07:12 ffff880e8df3f6b0 0000000000000001 0000000000000b19 ffff880e00000000 2014-01-07 19:07:12 ffff880e8dee2638 ffff880e8df3ffd8 000000000000fb88 ffff880e8dee2638 2014-01-07 19:07:12 Call Trace: 2014-01-07 19:07:12 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:12 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:12 [] io_schedule+0x73/0xc0 2014-01-07 19:07:12 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:12 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:12 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:12 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:12 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:12 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:12 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:12 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:12 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:12 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:12 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:12 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:12 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:12 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:12 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] kthread+0x96/0xa0 2014-01-07 19:07:12 [] child_rip+0xa/0x20 2014-01-07 19:07:12 [] ? kthread+0x0/0xa0 2014-01-07 19:07:12 [] ? child_rip+0x0/0x20 2014-01-07 19:07:12 ffff880e8d4bf690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:12 ffff880e8d4bf6b0 0000000000000001 0000000000000ea6 ffff880700000000 2014-01-07 19:07:12 ffff880e8d4bdab8 ffff880e8d4bffd8 000000000000fb88 ffff880e8d4bdab8 2014-01-07 19:07:12 Call Trace: 2014-01-07 19:07:12 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:12 [] io_schedule+0x73/0xc0 2014-01-07 19:07:12 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:12 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:12 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:12 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:12 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:12 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:12 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:12 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:12 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:12 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:12 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:12 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:12 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:12 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:12 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] kthread+0x96/0xa0 2014-01-07 19:07:12 [] child_rip+0xa/0x20 2014-01-07 19:07:12 [] ? kthread+0x0/0xa0 2014-01-07 19:07:12 [] ? child_rip+0x0/0x20 2014-01-07 19:07:12 ffff880e8cea3690 0000000000000046 ffff880e8cea36b0 ffffffffa04e97d6 2014-01-07 19:07:12 ffff880e8cea36b0 ffffffff00000001 ffff8801834c7040 ffff880e00000001 2014-01-07 19:07:12 ffff880e8d4bd058 ffff880e8cea3fd8 000000000000fb88 ffff880e8d4bd058 2014-01-07 19:07:12 Call Trace: 2014-01-07 19:07:12 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:12 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:12 [] io_schedule+0x73/0xc0 2014-01-07 19:07:12 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:12 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:12 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:12 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:12 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:12 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:12 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:12 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:12 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:12 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:12 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:12 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:12 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:12 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:12 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] kthread+0x96/0xa0 2014-01-07 19:07:12 [] child_rip+0xa/0x20 2014-01-07 19:07:12 [] ? kthread+0x0/0xa0 2014-01-07 19:07:12 [] ? child_rip+0x0/0x20 2014-01-07 19:07:12 ffff880e8ded1360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:12 ffff880e8ded12e0 ffffffff8150fa5e ffff880e8192c640 ffff880e8192c958 2014-01-07 19:07:12 ffff880e8d4bc5f8 ffff880e8ded1fd8 000000000000fb88 ffff880e8d4bc5f8 2014-01-07 19:07:12 Call Trace: 2014-01-07 19:07:12 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:12 [] io_schedule+0x73/0xc0 2014-01-07 19:07:12 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:12 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:12 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:12 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:12 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:12 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:12 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:12 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:12 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:12 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:12 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:12 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:12 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:12 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:12 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:12 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:12 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:12 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:12 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:12 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:12 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:12 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:12 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:12 [] kthread+0x96/0xa0 2014-01-07 19:07:12 [] child_rip+0xa/0x20 2014-01-07 19:07:12 [] ? kthread+0x0/0xa0 2014-01-07 19:07:12 [] ? child_rip+0x0/0x20 2014-01-07 19:07:12 ffff880e8edc9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:12 ffff880e8edc96b0 0000000000000001 0000000000000cf1 ffff880e00000000 2014-01-07 19:07:12 ffff880e8ded3af8 ffff880e8edc9fd8 000000000000fb88 ffff880e8ded3af8 2014-01-07 19:07:12 Call Trace: 2014-01-07 19:07:12 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:12 [] io_schedule+0x73/0xc0 2014-01-07 19:07:12 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:12 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:12 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:12 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:12 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:12 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:12 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:12 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:12 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:12 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:12 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:12 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:12 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:13 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:13 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:13 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:13 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:13 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] kthread+0x96/0xa0 2014-01-07 19:07:13 [] child_rip+0xa/0x20 2014-01-07 19:07:13 [] ? kthread+0x0/0xa0 2014-01-07 19:07:13 [] ? child_rip+0x0/0x20 2014-01-07 19:07:13 ffff880e8d5d1690 0000000000000046 ffff880e8d5d16b0 ffffffffa04e9367 2014-01-07 19:07:13 ffff880e8d5d16b0 0000000000000001 0000000000000be8 ffff880e00000000 2014-01-07 19:07:13 ffff880e8ded3098 ffff880e8d5d1fd8 000000000000fb88 ffff880e8ded3098 2014-01-07 19:07:13 Call Trace: 2014-01-07 19:07:13 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:13 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:13 [] io_schedule+0x73/0xc0 2014-01-07 19:07:13 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:13 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:13 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:13 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:13 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:13 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:13 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:13 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:13 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:13 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:13 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:13 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:13 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:13 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:13 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] kthread+0x96/0xa0 2014-01-07 19:07:13 [] child_rip+0xa/0x20 2014-01-07 19:07:13 [] ? kthread+0x0/0xa0 2014-01-07 19:07:13 [] ? child_rip+0x0/0x20 2014-01-07 19:07:13 ffff880e8ed5b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:13 ffff880e8ed5b6b0 0000000000000001 0000000000000de1 ffff880700000000 2014-01-07 19:07:13 ffff880e8ded2638 ffff880e8ed5bfd8 000000000000fb88 ffff880e8ded2638 2014-01-07 19:07:13 Call Trace: 2014-01-07 19:07:13 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:13 [] io_schedule+0x73/0xc0 2014-01-07 19:07:13 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:13 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:13 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:13 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:13 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:13 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:13 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:13 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:13 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:13 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:13 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:13 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:13 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:13 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:13 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] kthread+0x96/0xa0 2014-01-07 19:07:13 [] child_rip+0xa/0x20 2014-01-07 19:07:13 [] ? kthread+0x0/0xa0 2014-01-07 19:07:13 [] ? child_rip+0x0/0x20 2014-01-07 19:07:13 ffff880e8c921690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:13 ffff880e8c9216b0 0000000000000001 0000000000000c87 ffff880e00000000 2014-01-07 19:07:13 ffff880e8c8e7ab8 ffff880e8c921fd8 000000000000fb88 ffff880e8c8e7ab8 2014-01-07 19:07:13 Call Trace: 2014-01-07 19:07:13 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:13 [] io_schedule+0x73/0xc0 2014-01-07 19:07:13 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:13 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:13 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:13 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:13 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:13 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:13 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:13 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:13 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:13 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:13 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:13 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:13 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:13 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:13 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] kthread+0x96/0xa0 2014-01-07 19:07:13 [] child_rip+0xa/0x20 2014-01-07 19:07:13 [] ? kthread+0x0/0xa0 2014-01-07 19:07:13 [] ? child_rip+0x0/0x20 2014-01-07 19:07:13 ffff880e8ce99690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:13 ffff880e8ce996b0 0000000000000001 0000000000000dfc ffff880e00000000 2014-01-07 19:07:13 ffff880e8c8e7058 ffff880e8ce99fd8 000000000000fb88 ffff880e8c8e7058 2014-01-07 19:07:13 Call Trace: 2014-01-07 19:07:13 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:13 [] io_schedule+0x73/0xc0 2014-01-07 19:07:13 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:13 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:13 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:13 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:13 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:13 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:13 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:13 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:13 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:13 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:13 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:13 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:13 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:13 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:13 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] kthread+0x96/0xa0 2014-01-07 19:07:13 [] child_rip+0xa/0x20 2014-01-07 19:07:13 [] ? kthread+0x0/0xa0 2014-01-07 19:07:13 [] ? child_rip+0x0/0x20 2014-01-07 19:07:13 ffff880e874e3360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:13 ffff880e874e32e0 ffffffff8150fa5e ffff880e8395c1e0 ffff880e8395c4f8 2014-01-07 19:07:13 ffff880e8c8e65f8 ffff880e874e3fd8 000000000000fb88 ffff880e8c8e65f8 2014-01-07 19:07:13 Call Trace: 2014-01-07 19:07:13 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:13 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:13 [] io_schedule+0x73/0xc0 2014-01-07 19:07:13 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:13 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:13 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:13 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:13 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:13 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:13 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:13 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:13 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:13 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:13 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:13 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:13 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:13 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:13 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:13 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:13 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:13 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:13 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:13 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:13 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:13 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:13 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:13 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:13 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:13 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:13 [] kthread+0x96/0xa0 2014-01-07 19:07:13 [] child_rip+0xa/0x20 2014-01-07 19:07:13 [] ? kthread+0x0/0xa0 2014-01-07 19:07:13 [] ? child_rip+0x0/0x20 2014-01-07 19:07:14 ffff880e874e7690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:14 ffff880e874e76b0 0000000000000001 0000000000000bfa ffff880e00000000 2014-01-07 19:07:14 ffff880e874e5af8 ffff880e874e7fd8 000000000000fb88 ffff880e874e5af8 2014-01-07 19:07:14 Call Trace: 2014-01-07 19:07:14 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:14 [] io_schedule+0x73/0xc0 2014-01-07 19:07:14 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:14 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:14 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:14 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:14 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:14 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:14 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:14 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:14 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:14 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:14 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:14 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:14 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:14 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:14 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] kthread+0x96/0xa0 2014-01-07 19:07:14 [] child_rip+0xa/0x20 2014-01-07 19:07:14 [] ? kthread+0x0/0xa0 2014-01-07 19:07:14 [] ? child_rip+0x0/0x20 2014-01-07 19:07:14 ffff880e874eb360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:14 ffff880e874eb2e0 ffffffff8150fa5e ffff880e90ae1620 ffff880e90ae1938 2014-01-07 19:07:14 ffff880e8dfa4638 ffff880e874ebfd8 000000000000fb88 ffff880e8dfa4638 2014-01-07 19:07:14 Call Trace: 2014-01-07 19:07:14 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:14 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:14 [] io_schedule+0x73/0xc0 2014-01-07 19:07:14 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:14 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:14 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:14 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:14 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:14 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:14 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:14 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:14 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:14 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:14 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:14 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:14 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:14 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:14 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:14 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:14 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:14 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:14 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:14 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:14 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:14 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] kthread+0x96/0xa0 2014-01-07 19:07:14 [] child_rip+0xa/0x20 2014-01-07 19:07:14 [] ? kthread+0x0/0xa0 2014-01-07 19:07:14 [] ? child_rip+0x0/0x20 2014-01-07 19:07:14 ffff880e874ef690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:14 ffff880e874ef6b0 0000000000000001 ffff880f997d86d0 ffff880e00000000 2014-01-07 19:07:14 ffff880e874edab8 ffff880e874effd8 000000000000fb88 ffff880e874edab8 2014-01-07 19:07:14 Call Trace: 2014-01-07 19:07:14 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:14 [] io_schedule+0x73/0xc0 2014-01-07 19:07:14 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:14 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:14 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:14 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:14 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:14 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:14 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:14 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:14 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:14 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:14 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:14 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:14 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:14 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:14 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] kthread+0x96/0xa0 2014-01-07 19:07:14 [] child_rip+0xa/0x20 2014-01-07 19:07:14 [] ? kthread+0x0/0xa0 2014-01-07 19:07:14 [] ? child_rip+0x0/0x20 2014-01-07 19:07:14 ffff880e874f5690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:14 ffff880e874f56b0 0000000000000001 0000000000000c7d ffff880e00000000 2014-01-07 19:07:14 ffff880e874f3af8 ffff880e874f5fd8 000000000000fb88 ffff880e874f3af8 2014-01-07 19:07:14 Call Trace: 2014-01-07 19:07:14 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:14 [] io_schedule+0x73/0xc0 2014-01-07 19:07:14 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:14 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:14 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:14 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:14 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:14 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:14 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:14 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:14 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:14 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:14 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:14 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:14 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:14 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:14 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] kthread+0x96/0xa0 2014-01-07 19:07:14 [] child_rip+0xa/0x20 2014-01-07 19:07:14 [] ? kthread+0x0/0xa0 2014-01-07 19:07:14 [] ? child_rip+0x0/0x20 2014-01-07 19:07:14 ffff880e874fb690 0000000000000046 ffff880e874fb6b0 ffffffffa04e9367 2014-01-07 19:07:14 ffff880e874fb6b0 0000000000000001 0000000000000dda ffff880700000000 2014-01-07 19:07:14 ffff880e8c519058 ffff880e874fbfd8 000000000000fb88 ffff880e8c519058 2014-01-07 19:07:14 Call Trace: 2014-01-07 19:07:14 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:14 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:14 [] io_schedule+0x73/0xc0 2014-01-07 19:07:14 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:14 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:14 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:14 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:14 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:14 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:14 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:14 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:14 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:14 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:14 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:14 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:14 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:14 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:14 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:14 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:14 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:14 [] kthread+0x96/0xa0 2014-01-07 19:07:14 [] child_rip+0xa/0x20 2014-01-07 19:07:14 [] ? kthread+0x0/0xa0 2014-01-07 19:07:14 [] ? child_rip+0x0/0x20 2014-01-07 19:07:14 ffff880e876a1690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:14 ffff880e876a16b0 0000000000000001 0000000000000d5e ffff880e00000000 2014-01-07 19:07:14 ffff880e8c5185f8 ffff880e876a1fd8 000000000000fb88 ffff880e8c5185f8 2014-01-07 19:07:14 Call Trace: 2014-01-07 19:07:14 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:14 [] io_schedule+0x73/0xc0 2014-01-07 19:07:14 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:14 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:14 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:14 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:14 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:15 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:15 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:15 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:15 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:15 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:15 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:15 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:15 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:15 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:15 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:15 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] kthread+0x96/0xa0 2014-01-07 19:07:15 [] child_rip+0xa/0x20 2014-01-07 19:07:15 [] ? kthread+0x0/0xa0 2014-01-07 19:07:15 [] ? child_rip+0x0/0x20 2014-01-07 19:07:15 ffff880e876a5690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:15 ffff880e876a56b0 0000000000000001 0000000000000bfa ffff880e00000000 2014-01-07 19:07:15 ffff880e876a3ab8 ffff880e876a5fd8 000000000000fb88 ffff880e876a3ab8 2014-01-07 19:07:15 Call Trace: 2014-01-07 19:07:15 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:15 [] io_schedule+0x73/0xc0 2014-01-07 19:07:15 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:15 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:15 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:15 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:15 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:15 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:15 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:15 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:15 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:15 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:15 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:15 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:15 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:15 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:15 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] kthread+0x96/0xa0 2014-01-07 19:07:15 [] child_rip+0xa/0x20 2014-01-07 19:07:15 [] ? kthread+0x0/0xa0 2014-01-07 19:07:15 [] ? child_rip+0x0/0x20 2014-01-07 19:07:15 ffff880e876ad690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:15 ffff880e876ad6b0 0000000000000001 0000000000000d10 ffff880700000000 2014-01-07 19:07:15 ffff880e876a3058 ffff880e876adfd8 000000000000fb88 ffff880e876a3058 2014-01-07 19:07:15 Call Trace: 2014-01-07 19:07:15 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:15 [] io_schedule+0x73/0xc0 2014-01-07 19:07:15 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:15 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:15 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:15 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:15 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:15 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:15 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:15 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:15 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:15 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:15 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:15 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:15 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:15 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:15 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] kthread+0x96/0xa0 2014-01-07 19:07:15 [] child_rip+0xa/0x20 2014-01-07 19:07:15 [] ? kthread+0x0/0xa0 2014-01-07 19:07:15 [] ? child_rip+0x0/0x20 2014-01-07 19:07:15 ffff880e876b3690 0000000000000046 ffff880e876b36b0 ffffffffa04e9367 2014-01-07 19:07:15 ffff880e876b36b0 0000000000000001 0000000000000b88 ffff880e00000000 2014-01-07 19:07:15 ffff880e876a25f8 ffff880e876b3fd8 000000000000fb88 ffff880e876a25f8 2014-01-07 19:07:15 Call Trace: 2014-01-07 19:07:15 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:15 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:15 [] io_schedule+0x73/0xc0 2014-01-07 19:07:15 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:15 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:15 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:15 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:15 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:15 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:15 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:15 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:15 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:15 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:15 scsi host6: SRP abort called 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:15 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:15 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:15 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:15 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:15 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] kthread+0x96/0xa0 2014-01-07 19:07:15 [] child_rip+0xa/0x20 2014-01-07 19:07:15 [] ? kthread+0x0/0xa0 2014-01-07 19:07:15 [] ? child_rip+0x0/0x20 2014-01-07 19:07:15 ffff880e876bb690 0000000000000046 ffff880e876bb6b0 ffffffffa04e9367 2014-01-07 19:07:15 ffff880e876bb6b0 0000000000000001 0000000000000c1e ffff880e00000000 2014-01-07 19:07:15 ffff880e876b9af8 ffff880e876bbfd8 000000000000fb88 ffff880e876b9af8 2014-01-07 19:07:15 Call Trace: 2014-01-07 19:07:15 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:15 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:15 [] io_schedule+0x73/0xc0 2014-01-07 19:07:15 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:15 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:15 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:15 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:15 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:15 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:15 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:15 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:15 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:15 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:15 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:15 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:15 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:15 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] kthread+0x96/0xa0 2014-01-07 19:07:15 [] child_rip+0xa/0x20 2014-01-07 19:07:15 [] ? kthread+0x0/0xa0 2014-01-07 19:07:15 [] ? child_rip+0x0/0x20 2014-01-07 19:07:15 ffff880e876bd690 0000000000000046 ffff880e876bd658 ffff880e876bd654 2014-01-07 19:07:15 ffff880e876bd6b0 ffff88083fe82200 ffff88085c416740 0000000000000400 2014-01-07 19:07:15 ffff880e876b9098 ffff880e876bdfd8 000000000000fb88 ffff880e876b9098 2014-01-07 19:07:15 Call Trace: 2014-01-07 19:07:15 [] io_schedule+0x73/0xc0 2014-01-07 19:07:15 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:15 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:15 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:15 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:15 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:15 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:15 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:15 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:15 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:15 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:15 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:15 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:15 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:15 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:15 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:15 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:15 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:15 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:15 [] kthread+0x96/0xa0 2014-01-07 19:07:15 [] child_rip+0xa/0x20 2014-01-07 19:07:16 [] ? kthread+0x0/0xa0 2014-01-07 19:07:16 [] ? child_rip+0x0/0x20 2014-01-07 19:07:16 ffff880e876e5690 0000000000000046 ffff880e876e56b0 ffffffffa04e9367 2014-01-07 19:07:16 ffff880e876e56b0 0000000000000001 0000000000000d21 ffff880e00000000 2014-01-07 19:07:16 ffff880e876b8638 ffff880e876e5fd8 000000000000fb88 ffff880e876b8638 2014-01-07 19:07:16 Call Trace: 2014-01-07 19:07:16 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:16 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:16 [] io_schedule+0x73/0xc0 2014-01-07 19:07:16 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:16 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:16 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:16 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:16 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] kthread+0x96/0xa0 2014-01-07 19:07:16 [] child_rip+0xa/0x20 2014-01-07 19:07:16 [] ? kthread+0x0/0xa0 2014-01-07 19:07:16 [] ? child_rip+0x0/0x20 2014-01-07 19:07:16 ffff880e876ed690 0000000000000046 ffff880e876ed6b0 ffffffffa04e9367 2014-01-07 19:07:16 ffff880e876ed6b0 0000000000000001 0000000000000db0 ffff880e00000000 2014-01-07 19:07:16 ffff880e876e7ab8 ffff880e876edfd8 000000000000fb88 ffff880e876e7ab8 2014-01-07 19:07:16 Call Trace: 2014-01-07 19:07:16 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:16 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:16 [] io_schedule+0x73/0xc0 2014-01-07 19:07:16 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:16 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:16 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:16 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:16 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] kthread+0x96/0xa0 2014-01-07 19:07:16 [] child_rip+0xa/0x20 2014-01-07 19:07:16 [] ? kthread+0x0/0xa0 2014-01-07 19:07:16 [] ? child_rip+0x0/0x20 2014-01-07 19:07:16 ffff880e86acf690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:16 ffff880e86acf6b0 0000000000000001 0000000000000e61 ffff880e00000000 2014-01-07 19:07:16 ffff880e876e7058 ffff880e86acffd8 000000000000fb88 ffff880e876e7058 2014-01-07 19:07:16 Call Trace: 2014-01-07 19:07:16 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:16 [] io_schedule+0x73/0xc0 2014-01-07 19:07:16 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:16 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:16 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:16 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:16 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] kthread+0x96/0xa0 2014-01-07 19:07:16 [] child_rip+0xa/0x20 2014-01-07 19:07:16 [] ? kthread+0x0/0xa0 2014-01-07 19:07:16 [] ? child_rip+0x0/0x20 2014-01-07 19:07:16 ffff880e86aef690 0000000000000046 ffff880e86aef6b0 ffffffffa04e9367 2014-01-07 19:07:16 ffff880e86aef6b0 0000000000000001 0000000000000b41 ffff880e00000000 2014-01-07 19:07:16 ffff880e874e5098 ffff880e86aeffd8 000000000000fb88 ffff880e874e5098 2014-01-07 19:07:16 Call Trace: 2014-01-07 19:07:16 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:16 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:16 [] io_schedule+0x73/0xc0 2014-01-07 19:07:16 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:16 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:16 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:16 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:16 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] kthread+0x96/0xa0 2014-01-07 19:07:16 [] child_rip+0xa/0x20 2014-01-07 19:07:16 [] ? kthread+0x0/0xa0 2014-01-07 19:07:16 [] ? child_rip+0x0/0x20 2014-01-07 19:07:16 ffff880e86b05690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:16 ffff880e86b056b0 0000000000000001 0000000000000d06 ffff880e00000000 2014-01-07 19:07:16 ffff880e876e65f8 ffff880e86b05fd8 000000000000fb88 ffff880e876e65f8 2014-01-07 19:07:16 Call Trace: 2014-01-07 19:07:16 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:16 [] io_schedule+0x73/0xc0 2014-01-07 19:07:16 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:16 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:16 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:16 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:16 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:16 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:16 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:16 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:16 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:16 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:16 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:16 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:16 [] kthread+0x96/0xa0 2014-01-07 19:07:16 [] child_rip+0xa/0x20 2014-01-07 19:07:16 [] ? kthread+0x0/0xa0 2014-01-07 19:07:16 [] ? child_rip+0x0/0x20 2014-01-07 19:07:16 ffff880e87483550 0000000000000046 ffff880effffffff 0000000000281826 2014-01-07 19:07:16 0000000200003232 0000000affffffff ffffffffffffffff 00000000b9f9098d 2014-01-07 19:07:16 ffff881033195098 ffff880e87483fd8 000000000000fb88 ffff881033195098 2014-01-07 19:07:16 Call Trace: 2014-01-07 19:07:16 [] ? vsnprintf+0x336/0x5e0 2014-01-07 19:07:16 [] __mutex_lock_slowpath+0x13e/0x180 2014-01-07 19:07:16 [] mutex_lock+0x2b/0x50 2014-01-07 19:07:16 [] dmu_zfetch+0x40b/0xd70 [zfs] 2014-01-07 19:07:16 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:16 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:16 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:16 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:16 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:16 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:16 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:16 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] kthread+0x96/0xa0 2014-01-07 19:07:17 [] child_rip+0xa/0x20 2014-01-07 19:07:17 [] ? kthread+0x0/0xa0 2014-01-07 19:07:17 [] ? child_rip+0x0/0x20 2014-01-07 19:07:17 ffff880e87669690 0000000000000046 ffff880e876696b0 ffffffffa04e9367 2014-01-07 19:07:17 ffff880e876696b0 0000000000000001 0000000000000d9b ffff880e00000000 2014-01-07 19:07:17 ffff880e874f3098 ffff880e87669fd8 000000000000fb88 ffff880e874f3098 2014-01-07 19:07:17 Call Trace: 2014-01-07 19:07:17 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:17 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:17 [] io_schedule+0x73/0xc0 2014-01-07 19:07:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] kthread+0x96/0xa0 2014-01-07 19:07:17 [] child_rip+0xa/0x20 2014-01-07 19:07:17 [] ? kthread+0x0/0xa0 2014-01-07 19:07:17 [] ? child_rip+0x0/0x20 2014-01-07 19:07:17 ffff880e87645690 0000000000000046 ffff880e876456b0 ffffffffa04e97d6 2014-01-07 19:07:17 ffff880e876456b0 ffffffff00000001 ffff8805f2f82ba0 ffff880e00000001 2014-01-07 19:07:17 ffff880e874f2638 ffff880e87645fd8 000000000000fb88 ffff880e874f2638 2014-01-07 19:07:17 Call Trace: 2014-01-07 19:07:17 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:17 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:17 [] io_schedule+0x73/0xc0 2014-01-07 19:07:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] kthread+0x96/0xa0 2014-01-07 19:07:17 [] child_rip+0xa/0x20 2014-01-07 19:07:17 [] ? kthread+0x0/0xa0 2014-01-07 19:07:17 [] ? child_rip+0x0/0x20 2014-01-07 19:07:17 ffff880e87e09690 0000000000000046 ffff880e87e09658 ffff880e87e09654 2014-01-07 19:07:17 ffff880e87e096b0 ffff88083fe82000 ffff88085c476740 0000000000000400 2014-01-07 19:07:17 ffff880e870d7af8 ffff880e87e09fd8 000000000000fb88 ffff880e870d7af8 2014-01-07 19:07:17 Call Trace: 2014-01-07 19:07:17 [] io_schedule+0x73/0xc0 2014-01-07 19:07:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] kthread+0x96/0xa0 2014-01-07 19:07:17 [] child_rip+0xa/0x20 2014-01-07 19:07:17 [] ? kthread+0x0/0xa0 2014-01-07 19:07:17 [] ? child_rip+0x0/0x20 2014-01-07 19:07:17 ffff880e870f3690 0000000000000046 ffff880e870f36b0 ffffffffa04e9367 2014-01-07 19:07:17 ffff880e870f36b0 0000000000000001 0000000000000bad ffff880e00000000 2014-01-07 19:07:17 ffff880e870d7098 ffff880e870f3fd8 000000000000fb88 ffff880e870d7098 2014-01-07 19:07:17 Call Trace: 2014-01-07 19:07:17 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:17 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:17 [] io_schedule+0x73/0xc0 2014-01-07 19:07:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] kthread+0x96/0xa0 2014-01-07 19:07:17 [] child_rip+0xa/0x20 2014-01-07 19:07:17 [] ? kthread+0x0/0xa0 2014-01-07 19:07:17 [] ? child_rip+0x0/0x20 2014-01-07 19:07:17 ffff880e870f9690 0000000000000046 ffff880e870f96b0 ffffffffa04e9367 2014-01-07 19:07:17 ffff880e870f96b0 0000000000000001 0000000000000ce5 ffff880e00000000 2014-01-07 19:07:17 ffff880e870d6638 ffff880e870f9fd8 000000000000fb88 ffff880e870d6638 2014-01-07 19:07:17 Call Trace: 2014-01-07 19:07:17 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:17 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:17 [] io_schedule+0x73/0xc0 2014-01-07 19:07:17 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:17 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:17 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:17 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:17 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:17 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:17 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:17 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:17 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:17 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:17 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:17 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:17 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:17 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:17 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:17 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:17 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:17 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:17 [] kthread+0x96/0xa0 2014-01-07 19:07:17 [] child_rip+0xa/0x20 2014-01-07 19:07:17 [] ? kthread+0x0/0xa0 2014-01-07 19:07:17 [] ? child_rip+0x0/0x20 2014-01-07 19:07:17 ffff880e870fd690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:18 ffff880e870fd6b0 0000000000000001 0000000000000d90 ffff880e00000000 2014-01-07 19:07:18 ffff880e874ec5f8 ffff880e870fdfd8 000000000000fb88 ffff880e874ec5f8 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:18 [] io_schedule+0x73/0xc0 2014-01-07 19:07:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] kthread+0x96/0xa0 2014-01-07 19:07:18 [] child_rip+0xa/0x20 2014-01-07 19:07:18 [] ? kthread+0x0/0xa0 2014-01-07 19:07:18 [] ? child_rip+0x0/0x20 2014-01-07 19:07:18 ffff880e87015360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:18 ffff880e870152e0 ffffffff8150fa5e ffff880e7af204a0 ffff880e7af207b8 2014-01-07 19:07:18 ffff880e870ffab8 ffff880e87015fd8 000000000000fb88 ffff880e870ffab8 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:18 [] io_schedule+0x73/0xc0 2014-01-07 19:07:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:18 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:18 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:18 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:18 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:18 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:18 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:18 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:18 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] kthread+0x96/0xa0 2014-01-07 19:07:18 [] child_rip+0xa/0x20 2014-01-07 19:07:18 [] ? kthread+0x0/0xa0 2014-01-07 19:07:18 [] ? child_rip+0x0/0x20 2014-01-07 19:07:18 ffff880e8decb690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:18 ffff880e8decb6b0 0000000000000001 0000000000000dc8 ffff880e00000000 2014-01-07 19:07:18 ffff880e870ff058 ffff880e8decbfd8 000000000000fb88 ffff880e870ff058 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:18 [] io_schedule+0x73/0xc0 2014-01-07 19:07:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] kthread+0x96/0xa0 2014-01-07 19:07:18 [] child_rip+0xa/0x20 2014-01-07 19:07:18 [] ? kthread+0x0/0xa0 2014-01-07 19:07:18 [] ? child_rip+0x0/0x20 2014-01-07 19:07:18 ffff880e87033da0 0000000000000046 0000000000000075 ffff880e86d98800 2014-01-07 19:07:18 ffff880ff541e000 0000000000000000 0000000000000029 ffff8810343b6680 2014-01-07 19:07:18 ffff880e86db4638 ffff880e87033fd8 000000000000fb88 ffff880e86db4638 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:07:18 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:18 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:18 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:18 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] kthread+0x96/0xa0 2014-01-07 19:07:18 [] child_rip+0xa/0x20 2014-01-07 19:07:18 [] ? kthread+0x0/0xa0 2014-01-07 19:07:18 [] ? child_rip+0x0/0x20 2014-01-07 19:07:18 ffff880e85be9da0 0000000000000046 0000000000000000 ffff880e85be9d64 2014-01-07 19:07:18 ffff880ff54aac00 ffff88083fe82800 ffff88085c4d6740 0000000000000484 2014-01-07 19:07:18 ffff880e86d49ab8 ffff880e85be9fd8 000000000000fb88 ffff880e86d49ab8 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:18 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:18 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] kthread+0x96/0xa0 2014-01-07 19:07:18 [] child_rip+0xa/0x20 2014-01-07 19:07:18 [] ? kthread+0x0/0xa0 2014-01-07 19:07:18 [] ? child_rip+0x0/0x20 2014-01-07 19:07:18 ffff880e84609690 0000000000000046 ffff880e846096b0 ffffffffa04e9367 2014-01-07 19:07:18 ffff880e846096b0 0000000000000001 0000000000000b40 ffff880e00000000 2014-01-07 19:07:18 ffff880e86d49058 ffff880e84609fd8 000000000000fb88 ffff880e86d49058 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:18 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:18 [] io_schedule+0x73/0xc0 2014-01-07 19:07:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:18 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:18 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:18 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:18 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:18 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:18 [] kthread+0x96/0xa0 2014-01-07 19:07:18 [] child_rip+0xa/0x20 2014-01-07 19:07:18 [] ? kthread+0x0/0xa0 2014-01-07 19:07:18 [] ? child_rip+0x0/0x20 2014-01-07 19:07:18 ffff880e8460b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:18 ffff880e8460b6b0 0000000000000001 0000000000000dff ffff880e00000000 2014-01-07 19:07:18 ffff880e86d485f8 ffff880e8460bfd8 000000000000fb88 ffff880e86d485f8 2014-01-07 19:07:18 Call Trace: 2014-01-07 19:07:18 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:18 [] io_schedule+0x73/0xc0 2014-01-07 19:07:18 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:18 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:18 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:18 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:18 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:18 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:18 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:18 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:18 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:18 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:18 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:18 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:18 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:19 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:19 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:19 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:19 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:19 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] kthread+0x96/0xa0 2014-01-07 19:07:19 [] child_rip+0xa/0x20 2014-01-07 19:07:19 [] ? kthread+0x0/0xa0 2014-01-07 19:07:19 [] ? child_rip+0x0/0x20 2014-01-07 19:07:19 ffff880e84621da0 0000000000000046 0000000000000000 ffff880e84621d64 2014-01-07 19:07:19 ffff880700000000 ffff88083fe81600 ffff88085c436740 0000000000000400 2014-01-07 19:07:19 ffff880e86db5098 ffff880e84621fd8 000000000000fb88 ffff880e86db5098 2014-01-07 19:07:19 Call Trace: 2014-01-07 19:07:19 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:19 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:19 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] kthread+0x96/0xa0 2014-01-07 19:07:19 [] child_rip+0xa/0x20 2014-01-07 19:07:19 [] ? kthread+0x0/0xa0 2014-01-07 19:07:19 [] ? child_rip+0x0/0x20 2014-01-07 19:07:19 ffff880e85807690 0000000000000046 ffff880e85807658 ffff880e85807654 2014-01-07 19:07:19 ffff880e858076b0 ffff88083fe82400 ffff88085c416740 0000000000000400 2014-01-07 19:07:19 ffff880e86db5af8 ffff880e85807fd8 000000000000fb88 ffff880e86db5af8 2014-01-07 19:07:19 Call Trace: 2014-01-07 19:07:19 [] io_schedule+0x73/0xc0 2014-01-07 19:07:19 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:19 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:19 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:19 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:19 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:19 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:19 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:19 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:19 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:19 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:19 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:19 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:19 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:19 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:19 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] kthread+0x96/0xa0 2014-01-07 19:07:19 [] child_rip+0xa/0x20 2014-01-07 19:07:19 [] ? kthread+0x0/0xa0 2014-01-07 19:07:19 [] ? child_rip+0x0/0x20 2014-01-07 19:07:19 ffff880e844d7690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:19 ffff880e844d76b0 0000000000000001 0000000000000e10 ffff880700000000 2014-01-07 19:07:19 ffff880e844d5af8 ffff880e844d7fd8 000000000000fb88 ffff880e844d5af8 2014-01-07 19:07:19 Call Trace: 2014-01-07 19:07:19 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:19 [] io_schedule+0x73/0xc0 2014-01-07 19:07:19 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:19 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:19 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:19 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:19 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:19 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:19 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:19 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:19 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:19 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:19 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:19 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:19 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:19 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:19 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] kthread+0x96/0xa0 2014-01-07 19:07:19 [] child_rip+0xa/0x20 2014-01-07 19:07:19 [] ? kthread+0x0/0xa0 2014-01-07 19:07:19 [] ? child_rip+0x0/0x20 2014-01-07 19:07:19 ffff880e87611690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:19 ffff880e876116b0 ffffffff00000001 ffff88059463fc80 ffff880e00000001 2014-01-07 19:07:19 ffff880e84651ab8 ffff880e87611fd8 000000000000fb88 ffff880e84651ab8 2014-01-07 19:07:19 Call Trace: 2014-01-07 19:07:19 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:19 [] io_schedule+0x73/0xc0 2014-01-07 19:07:19 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:19 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:19 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:19 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:19 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:19 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:19 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:19 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:19 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:19 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:19 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:19 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:19 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:19 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:19 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] kthread+0x96/0xa0 2014-01-07 19:07:19 [] child_rip+0xa/0x20 2014-01-07 19:07:19 [] ? kthread+0x0/0xa0 2014-01-07 19:07:19 [] ? child_rip+0x0/0x20 2014-01-07 19:07:19 ffff880e84afb360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:19 ffff880e84afb2e0 ffffffff8150fa5e ffff880e818beda0 ffff880e818bf0b8 2014-01-07 19:07:19 ffff880e846505f8 ffff880e84afbfd8 000000000000fb88 ffff880e846505f8 2014-01-07 19:07:19 Call Trace: 2014-01-07 19:07:19 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:19 [] io_schedule+0x73/0xc0 2014-01-07 19:07:19 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:19 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:19 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:19 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:19 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:19 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:19 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:19 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:19 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:19 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:19 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:19 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:19 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:19 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:19 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:19 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:19 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:19 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:19 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:19 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:19 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:19 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:19 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:19 [] kthread+0x96/0xa0 2014-01-07 19:07:19 [] child_rip+0xa/0x20 2014-01-07 19:07:19 [] ? kthread+0x0/0xa0 2014-01-07 19:07:19 [] ? child_rip+0x0/0x20 2014-01-07 19:07:19 ffff880e8707b690 0000000000000046 ffff880e8707b6b0 ffffffffa04e9367 2014-01-07 19:07:19 ffff880e8707b6b0 0000000000000001 0000000000000e96 ffff880700000000 2014-01-07 19:07:19 ffff880e84651058 ffff880e8707bfd8 000000000000fb88 ffff880e84651058 2014-01-07 19:07:19 Call Trace: 2014-01-07 19:07:19 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:19 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:19 [] io_schedule+0x73/0xc0 2014-01-07 19:07:19 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:19 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:19 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:19 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:19 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:19 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:19 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:19 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:19 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:19 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:19 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:19 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:19 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:20 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:20 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:20 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:20 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_server_post_idle_rqbds+0x38/0xe0 [ptlrpc] 2014-01-07 19:07:20 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] kthread+0x96/0xa0 2014-01-07 19:07:20 [] child_rip+0xa/0x20 2014-01-07 19:07:20 [] ? kthread+0x0/0xa0 2014-01-07 19:07:20 [] ? child_rip+0x0/0x20 2014-01-07 19:07:20 ffff880e8549d4e0 0000000000000046 0000000000000000 ffffffff8127fa1e 2014-01-07 19:07:20 0000002100000005 ffff8807ceda3000 ffff880e8549d460 ffff880e8549d480 2014-01-07 19:07:20 ffff880e844d4638 ffff880e8549dfd8 000000000000fb88 ffff880e844d4638 2014-01-07 19:07:20 Call Trace: 2014-01-07 19:07:20 [] ? number+0x2ee/0x320 2014-01-07 19:07:20 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:07:20 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:07:20 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:07:20 [] ? down_write+0x32/0x40 2014-01-07 19:07:20 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:07:20 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:20 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:20 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:20 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:20 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:20 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:20 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:20 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:20 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:20 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:20 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:20 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] kthread+0x96/0xa0 2014-01-07 19:07:20 [] child_rip+0xa/0x20 2014-01-07 19:07:20 [] ? kthread+0x0/0xa0 2014-01-07 19:07:20 [] ? child_rip+0x0/0x20 2014-01-07 19:07:20 ffff880e84b35690 0000000000000046 ffff880e84b35658 ffff880e84b35654 2014-01-07 19:07:20 ffff880e84b356b0 ffff88083fe82c00 ffff88085c496740 0000000000000400 2014-01-07 19:07:20 ffff880e844d5098 ffff880e84b35fd8 000000000000fb88 ffff880e844d5098 2014-01-07 19:07:20 Call Trace: 2014-01-07 19:07:20 [] io_schedule+0x73/0xc0 2014-01-07 19:07:20 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:20 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:20 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:20 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:20 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:20 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:20 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:20 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:20 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:20 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:20 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:20 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:20 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:20 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:20 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] kthread+0x96/0xa0 2014-01-07 19:07:20 [] child_rip+0xa/0x20 2014-01-07 19:07:20 [] ? kthread+0x0/0xa0 2014-01-07 19:07:20 [] ? child_rip+0x0/0x20 2014-01-07 19:07:20 ffff880e854c7690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:20 ffff880e854c76b0 0000000000000001 0000000000000ca2 ffff880e00000000 2014-01-07 19:07:20 ffff880e874ed058 ffff880e854c7fd8 000000000000fb88 ffff880e874ed058 2014-01-07 19:07:20 Call Trace: 2014-01-07 19:07:20 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:20 [] io_schedule+0x73/0xc0 2014-01-07 19:07:20 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:20 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:20 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:20 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:20 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:20 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:20 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:20 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:20 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:20 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:20 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:20 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:20 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:20 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:20 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] kthread+0x96/0xa0 2014-01-07 19:07:20 scsi host6: SRP abort called 2014-01-07 19:07:20 [] child_rip+0xa/0x20 2014-01-07 19:07:20 [] ? kthread+0x0/0xa0 2014-01-07 19:07:20 [] ? child_rip+0x0/0x20 2014-01-07 19:07:20 ffff880e8493b690 0000000000000046 ffff880e8493b6b0 ffffffffa04e9367 2014-01-07 19:07:20 ffff880e8493b6b0 0000000000000001 0000000000000b2a ffff880e00000000 2014-01-07 19:07:20 ffff880e870fe5f8 ffff880e8493bfd8 000000000000fb88 ffff880e870fe5f8 2014-01-07 19:07:20 Call Trace: 2014-01-07 19:07:20 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:20 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:20 [] io_schedule+0x73/0xc0 2014-01-07 19:07:20 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:20 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:20 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:20 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:20 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:20 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:20 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:20 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:20 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:20 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:20 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:20 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:20 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:20 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:20 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:20 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:20 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:20 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] kthread+0x96/0xa0 2014-01-07 19:07:20 [] child_rip+0xa/0x20 2014-01-07 19:07:20 [] ? kthread+0x0/0xa0 2014-01-07 19:07:20 [] ? child_rip+0x0/0x20 2014-01-07 19:07:20 ffff880e84b27908 0000000000000086 ffff880e84b278d0 ffff880e84b278cc 2014-01-07 19:07:20 0000000000000001 ffff88083fe82200 ffff88085c456740 0000000000000207 2014-01-07 19:07:20 ffff8800bc802638 ffff880e84b27fd8 000000000000fb88 ffff8800bc802638 2014-01-07 19:07:20 Call Trace: 2014-01-07 19:07:20 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:07:20 [] ? add_wait_queue+0x46/0x60 2014-01-07 19:07:20 [] ? __pollwait+0x75/0xf0 2014-01-07 19:07:20 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:07:20 [] do_select+0x57c/0x6c0 2014-01-07 19:07:20 [] ? __pollwait+0x0/0xf0 2014-01-07 19:07:20 [] ? pollwake+0x0/0x60 2014-01-07 19:07:20 [] ? pollwake+0x0/0x60 2014-01-07 19:07:20 [] ? pollwake+0x0/0x60 2014-01-07 19:07:20 [] ? filemap_fault+0xd3/0x500 2014-01-07 19:07:20 [] ? unlock_page+0x27/0x30 2014-01-07 19:07:20 [] ? __do_fault+0x469/0x530 2014-01-07 19:07:20 [] ? handle_pte_fault+0xf7/0xb50 2014-01-07 19:07:20 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:20 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:07:20 [] ? __do_page_fault+0x1ec/0x480 2014-01-07 19:07:20 [] ? sys_sendto+0x139/0x190 2014-01-07 19:07:20 [] ? mntput_no_expire+0x30/0x110 2014-01-07 19:07:20 [] sys_select+0x47/0x110 2014-01-07 19:07:20 [] ? do_page_fault+0x3e/0xa0 2014-01-07 19:07:20 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:07:20 ffff880e83b87da0 0000000000000046 0000000000000000 ffff880e83b87d64 2014-01-07 19:07:20 ffff880700000000 ffff88083fe81800 ffff8800446b6740 0000000000000400 2014-01-07 19:07:20 ffff880e874e4638 ffff880e83b87fd8 000000000000fb88 ffff880e874e4638 2014-01-07 19:07:20 Call Trace: 2014-01-07 19:07:20 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:20 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:20 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:20 [] kthread+0x96/0xa0 2014-01-07 19:07:20 [] child_rip+0xa/0x20 2014-01-07 19:07:20 [] ? kthread+0x0/0xa0 2014-01-07 19:07:20 [] ? child_rip+0x0/0x20 2014-01-07 19:07:20 ffff880e87475da0 0000000000000046 0000000000000010 ffff8800bc284780 2014-01-07 19:07:20 ffff8807d138f800 0000000000000000 000000000000003a ffff8810343b6680 2014-01-07 19:07:20 ffff8810309ed098 ffff880e87475fd8 000000000000fb88 ffff8810309ed098 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:07:21 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880e8199bf48 0000000000000086 0000000000000000 0000000000000010 2014-01-07 19:07:21 ffff880832925728 ffff88007f412e40 ffff880e8199bf08 ffffffff81182bc1 2014-01-07 19:07:21 ffff880789e82638 ffff880e8199bfd8 000000000000fb88 ffff880789e82638 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? __fput+0x1a1/0x210 2014-01-07 19:07:21 [] sys_rt_sigsuspend+0xb3/0xe0 2014-01-07 19:07:21 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:07:21 ffff880e7fd55da0 0000000000000046 0000000000000000 ffff880e83155780 2014-01-07 19:07:21 ffff880ff54aac00 0000000000000000 000000000000005c ffff8810343b6680 2014-01-07 19:07:21 ffff880e7fd53af8 ffff880e7fd55fd8 000000000000fb88 ffff880e7fd53af8 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:07:21 [] ? ptlrpc_server_high_pending+0x51/0xb0 [ptlrpc] 2014-01-07 19:07:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880e7ef4fda0 0000000000000046 ffff880e7ef4fd68 ffff880e7ef4fd64 2014-01-07 19:07:21 ffff880f00000000 ffff88083fe82c00 ffff88085c4b6740 0000000000000400 2014-01-07 19:07:21 ffff880e7fd52638 ffff880e7ef4ffd8 000000000000fb88 ffff880e7fd52638 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:21 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880ff4123690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:21 ffff880ff41236b0 0000000000000001 0000000000000ce0 ffff880e00000000 2014-01-07 19:07:21 ffff880e7fd53098 ffff880ff4123fd8 000000000000fb88 ffff880e7fd53098 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:21 [] io_schedule+0x73/0xc0 2014-01-07 19:07:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880ff4127690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:21 ffff880ff41276b0 ffffffff00000001 ffff88021a55f5f0 ffff880e00000001 2014-01-07 19:07:21 ffff880ff4125af8 ffff880ff4127fd8 000000000000fb88 ffff880ff4125af8 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:21 [] io_schedule+0x73/0xc0 2014-01-07 19:07:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880ff47e1690 0000000000000046 ffff880ff47e16b0 ffffffffa04e9367 2014-01-07 19:07:21 ffff880ff47e16b0 0000000000000001 0000000000000e96 ffff880700000000 2014-01-07 19:07:21 ffff880ff4125098 ffff880ff47e1fd8 000000000000fb88 ffff880ff4125098 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:21 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:21 [] io_schedule+0x73/0xc0 2014-01-07 19:07:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880ff47e5690 0000000000000046 ffff880ff47e56b0 ffffffffa04e9367 2014-01-07 19:07:21 ffff880ff47e56b0 0000000000000001 0000000000000ccb ffff880700000000 2014-01-07 19:07:21 ffff880ff4124638 ffff880ff47e5fd8 000000000000fb88 ffff880ff4124638 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:21 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:21 [] io_schedule+0x73/0xc0 2014-01-07 19:07:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:21 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:21 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:21 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:21 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:21 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:21 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:21 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:21 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:21 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:21 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:21 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:21 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:21 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:21 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:21 [] kthread+0x96/0xa0 2014-01-07 19:07:21 [] child_rip+0xa/0x20 2014-01-07 19:07:21 [] ? kthread+0x0/0xa0 2014-01-07 19:07:21 [] ? child_rip+0x0/0x20 2014-01-07 19:07:21 ffff880ff4041690 0000000000000046 ffff880ff40416b0 ffffffffa04e9367 2014-01-07 19:07:21 ffff880ff40416b0 0000000000000001 0000000000000e90 ffff880700000000 2014-01-07 19:07:21 ffff880ff47e7ab8 ffff880ff4041fd8 000000000000fb88 ffff880ff47e7ab8 2014-01-07 19:07:21 Call Trace: 2014-01-07 19:07:21 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:21 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:21 [] io_schedule+0x73/0xc0 2014-01-07 19:07:21 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:21 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:21 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:21 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] kthread+0x96/0xa0 2014-01-07 19:07:22 [] child_rip+0xa/0x20 2014-01-07 19:07:22 [] ? kthread+0x0/0xa0 2014-01-07 19:07:22 [] ? child_rip+0x0/0x20 2014-01-07 19:07:22 ffff880ff4047360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:22 ffff880ff40472e0 ffffffff8150fa5e ffff8806c39fb060 ffff8806c39fb378 2014-01-07 19:07:22 ffff880ff47e7058 ffff880ff4047fd8 000000000000fb88 ffff880ff47e7058 2014-01-07 19:07:22 Call Trace: 2014-01-07 19:07:22 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:22 [] io_schedule+0x73/0xc0 2014-01-07 19:07:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:22 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:22 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:22 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:22 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:22 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:22 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:22 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] kthread+0x96/0xa0 2014-01-07 19:07:22 [] child_rip+0xa/0x20 2014-01-07 19:07:22 [] ? kthread+0x0/0xa0 2014-01-07 19:07:22 [] ? child_rip+0x0/0x20 2014-01-07 19:07:22 ffff880ff4011360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:22 ffff880ff40112e0 ffffffff8150fa5e ffff880e8f2b8900 ffff880e8f2b8c18 2014-01-07 19:07:22 ffff880ff47e65f8 ffff880ff4011fd8 000000000000fb88 ffff880ff47e65f8 2014-01-07 19:07:22 Call Trace: 2014-01-07 19:07:22 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:22 [] io_schedule+0x73/0xc0 2014-01-07 19:07:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:22 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:22 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:22 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:22 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:22 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:22 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:22 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:22 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] kthread+0x96/0xa0 2014-01-07 19:07:22 [] child_rip+0xa/0x20 2014-01-07 19:07:22 [] ? kthread+0x0/0xa0 2014-01-07 19:07:22 [] ? child_rip+0x0/0x20 2014-01-07 19:07:22 ffff880ff4015690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:22 ffff880ff40156b0 0000000000000001 0000000000000b59 ffff880e00000000 2014-01-07 19:07:22 ffff880ff4013af8 ffff880ff4015fd8 000000000000fb88 ffff880ff4013af8 2014-01-07 19:07:22 Call Trace: 2014-01-07 19:07:22 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:22 [] io_schedule+0x73/0xc0 2014-01-07 19:07:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] kthread+0x96/0xa0 2014-01-07 19:07:22 [] child_rip+0xa/0x20 2014-01-07 19:07:22 [] ? kthread+0x0/0xa0 2014-01-07 19:07:22 [] ? child_rip+0x0/0x20 2014-01-07 19:07:22 ffff880e80399690 0000000000000046 ffff880e803996b0 ffffffffa04e9367 2014-01-07 19:07:22 ffff880e803996b0 0000000000000001 0000000000000dd5 ffff880700000000 2014-01-07 19:07:22 ffff880ff4013098 ffff880e80399fd8 000000000000fb88 ffff880ff4013098 2014-01-07 19:07:22 Call Trace: 2014-01-07 19:07:22 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:22 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:22 [] io_schedule+0x73/0xc0 2014-01-07 19:07:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:22 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:22 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:22 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:22 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:22 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:22 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:22 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:22 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:22 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:22 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:22 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:22 [] kthread+0x96/0xa0 2014-01-07 19:07:22 [] child_rip+0xa/0x20 2014-01-07 19:07:22 [] ? kthread+0x0/0xa0 2014-01-07 19:07:22 [] ? child_rip+0x0/0x20 2014-01-07 19:07:22 ffff880e8039b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:22 ffff880e8039b6b0 0000000000000001 0000000000000ce0 ffff880e00000000 2014-01-07 19:07:22 ffff880ff4012638 ffff880e8039bfd8 000000000000fb88 ffff880ff4012638 2014-01-07 19:07:22 Call Trace: 2014-01-07 19:07:22 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:22 [] io_schedule+0x73/0xc0 2014-01-07 19:07:22 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:22 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:22 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:22 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:22 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:22 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:22 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] kthread+0x96/0xa0 2014-01-07 19:07:23 [] child_rip+0xa/0x20 2014-01-07 19:07:23 [] ? kthread+0x0/0xa0 2014-01-07 19:07:23 [] ? child_rip+0x0/0x20 2014-01-07 19:07:23 ffff880e7fe3b690 0000000000000046 ffff880e7fe3b6b0 ffffffffa04e9367 2014-01-07 19:07:23 ffff880e7fe3b6b0 0000000000000001 0000000000000c6e ffff880e00000000 2014-01-07 19:07:23 ffff880e7fe39ab8 ffff880e7fe3bfd8 000000000000fb88 ffff880e7fe39ab8 2014-01-07 19:07:23 Call Trace: 2014-01-07 19:07:23 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:23 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:23 [] io_schedule+0x73/0xc0 2014-01-07 19:07:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] kthread+0x96/0xa0 2014-01-07 19:07:23 [] child_rip+0xa/0x20 2014-01-07 19:07:23 [] ? kthread+0x0/0xa0 2014-01-07 19:07:23 [] ? child_rip+0x0/0x20 2014-01-07 19:07:23 ffff880e7fe3f690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:23 ffff880e7fe3f6b0 0000000000000001 0000000000000db7 ffff880e00000000 2014-01-07 19:07:23 ffff880e7fe39058 ffff880e7fe3ffd8 000000000000fb88 ffff880e7fe39058 2014-01-07 19:07:23 Call Trace: 2014-01-07 19:07:23 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:23 [] io_schedule+0x73/0xc0 2014-01-07 19:07:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] kthread+0x96/0xa0 2014-01-07 19:07:23 [] child_rip+0xa/0x20 2014-01-07 19:07:23 [] ? kthread+0x0/0xa0 2014-01-07 19:07:23 [] ? child_rip+0x0/0x20 2014-01-07 19:07:23 ffff880e7b23dda0 0000000000000046 0000000000000000 ffff880ff4162240 2014-01-07 19:07:23 ffff880ff54aa000 0000000000000000 000000000000003e ffff8810343b6580 2014-01-07 19:07:23 ffff880e7fe385f8 ffff880e7b23dfd8 000000000000fb88 ffff880e7fe385f8 2014-01-07 19:07:23 Call Trace: 2014-01-07 19:07:23 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:23 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:23 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] kthread+0x96/0xa0 2014-01-07 19:07:23 [] child_rip+0xa/0x20 2014-01-07 19:07:23 [] ? kthread+0x0/0xa0 2014-01-07 19:07:23 [] ? child_rip+0x0/0x20 2014-01-07 19:07:23 ffff880e7ebf5690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:23 ffff880e7ebf56b0 ffffffff00000001 ffff880eed414c10 ffff880e00000001 2014-01-07 19:07:23 ffff880e7b23faf8 ffff880e7ebf5fd8 000000000000fb88 ffff880e7b23faf8 2014-01-07 19:07:23 Call Trace: 2014-01-07 19:07:23 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:23 [] io_schedule+0x73/0xc0 2014-01-07 19:07:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] kthread+0x96/0xa0 2014-01-07 19:07:23 [] child_rip+0xa/0x20 2014-01-07 19:07:23 [] ? kthread+0x0/0xa0 2014-01-07 19:07:23 [] ? child_rip+0x0/0x20 2014-01-07 19:07:23 ffff880e7ebff690 0000000000000046 ffff880e7ebff6b0 ffffffffa04e9367 2014-01-07 19:07:23 ffff880e7ebff6b0 0000000000000001 0000000000000dd0 ffff880700000000 2014-01-07 19:07:23 ffff880e7ebfdab8 ffff880e7ebfffd8 000000000000fb88 ffff880e7ebfdab8 2014-01-07 19:07:23 Call Trace: 2014-01-07 19:07:23 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:23 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:23 [] io_schedule+0x73/0xc0 2014-01-07 19:07:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:23 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:23 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:23 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:23 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:23 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:23 [] kthread+0x96/0xa0 2014-01-07 19:07:23 [] child_rip+0xa/0x20 2014-01-07 19:07:23 [] ? kthread+0x0/0xa0 2014-01-07 19:07:23 [] ? child_rip+0x0/0x20 2014-01-07 19:07:23 ffff880e7d6f1690 0000000000000046 ffff880e7d6f16b0 ffffffffa04e9367 2014-01-07 19:07:23 ffff880e7d6f16b0 0000000000000001 0000000000000dd0 ffff880700000000 2014-01-07 19:07:23 ffff880e7ebfd058 ffff880e7d6f1fd8 000000000000fb88 ffff880e7ebfd058 2014-01-07 19:07:23 Call Trace: 2014-01-07 19:07:23 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:23 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:23 [] io_schedule+0x73/0xc0 2014-01-07 19:07:23 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:23 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:23 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:23 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:23 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:23 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:23 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:23 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:23 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:23 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:23 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:23 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:23 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] kthread+0x96/0xa0 2014-01-07 19:07:24 [] child_rip+0xa/0x20 2014-01-07 19:07:24 [] ? kthread+0x0/0xa0 2014-01-07 19:07:24 [] ? child_rip+0x0/0x20 2014-01-07 19:07:24 ffff880e7cca9690 0000000000000046 ffff880e7cca96b0 ffffffffa04e9367 2014-01-07 19:07:24 ffff880e7cca96b0 0000000000000001 0000000000000b14 ffff880e00000000 2014-01-07 19:07:24 ffff880e7cca7af8 ffff880e7cca9fd8 000000000000fb88 ffff880e7cca7af8 2014-01-07 19:07:24 Call Trace: 2014-01-07 19:07:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:24 [] io_schedule+0x73/0xc0 2014-01-07 19:07:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] kthread+0x96/0xa0 2014-01-07 19:07:24 [] child_rip+0xa/0x20 2014-01-07 19:07:24 [] ? kthread+0x0/0xa0 2014-01-07 19:07:24 [] ? child_rip+0x0/0x20 2014-01-07 19:07:24 ffff880e7d0ed690 0000000000000046 ffff880e7d0ed6b0 ffffffffa04e9367 2014-01-07 19:07:24 ffff880e7d0ed6b0 0000000000000001 0000000000000c12 ffff880e00000000 2014-01-07 19:07:24 ffff880e7cca7098 ffff880e7d0edfd8 000000000000fb88 ffff880e7cca7098 2014-01-07 19:07:24 Call Trace: 2014-01-07 19:07:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:24 [] io_schedule+0x73/0xc0 2014-01-07 19:07:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] kthread+0x96/0xa0 2014-01-07 19:07:24 [] child_rip+0xa/0x20 2014-01-07 19:07:24 [] ? kthread+0x0/0xa0 2014-01-07 19:07:24 [] ? child_rip+0x0/0x20 2014-01-07 19:07:24 ffff880e7d0ef690 0000000000000046 ffff880e7d0ef6b0 ffffffffa04e9367 2014-01-07 19:07:24 ffff880e7d0ef6b0 0000000000000001 0000000000000cae ffff880e00000000 2014-01-07 19:07:24 ffff880e7ebfc5f8 ffff880e7d0effd8 000000000000fb88 ffff880e7ebfc5f8 2014-01-07 19:07:24 Call Trace: 2014-01-07 19:07:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:24 [] io_schedule+0x73/0xc0 2014-01-07 19:07:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:24 scsi host7: SRP abort called 2014-01-07 19:07:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] kthread+0x96/0xa0 2014-01-07 19:07:24 [] child_rip+0xa/0x20 2014-01-07 19:07:24 [] ? kthread+0x0/0xa0 2014-01-07 19:07:24 [] ? child_rip+0x0/0x20 2014-01-07 19:07:24 ffff880e7cef9690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:24 ffff880e7cef96b0 0000000000000001 0000000000000ed1 ffff880e00000000 2014-01-07 19:07:24 ffff880e7b23f098 ffff880e7cef9fd8 000000000000fb88 ffff880e7b23f098 2014-01-07 19:07:24 Call Trace: 2014-01-07 19:07:24 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:24 [] io_schedule+0x73/0xc0 2014-01-07 19:07:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] kthread+0x96/0xa0 2014-01-07 19:07:24 [] child_rip+0xa/0x20 2014-01-07 19:07:24 [] ? kthread+0x0/0xa0 2014-01-07 19:07:24 [] ? child_rip+0x0/0x20 2014-01-07 19:07:24 ffff880e7c623360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:24 ffff880e7c6232e0 ffffffff8150fa5e ffff880e844e11c0 ffff880e844e14d8 2014-01-07 19:07:24 ffff880e7c621ab8 ffff880e7c623fd8 000000000000fb88 ffff880e7c621ab8 2014-01-07 19:07:24 Call Trace: 2014-01-07 19:07:24 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:24 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:24 [] io_schedule+0x73/0xc0 2014-01-07 19:07:24 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:24 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:24 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:24 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:24 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:24 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:24 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:24 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:24 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:24 [] ? arc_read+0x737/0x8a0 [zfs] 2014-01-07 19:07:24 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:24 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:24 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:24 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:24 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:24 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:24 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:24 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:24 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:24 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:24 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:24 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:24 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:24 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:24 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:24 [] kthread+0x96/0xa0 2014-01-07 19:07:24 [] child_rip+0xa/0x20 2014-01-07 19:07:25 [] ? kthread+0x0/0xa0 2014-01-07 19:07:25 [] ? child_rip+0x0/0x20 2014-01-07 19:07:25 ffff880e7c62f690 0000000000000046 ffff880e7c62f6b0 ffffffffa04e9367 2014-01-07 19:07:25 ffff880e7c62f6b0 0000000000000001 0000000000000c7f ffff880e00000000 2014-01-07 19:07:25 ffff880e7c621058 ffff880e7c62ffd8 000000000000fb88 ffff880e7c621058 2014-01-07 19:07:25 Call Trace: 2014-01-07 19:07:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:25 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:25 [] io_schedule+0x73/0xc0 2014-01-07 19:07:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] kthread+0x96/0xa0 2014-01-07 19:07:25 [] child_rip+0xa/0x20 2014-01-07 19:07:25 [] ? kthread+0x0/0xa0 2014-01-07 19:07:25 [] ? child_rip+0x0/0x20 2014-01-07 19:07:25 ffff880e7c065690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:25 ffff880e7c0656b0 ffffffff00000001 ffff880f61cde5f0 ffff880700000001 2014-01-07 19:07:25 ffff880e7b23e638 ffff880e7c065fd8 000000000000fb88 ffff880e7b23e638 2014-01-07 19:07:25 Call Trace: 2014-01-07 19:07:25 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:25 [] io_schedule+0x73/0xc0 2014-01-07 19:07:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] kthread+0x96/0xa0 2014-01-07 19:07:25 [] child_rip+0xa/0x20 2014-01-07 19:07:25 [] ? kthread+0x0/0xa0 2014-01-07 19:07:25 [] ? child_rip+0x0/0x20 2014-01-07 19:07:25 ffff880e7bcaf690 0000000000000046 ffff880e7bcaf6b0 ffffffffa04e9367 2014-01-07 19:07:25 ffff880e7bcaf6b0 0000000000000001 0000000000000b7b ffff880e00000000 2014-01-07 19:07:25 ffff880e7bcadaf8 ffff880e7bcaffd8 000000000000fb88 ffff880e7bcadaf8 2014-01-07 19:07:25 Call Trace: 2014-01-07 19:07:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:25 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:25 [] io_schedule+0x73/0xc0 2014-01-07 19:07:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] kthread+0x96/0xa0 2014-01-07 19:07:25 [] child_rip+0xa/0x20 2014-01-07 19:07:25 [] ? kthread+0x0/0xa0 2014-01-07 19:07:25 [] ? child_rip+0x0/0x20 2014-01-07 19:07:25 ffff880e7cf83360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:25 ffff880e7cf832e0 ffffffff8150fa5e ffff8806c3bf9620 ffff8806c3bf9938 2014-01-07 19:07:25 ffff880e7bcad098 ffff880e7cf83fd8 000000000000fb88 ffff880e7bcad098 2014-01-07 19:07:25 Call Trace: 2014-01-07 19:07:25 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:25 scsi host6: SRP abort called 2014-01-07 19:07:25 [] io_schedule+0x73/0xc0 2014-01-07 19:07:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:25 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:25 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:25 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:25 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:25 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:25 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:25 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:25 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] kthread+0x96/0xa0 2014-01-07 19:07:25 [] child_rip+0xa/0x20 2014-01-07 19:07:25 [] ? kthread+0x0/0xa0 2014-01-07 19:07:25 [] ? child_rip+0x0/0x20 2014-01-07 19:07:25 ffff880e7cf89690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:25 ffff880e7cf896b0 0000000000000001 0000000000000ba2 ffff880e00000000 2014-01-07 19:07:25 ffff880e7bcac638 ffff880e7cf89fd8 000000000000fb88 ffff880e7bcac638 2014-01-07 19:07:25 Call Trace: 2014-01-07 19:07:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:25 [] io_schedule+0x73/0xc0 2014-01-07 19:07:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:25 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:25 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:25 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:25 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:25 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:25 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:25 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:25 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:25 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:25 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:25 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:25 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:25 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:25 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:25 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:25 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:25 [] kthread+0x96/0xa0 2014-01-07 19:07:25 [] child_rip+0xa/0x20 2014-01-07 19:07:25 [] ? kthread+0x0/0xa0 2014-01-07 19:07:25 [] ? child_rip+0x0/0x20 2014-01-07 19:07:25 ffff880e7bb27690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:25 ffff880e7bb276b0 0000000000000001 0000000000000de1 ffff880700000000 2014-01-07 19:07:25 ffff880e7bb25ab8 ffff880e7bb27fd8 000000000000fb88 ffff880e7bb25ab8 2014-01-07 19:07:25 Call Trace: 2014-01-07 19:07:25 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:25 [] io_schedule+0x73/0xc0 2014-01-07 19:07:25 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:25 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] kthread+0x96/0xa0 2014-01-07 19:07:26 [] child_rip+0xa/0x20 2014-01-07 19:07:26 [] ? kthread+0x0/0xa0 2014-01-07 19:07:26 [] ? child_rip+0x0/0x20 2014-01-07 19:07:26 ffff880e7bb2b690 0000000000000046 ffff880e7bb2b6b0 ffffffffa04e9367 2014-01-07 19:07:26 ffff880e7bb2b6b0 0000000000000001 0000000000000c73 ffff880e00000000 2014-01-07 19:07:26 ffff880e7bb25058 ffff880e7bb2bfd8 000000000000fb88 ffff880e7bb25058 2014-01-07 19:07:26 Call Trace: 2014-01-07 19:07:26 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:26 [] io_schedule+0x73/0xc0 2014-01-07 19:07:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] kthread+0x96/0xa0 2014-01-07 19:07:26 [] child_rip+0xa/0x20 2014-01-07 19:07:26 [] ? kthread+0x0/0xa0 2014-01-07 19:07:26 [] ? child_rip+0x0/0x20 2014-01-07 19:07:26 ffff880e7bb2d690 0000000000000046 ffff880e7bb2d6b0 ffffffffa04e9367 2014-01-07 19:07:26 ffff880e7bb2d6b0 0000000000000001 0000000000000dc2 ffff880e00000000 2014-01-07 19:07:26 ffff880e7bb245f8 ffff880e7bb2dfd8 000000000000fb88 ffff880e7bb245f8 2014-01-07 19:07:26 Call Trace: 2014-01-07 19:07:26 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:26 [] io_schedule+0x73/0xc0 2014-01-07 19:07:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] kthread+0x96/0xa0 2014-01-07 19:07:26 [] child_rip+0xa/0x20 2014-01-07 19:07:26 [] ? kthread+0x0/0xa0 2014-01-07 19:07:26 [] ? child_rip+0x0/0x20 2014-01-07 19:07:26 ffff880e80795690 0000000000000046 ffff880e807956b0 ffffffffa04e97d6 2014-01-07 19:07:26 ffff880e807956b0 ffffffff00000001 ffff8805f76c40b0 ffff880e00000001 2014-01-07 19:07:26 ffff880e80793af8 ffff880e80795fd8 000000000000fb88 ffff880e80793af8 2014-01-07 19:07:26 Call Trace: 2014-01-07 19:07:26 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:26 [] io_schedule+0x73/0xc0 2014-01-07 19:07:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] kthread+0x96/0xa0 2014-01-07 19:07:26 [] child_rip+0xa/0x20 2014-01-07 19:07:26 [] ? kthread+0x0/0xa0 2014-01-07 19:07:26 [] ? child_rip+0x0/0x20 2014-01-07 19:07:26 ffff880e807994e0 0000000000000046 0000000000000000 ffffffff8127fa1e 2014-01-07 19:07:26 0000002100000005 ffff8808311ea000 ffff880e80799460 ffff880e80799480 2014-01-07 19:07:26 ffff880e80793098 ffff880e80799fd8 000000000000fb88 ffff880e80793098 2014-01-07 19:07:26 Call Trace: 2014-01-07 19:07:26 [] ? number+0x2ee/0x320 2014-01-07 19:07:26 [] rwsem_down_failed_common+0x95/0x1d0 2014-01-07 19:07:26 [] rwsem_down_write_failed+0x23/0x30 2014-01-07 19:07:26 [] call_rwsem_down_write_failed+0x13/0x20 2014-01-07 19:07:26 [] ? down_write+0x32/0x40 2014-01-07 19:07:26 [] dmu_zfetch+0x6fa/0xd70 [zfs] 2014-01-07 19:07:26 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:26 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:26 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:26 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:26 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:26 [] kthread+0x96/0xa0 2014-01-07 19:07:26 [] child_rip+0xa/0x20 2014-01-07 19:07:26 [] ? kthread+0x0/0xa0 2014-01-07 19:07:26 [] ? child_rip+0x0/0x20 2014-01-07 19:07:26 ffff880e8079f690 0000000000000046 ffff880e8079f6b0 ffffffffa04e9367 2014-01-07 19:07:26 ffff880e8079f6b0 0000000000000001 0000000000000bce ffff880e00000000 2014-01-07 19:07:26 ffff880e80792638 ffff880e8079ffd8 000000000000fb88 ffff880e80792638 2014-01-07 19:07:26 Call Trace: 2014-01-07 19:07:26 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:26 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:26 [] io_schedule+0x73/0xc0 2014-01-07 19:07:26 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:26 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:26 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:26 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:26 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:26 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:26 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:26 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:26 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:26 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:26 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:26 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:26 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:26 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] kthread+0x96/0xa0 2014-01-07 19:07:27 [] child_rip+0xa/0x20 2014-01-07 19:07:27 [] ? kthread+0x0/0xa0 2014-01-07 19:07:27 [] ? child_rip+0x0/0x20 2014-01-07 19:07:27 ffff880e7dc81690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:27 ffff880e7dc816b0 0000000000000001 0000000000000e24 ffff880700000000 2014-01-07 19:07:27 ffff880e7c6205f8 ffff880e7dc81fd8 000000000000fb88 ffff880e7c6205f8 2014-01-07 19:07:27 Call Trace: 2014-01-07 19:07:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:27 [] io_schedule+0x73/0xc0 2014-01-07 19:07:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] kthread+0x96/0xa0 2014-01-07 19:07:27 [] child_rip+0xa/0x20 2014-01-07 19:07:27 [] ? kthread+0x0/0xa0 2014-01-07 19:07:27 [] ? child_rip+0x0/0x20 2014-01-07 19:07:27 ffff880e7dc8d690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:27 ffff880e7dc8d6b0 0000000000000001 0000000000000dfd ffff880e00000000 2014-01-07 19:07:27 ffff880e7dc8bab8 ffff880e7dc8dfd8 000000000000fb88 ffff880e7dc8bab8 2014-01-07 19:07:27 Call Trace: 2014-01-07 19:07:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:27 [] io_schedule+0x73/0xc0 2014-01-07 19:07:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] kthread+0x96/0xa0 2014-01-07 19:07:27 [] child_rip+0xa/0x20 2014-01-07 19:07:27 [] ? kthread+0x0/0xa0 2014-01-07 19:07:27 [] ? child_rip+0x0/0x20 2014-01-07 19:07:27 ffff880e7bab5690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:27 ffff880e7bab56b0 0000000000000001 0000000000000b21 ffff880e00000000 2014-01-07 19:07:27 ffff880e7dc8b058 ffff880e7bab5fd8 000000000000fb88 ffff880e7dc8b058 2014-01-07 19:07:27 Call Trace: 2014-01-07 19:07:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:27 [] io_schedule+0x73/0xc0 2014-01-07 19:07:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] kthread+0x96/0xa0 2014-01-07 19:07:27 [] child_rip+0xa/0x20 2014-01-07 19:07:27 [] ? kthread+0x0/0xa0 2014-01-07 19:07:27 [] ? child_rip+0x0/0x20 2014-01-07 19:07:27 ffff880ff42cd690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:27 ffff880ff42cd6b0 0000000000000001 0000000000000ecb ffff880e00000000 2014-01-07 19:07:27 ffff880ff42c7af8 ffff880ff42cdfd8 000000000000fb88 ffff880ff42c7af8 2014-01-07 19:07:27 Call Trace: 2014-01-07 19:07:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:27 [] io_schedule+0x73/0xc0 2014-01-07 19:07:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] kthread+0x96/0xa0 2014-01-07 19:07:27 [] child_rip+0xa/0x20 2014-01-07 19:07:27 [] ? kthread+0x0/0xa0 2014-01-07 19:07:27 [] ? child_rip+0x0/0x20 2014-01-07 19:07:27 ffff880e7d827690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:27 ffff880e7d8276b0 0000000000000001 0000000000000dc3 ffff880e00000000 2014-01-07 19:07:27 ffff880ff42c7098 ffff880e7d827fd8 000000000000fb88 ffff880ff42c7098 2014-01-07 19:07:27 Call Trace: 2014-01-07 19:07:27 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:27 [] io_schedule+0x73/0xc0 2014-01-07 19:07:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:27 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:27 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:27 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:27 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:27 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:27 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:27 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:27 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:27 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:27 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:27 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:27 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:27 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:27 [] kthread+0x96/0xa0 2014-01-07 19:07:27 [] child_rip+0xa/0x20 2014-01-07 19:07:27 [] ? kthread+0x0/0xa0 2014-01-07 19:07:27 [] ? child_rip+0x0/0x20 2014-01-07 19:07:27 ffff880e7cb91690 0000000000000046 0000000000000000 ffffffffa04e97d6 2014-01-07 19:07:27 ffff880e7cb916b0 ffffffff00000001 ffff8807998b7820 ffff880e00000001 2014-01-07 19:07:27 ffff880ff42c6638 ffff880e7cb91fd8 000000000000fb88 ffff880ff42c6638 2014-01-07 19:07:27 Call Trace: 2014-01-07 19:07:27 [] ? dmu_zfetch+0x7c6/0xd70 [zfs] 2014-01-07 19:07:27 [] io_schedule+0x73/0xc0 2014-01-07 19:07:27 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:27 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:27 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:27 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:27 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] kthread+0x96/0xa0 2014-01-07 19:07:28 [] child_rip+0xa/0x20 2014-01-07 19:07:28 [] ? kthread+0x0/0xa0 2014-01-07 19:07:28 [] ? child_rip+0x0/0x20 2014-01-07 19:07:28 ffff880e803ad690 0000000000000046 ffff880e803ad6b0 ffffffffa04e9367 2014-01-07 19:07:28 ffff880e803ad6b0 0000000000000001 0000000000000e1a ffff880700000000 2014-01-07 19:07:28 ffff880e803abab8 ffff880e803adfd8 000000000000fb88 ffff880e803abab8 2014-01-07 19:07:28 Call Trace: 2014-01-07 19:07:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:28 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:28 [] io_schedule+0x73/0xc0 2014-01-07 19:07:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] kthread+0x96/0xa0 2014-01-07 19:07:28 [] child_rip+0xa/0x20 2014-01-07 19:07:28 [] ? kthread+0x0/0xa0 2014-01-07 19:07:28 [] ? child_rip+0x0/0x20 2014-01-07 19:07:28 ffff880e803b1690 0000000000000046 ffff880e803b16b0 ffffffffa04e9367 2014-01-07 19:07:28 ffff880e803b16b0 0000000000000001 0000000000000d10 ffff880700000000 2014-01-07 19:07:28 ffff880e803ab058 ffff880e803b1fd8 000000000000fb88 ffff880e803ab058 2014-01-07 19:07:28 Call Trace: 2014-01-07 19:07:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:28 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:28 [] io_schedule+0x73/0xc0 2014-01-07 19:07:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] kthread+0x96/0xa0 2014-01-07 19:07:28 [] child_rip+0xa/0x20 2014-01-07 19:07:28 [] ? kthread+0x0/0xa0 2014-01-07 19:07:28 [] ? child_rip+0x0/0x20 2014-01-07 19:07:28 ffff880e7bb03690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:28 ffff880e7bb036b0 0000000000000001 0000000000000d33 ffff880700000000 2014-01-07 19:07:28 ffff880e803aa5f8 ffff880e7bb03fd8 000000000000fb88 ffff880e803aa5f8 2014-01-07 19:07:28 Call Trace: 2014-01-07 19:07:28 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:28 [] io_schedule+0x73/0xc0 2014-01-07 19:07:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_server_post_idle_rqbds+0x38/0xe0 [ptlrpc] 2014-01-07 19:07:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] kthread+0x96/0xa0 2014-01-07 19:07:28 [] child_rip+0xa/0x20 2014-01-07 19:07:28 [] ? kthread+0x0/0xa0 2014-01-07 19:07:28 [] ? child_rip+0x0/0x20 2014-01-07 19:07:28 ffff880e7bb0b360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:28 ffff880e7bb0b2e0 ffffffff8150fa5e ffff880e8ec8fac0 ffff880e8ec8fdd8 2014-01-07 19:07:28 ffff880e7bb09af8 ffff880e7bb0bfd8 000000000000fb88 ffff880e7bb09af8 2014-01-07 19:07:28 Call Trace: 2014-01-07 19:07:28 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:28 [] io_schedule+0x73/0xc0 2014-01-07 19:07:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:28 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:28 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:28 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:28 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:28 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:28 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:28 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:28 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:28 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:28 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:28 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:28 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:28 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:28 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:28 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:28 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:28 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:28 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:28 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:28 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:28 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:28 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:28 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:28 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:28 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] kthread+0x96/0xa0 2014-01-07 19:07:28 [] child_rip+0xa/0x20 2014-01-07 19:07:28 [] ? kthread+0x0/0xa0 2014-01-07 19:07:28 [] ? child_rip+0x0/0x20 2014-01-07 19:07:28 ffff880e7bb0fda0 0000000000000046 ffff880e7bb0fd68 ffff880e7bb0fd64 2014-01-07 19:07:28 ffff880ff5709000 ffff88083fe82400 ffff880044616740 0000000000000406 2014-01-07 19:07:28 ffff880e7bb09098 ffff880e7bb0ffd8 000000000000fb88 ffff880e7bb09098 2014-01-07 19:07:28 Call Trace: 2014-01-07 19:07:28 [] ptlrpc_wait_event+0x2c5/0x2d0 [ptlrpc] 2014-01-07 19:07:28 [] ? default_wake_function+0x0/0x20 2014-01-07 19:07:28 [] ptlrpc_main+0x81f/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:28 [] kthread+0x96/0xa0 2014-01-07 19:07:28 [] child_rip+0xa/0x20 2014-01-07 19:07:28 [] ? kthread+0x0/0xa0 2014-01-07 19:07:28 [] ? child_rip+0x0/0x20 2014-01-07 19:07:28 ffff880e7ba9f360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:28 ffff880e7ba9f2e0 ffffffff8150fa5e ffff880e90a81ee0 ffff880e90a821f8 2014-01-07 19:07:28 ffff880e7bb08638 ffff880e7ba9ffd8 000000000000fb88 ffff880e7bb08638 2014-01-07 19:07:28 Call Trace: 2014-01-07 19:07:28 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:28 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:28 [] io_schedule+0x73/0xc0 2014-01-07 19:07:28 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:29 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:29 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:29 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:29 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:29 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:29 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] kthread+0x96/0xa0 2014-01-07 19:07:29 [] child_rip+0xa/0x20 2014-01-07 19:07:29 [] ? kthread+0x0/0xa0 2014-01-07 19:07:29 [] ? child_rip+0x0/0x20 2014-01-07 19:07:29 ffff880e7bdeb360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:29 ffff880e7bdeb2e0 ffffffff8150fa5e ffff8807bcf0f200 ffff8807bcf0f518 2014-01-07 19:07:29 ffff880e7bde9ab8 ffff880e7bdebfd8 000000000000fb88 ffff880e7bde9ab8 2014-01-07 19:07:29 Call Trace: 2014-01-07 19:07:29 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:29 [] io_schedule+0x73/0xc0 2014-01-07 19:07:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:29 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:29 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:29 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:29 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:29 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:29 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] kthread+0x96/0xa0 2014-01-07 19:07:29 [] child_rip+0xa/0x20 2014-01-07 19:07:29 [] ? kthread+0x0/0xa0 2014-01-07 19:07:29 [] ? child_rip+0x0/0x20 2014-01-07 19:07:29 ffff880e7bce7360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:29 ffff880e7bce72e0 ffffffff8150fa5e ffff880e8409a340 ffff880e8409a658 2014-01-07 19:07:29 ffff880e7bde9058 ffff880e7bce7fd8 000000000000fb88 ffff880e7bde9058 2014-01-07 19:07:29 Call Trace: 2014-01-07 19:07:29 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:29 [] io_schedule+0x73/0xc0 2014-01-07 19:07:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:29 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:29 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:29 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:29 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:29 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:29 scsi host7: SRP reset_device called 2014-01-07 19:07:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] kthread+0x96/0xa0 2014-01-07 19:07:29 [] child_rip+0xa/0x20 2014-01-07 19:07:29 [] ? kthread+0x0/0xa0 2014-01-07 19:07:29 [] ? child_rip+0x0/0x20 2014-01-07 19:07:29 ffff880e7bc81690 0000000000000046 ffff880e7bc816b0 ffffffffa04e9367 2014-01-07 19:07:29 ffff880e7bc816b0 0000000000000001 0000000000000d30 ffff880700000000 2014-01-07 19:07:29 ffff880e7dc8a5f8 ffff880e7bc81fd8 000000000000fb88 ffff880e7dc8a5f8 2014-01-07 19:07:29 Call Trace: 2014-01-07 19:07:29 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:29 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:29 [] io_schedule+0x73/0xc0 2014-01-07 19:07:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:29 [] kthread+0x96/0xa0 2014-01-07 19:07:29 [] child_rip+0xa/0x20 2014-01-07 19:07:29 [] ? kthread+0x0/0xa0 2014-01-07 19:07:29 [] ? child_rip+0x0/0x20 2014-01-07 19:07:29 ffff880e7bc89360 0000000000000046 0000000000000000 0000000000000001 2014-01-07 19:07:29 ffff880e7bc892e0 ffffffff8150fa5e ffff880e81f45c20 ffff880e81f45f38 2014-01-07 19:07:29 ffff880e7bc83af8 ffff880e7bc89fd8 000000000000fb88 ffff880e7bc83af8 2014-01-07 19:07:29 Call Trace: 2014-01-07 19:07:29 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:29 [] io_schedule+0x73/0xc0 2014-01-07 19:07:29 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:29 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:29 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:29 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:29 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:29 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:29 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:29 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:29 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:29 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:29 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:29 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:29 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:29 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:29 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:29 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:29 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:29 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:29 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:29 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:29 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:29 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:29 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:29 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] kthread+0x96/0xa0 2014-01-07 19:07:30 [] child_rip+0xa/0x20 2014-01-07 19:07:30 [] ? kthread+0x0/0xa0 2014-01-07 19:07:30 [] ? child_rip+0x0/0x20 2014-01-07 19:07:30 ffff880e7bc8f690 0000000000000046 ffff880e7bc8f6b0 ffffffffa04e9367 2014-01-07 19:07:30 ffff880e7bc8f6b0 0000000000000001 0000000000000d94 ffff880e00000000 2014-01-07 19:07:30 ffff880e7bc83098 ffff880e7bc8ffd8 000000000000fb88 ffff880e7bc83098 2014-01-07 19:07:30 Call Trace: 2014-01-07 19:07:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:30 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:30 [] io_schedule+0x73/0xc0 2014-01-07 19:07:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] kthread+0x96/0xa0 2014-01-07 19:07:30 [] child_rip+0xa/0x20 2014-01-07 19:07:30 [] ? kthread+0x0/0xa0 2014-01-07 19:07:30 [] ? child_rip+0x0/0x20 2014-01-07 19:07:30 ffff880e7c399690 0000000000000046 ffff880e7c3996b0 ffffffffa04e9367 2014-01-07 19:07:30 ffff880e7c3996b0 0000000000000001 0000000000000d46 ffff880700000000 2014-01-07 19:07:30 ffff880e7bc82638 ffff880e7c399fd8 000000000000fb88 ffff880e7bc82638 2014-01-07 19:07:30 Call Trace: 2014-01-07 19:07:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:30 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:30 [] io_schedule+0x73/0xc0 2014-01-07 19:07:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] kthread+0x96/0xa0 2014-01-07 19:07:30 [] child_rip+0xa/0x20 2014-01-07 19:07:30 [] ? kthread+0x0/0xa0 2014-01-07 19:07:30 [] ? child_rip+0x0/0x20 2014-01-07 19:07:30 ffff880e7c39d690 0000000000000046 ffff880e7c39d6b0 ffffffffa04e9367 2014-01-07 19:07:30 ffff880e7c39d6b0 0000000000000001 0000000000000c8c ffff880e00000000 2014-01-07 19:07:30 ffff880e7c39bab8 ffff880e7c39dfd8 000000000000fb88 ffff880e7c39bab8 2014-01-07 19:07:30 Call Trace: 2014-01-07 19:07:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:30 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:30 [] io_schedule+0x73/0xc0 2014-01-07 19:07:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] kthread+0x96/0xa0 2014-01-07 19:07:30 [] child_rip+0xa/0x20 2014-01-07 19:07:30 [] ? kthread+0x0/0xa0 2014-01-07 19:07:30 [] ? child_rip+0x0/0x20 2014-01-07 19:07:30 ffff880e7c649690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:30 ffff880e7c6496b0 0000000000000001 0000000000000d6d ffff880e00000000 2014-01-07 19:07:30 ffff880e7c39b058 ffff880e7c649fd8 000000000000fb88 2014-01-07 19:07:30 scsi host6: SRP abort called 2014-01-07 19:07:30 ffff880e7c39b058 2014-01-07 19:07:30 Call Trace: 2014-01-07 19:07:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:30 [] io_schedule+0x73/0xc0 2014-01-07 19:07:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] kthread+0x96/0xa0 2014-01-07 19:07:30 [] child_rip+0xa/0x20 2014-01-07 19:07:30 [] ? kthread+0x0/0xa0 2014-01-07 19:07:30 [] ? child_rip+0x0/0x20 2014-01-07 19:07:30 ffff880e7c64b690 0000000000000046 0000000000000000 ffffffffa04e9367 2014-01-07 19:07:30 ffff880e7c64b6b0 0000000000000001 0000000000000b40 ffff880e00000000 2014-01-07 19:07:30 ffff880e7c39a5f8 ffff880e7c64bfd8 000000000000fb88 ffff880e7c39a5f8 2014-01-07 19:07:30 Call Trace: 2014-01-07 19:07:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:30 [] io_schedule+0x73/0xc0 2014-01-07 19:07:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:30 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:30 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:30 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:30 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:30 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:30 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:30 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:30 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:30 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:30 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:30 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:30 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:30 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:30 [] kthread+0x96/0xa0 2014-01-07 19:07:30 [] child_rip+0xa/0x20 2014-01-07 19:07:30 [] ? kthread+0x0/0xa0 2014-01-07 19:07:30 [] ? child_rip+0x0/0x20 2014-01-07 19:07:30 ffff880e7c9c7690 0000000000000046 ffff880e7c9c76b0 ffffffffa04e9367 2014-01-07 19:07:30 ffff880e7c9c76b0 0000000000000001 0000000000000e95 ffff880700000000 2014-01-07 19:07:30 ffff880e7c9c5af8 ffff880e7c9c7fd8 000000000000fb88 ffff880e7c9c5af8 2014-01-07 19:07:30 Call Trace: 2014-01-07 19:07:30 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:30 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:30 [] io_schedule+0x73/0xc0 2014-01-07 19:07:30 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:30 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:30 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:30 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:30 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] kthread+0x96/0xa0 2014-01-07 19:07:31 [] child_rip+0xa/0x20 2014-01-07 19:07:31 [] ? kthread+0x0/0xa0 2014-01-07 19:07:31 [] ? child_rip+0x0/0x20 2014-01-07 19:07:31 ffff880e7d53d690 0000000000000046 ffff880e7d53d6b0 ffffffffa04e9367 2014-01-07 19:07:31 ffff880e7d53d6b0 0000000000000001 0000000000000b14 ffff880e00000000 2014-01-07 19:07:31 ffff880e7c9c5098 ffff880e7d53dfd8 000000000000fb88 ffff880e7c9c5098 2014-01-07 19:07:31 Call Trace: 2014-01-07 19:07:31 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:31 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:31 [] io_schedule+0x73/0xc0 2014-01-07 19:07:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] kthread+0x96/0xa0 2014-01-07 19:07:31 [] child_rip+0xa/0x20 2014-01-07 19:07:31 [] ? kthread+0x0/0xa0 2014-01-07 19:07:31 [] ? child_rip+0x0/0x20 2014-01-07 19:07:31 ffff880e7c995690 0000000000000046 ffff880e7c9956b0 ffffffffa04e9367 2014-01-07 19:07:31 ffff880e7c9956b0 0000000000000001 0000000000000d90 ffff880e00000000 2014-01-07 19:07:31 ffff880e7c9c4638 ffff880e7c995fd8 000000000000fb88 ffff880e7c9c4638 2014-01-07 19:07:31 Call Trace: 2014-01-07 19:07:31 [] ? dmu_zfetch+0x357/0xd70 [zfs] 2014-01-07 19:07:31 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:31 [] io_schedule+0x73/0xc0 2014-01-07 19:07:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:31 [] dmu_buf_hold_array_by_dnode+0x1dd/0x560 [zfs] 2014-01-07 19:07:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] kthread+0x96/0xa0 2014-01-07 19:07:31 [] child_rip+0xa/0x20 2014-01-07 19:07:31 [] ? kthread+0x0/0xa0 2014-01-07 19:07:31 [] ? child_rip+0x0/0x20 2014-01-07 19:07:31 ffff880e7c99d360 0000000000000046 0000000000000004 0000000000000001 2014-01-07 19:07:31 ffff880e7c99d2e0 ffffffff8150fa5e ffff880e7a65caa0 ffff880e7a65cdb8 2014-01-07 19:07:31 ffff880e7c997ab8 ffff880e7c99dfd8 000000000000fb88 ffff880e7c997ab8 2014-01-07 19:07:31 Call Trace: 2014-01-07 19:07:31 [] ? mutex_lock+0x1e/0x50 2014-01-07 19:07:31 [] ? ktime_get_ts+0xb1/0xf0 2014-01-07 19:07:31 [] io_schedule+0x73/0xc0 2014-01-07 19:07:31 [] cv_wait_common+0x8c/0x100 [spl] 2014-01-07 19:07:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:31 [] __cv_wait_io+0x18/0x20 [spl] 2014-01-07 19:07:31 [] zio_wait+0xfb/0x1b0 [zfs] 2014-01-07 19:07:31 [] dbuf_read+0x3fd/0x750 [zfs] 2014-01-07 19:07:31 [] ? __dbuf_hold_impl+0x2b1/0x480 [zfs] 2014-01-07 19:07:31 [] dbuf_prefetch+0x10b/0x270 [zfs] 2014-01-07 19:07:31 [] ? libcfs_debug_vmsg2+0x50b/0xbc0 [libcfs] 2014-01-07 19:07:31 [] dmu_zfetch_dofetch+0xf1/0x160 [zfs] 2014-01-07 19:07:31 [] dmu_zfetch+0x80c/0xd70 [zfs] 2014-01-07 19:07:31 [] ? arc_read+0x6a9/0x8a0 [zfs] 2014-01-07 19:07:31 [] dbuf_read+0x48a/0x750 [zfs] 2014-01-07 19:07:31 [] dmu_buf_hold_array_by_dnode+0x162/0x560 [zfs] 2014-01-07 19:07:31 [] dmu_buf_hold_array_by_bonus+0x68/0x90 [zfs] 2014-01-07 19:07:31 [] osd_bufs_get+0x493/0xb00 [osd_zfs] 2014-01-07 19:07:31 [] ? libcfs_log_return+0x28/0x40 [libcfs] 2014-01-07 19:07:31 [] ofd_preprw_read+0x14b/0x7f0 [ofd] 2014-01-07 19:07:31 [] ofd_preprw+0x77a/0x1480 [ofd] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] obd_preprw+0x121/0x390 [ost] 2014-01-07 19:07:31 [] ost_brw_read+0xd29/0x1350 [ost] 2014-01-07 19:07:31 [] ? cfs_set_ptldebug_header+0x2b/0xc0 [libcfs] 2014-01-07 19:07:31 [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 2014-01-07 19:07:31 [] ost_handle+0x24a8/0x44d0 [ost] 2014-01-07 19:07:31 [] ? libcfs_id2str+0x74/0xb0 [libcfs] 2014-01-07 19:07:31 [] ptlrpc_server_handle_request+0x385/0xc00 [ptlrpc] 2014-01-07 19:07:31 [] ? lc_watchdog_touch+0xd5/0x170 [libcfs] 2014-01-07 19:07:31 [] ? ptlrpc_wait_event+0xa9/0x2d0 [ptlrpc] 2014-01-07 19:07:31 [] ptlrpc_main+0xaed/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] ? ptlrpc_main+0x0/0x1740 [ptlrpc] 2014-01-07 19:07:31 [] kthread+0x96/0xa0 2014-01-07 19:07:31 [] child_rip+0xa/0x20 2014-01-07 19:07:31 [] ? kthread+0x0/0xa0 2014-01-07 19:07:31 [] ? child_rip+0x0/0x20 2014-01-07 19:07:31 ffff880e76685908 0000000000000082 0000000000000000 ffff880e766858cc 2014-01-07 19:07:31 ffff880e00000000 ffff88083fe81200 ffff880044616740 000000000000015a 2014-01-07 19:07:31 ffff880789ab65f8 ffff880e76685fd8 000000000000fb88 ffff880789ab65f8 2014-01-07 19:07:31 Call Trace: 2014-01-07 19:07:31 [] schedule_hrtimeout_range+0x13d/0x160 2014-01-07 19:07:31 [] ? flush_delayed_work+0x54/0x70 2014-01-07 19:07:31 [] poll_schedule_timeout+0x39/0x60 2014-01-07 19:07:31 [] do_select+0x57c/0x6c0 2014-01-07 19:07:31 [] ? __pollwait+0x0/0xf0 2014-01-07 19:07:31 [] ? pollwake+0x0/0x60 2014-01-07 19:07:31 [] ? pollwake+0x0/0x60 2014-01-07 19:07:31 [] ? pollwake+0x0/0x60 2014-01-07 19:07:31 [] ? _spin_unlock_bh+0x1b/0x20 2014-01-07 19:07:31 [] ? release_sock+0xce/0xe0 2014-01-07 19:07:31 [] ? tcp_sendmsg+0x73c/0xa20 2014-01-07 19:07:31 [] ? sock_aio_write+0x19b/0x1c0 2014-01-07 19:07:31 [] core_sys_select+0x18a/0x2c0 2014-01-07 19:07:31 [] ? n_tty_read+0x34c/0x9b0 2014-01-07 19:07:31 [] ? autoremove_wake_function+0x0/0x40 2014-01-07 19:07:31 [] sys_select+0x47/0x110 2014-01-07 19:07:31 [] ? sys_write+0x51/0x90 2014-01-07 19:07:31 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:07:31 ffff880e766e5e78 0000000000000082 0000000000000000 0000000000000029 2014-01-07 19:07:31 ffff88082886ec40 00007ffff7ffd978 ffff880831c8c700 0000000000000007 2014-01-07 19:07:31 ffff88078fd1e5f8 ffff880e766e5fd8 000000000000fb88 ffff88078fd1e5f8 2014-01-07 19:07:31 Call Trace: 2014-01-07 19:07:31 [] do_wait+0x1e4/0x240 2014-01-07 19:07:31 [] sys_wait4+0xa3/0x100 2014-01-07 19:07:31 [] ? child_wait_callback+0x0/0x70 2014-01-07 19:07:31 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:07:31 0000002100000009 ffffffff8106ecff ffff880e76743c38 ffff880e76743c8d 2014-01-07 19:07:31 ffffffff81eacf01 0000000000000014 ffff880e76743c78 0000000000000034 2014-01-07 19:07:31 ffff880e76743ce8 0000000000000046 0000006cffffffff 0000000000000046 2014-01-07 19:07:31 Call Trace: 2014-01-07 19:07:31 [] ? print_context_stack+0x85/0x140 2014-01-07 19:07:31 [] ? dump_trace+0x190/0x3b0 2014-01-07 19:07:31 [] show_trace_log_lvl+0x55/0x70 2014-01-07 19:07:31 [] show_stack_log_lvl+0x9a/0x170 2014-01-07 19:07:31 [] show_stack+0x1a/0x20 2014-01-07 19:07:31 [] sched_show_task+0x98/0x100 2014-01-07 19:07:31 [] show_state_filter+0x7b/0xc0 2014-01-07 19:07:31 [] sysrq_handle_showstate+0x10/0x20 2014-01-07 19:07:31 [] __handle_sysrq+0x132/0x1a0 2014-01-07 19:07:31 [] write_sysrq_trigger+0x4e/0x50 2014-01-07 19:07:31 [] proc_reg_write+0x7e/0xc0 2014-01-07 19:07:31 [] vfs_write+0xb8/0x1a0 2014-01-07 19:07:31 [] sys_write+0x51/0x90 2014-01-07 19:07:31 [] system_call_fastpath+0x16/0x1b 2014-01-07 19:07:31 Sched Debug Version: v0.09, 2.6.32-358.18.1.el6_lustre.gf1706f8.x86_64 #1 2014-01-07 19:07:31 now at 6528040.699813 msecs 2014-01-07 19:07:31 .jiffies : 4301195348 2014-01-07 19:07:31 .sysctl_sched_latency : 20.000000 2014-01-07 19:07:31 .sysctl_sched_min_granularity : 4.000000 2014-01-07 19:07:31 .sysctl_sched_wakeup_granularity : 4.000000 2014-01-07 19:07:31 .sysctl_sched_child_runs_first : 0.000000 2014-01-07 19:07:31 .sysctl_sched_features : 3183 2014-01-07 19:07:31 .sysctl_sched_tunable_scaling : 1 (logaritmic) 2014-01-07 19:07:32 2014-01-07 19:07:32 cpu#0, 2593.628 MHz 2014-01-07 19:07:32 .nr_running : 3 2014-01-07 19:07:32 .load : 1039 2014-01-07 19:07:32 .nr_switches : 28945271 2014-01-07 19:07:32 .nr_load_updates : 1618028 2014-01-07 19:07:32 .nr_uninterruptible : 42 2014-01-07 19:07:32 .next_balance : 4301.074013 2014-01-07 19:07:32 .curr->pid : 11921 2014-01-07 19:07:32 .clock : 6396557.898396 2014-01-07 19:07:32 .cpu_load[0] : 0 2014-01-07 19:07:32 .cpu_load[1] : 0 2014-01-07 19:07:32 .cpu_load[2] : 0 2014-01-07 19:07:32 .cpu_load[3] : 2 2014-01-07 19:07:32 .cpu_load[4] : 15 2014-01-07 19:07:32 .yld_count : 0 2014-01-07 19:07:32 .sched_switch : 0 2014-01-07 19:07:32 .sched_count : 38247171 2014-01-07 19:07:32 .sched_goidle : 12861981 2014-01-07 19:07:32 .avg_idle : 1000000 2014-01-07 19:07:32 .ttwu_count : 16037615 2014-01-07 19:07:32 .ttwu_local : 2445855 2014-01-07 19:07:32 .bkl_count : 1129 2014-01-07 19:07:32 2014-01-07 19:07:32 cfs_rq[0]:/ 2014-01-07 19:07:32 .exec_clock : 546644.980116 2014-01-07 19:07:32 .MIN_vruntime : 10117081.286249 2014-01-07 19:07:32 .min_vruntime : 10117091.286249 2014-01-07 19:07:32 .max_vruntime : 10117081.286249 2014-01-07 19:07:32 .spread : 0.000000 2014-01-07 19:07:32 .spread0 : 0.000000 2014-01-07 19:07:32 .nr_spread_over : 5263 2014-01-07 19:07:32 .nr_running : 2 2014-01-07 19:07:32 .load : 1039 2014-01-07 19:07:32 .load_avg : 0.000000 2014-01-07 19:07:32 .load_period : 0.000000 2014-01-07 19:07:32 .load_contrib : 0 2014-01-07 19:07:32 .load_tg : 0 2014-01-07 19:07:32 2014-01-07 19:07:32 rt_rq[0]:/ 2014-01-07 19:07:32 .rt_nr_running : 1 2014-01-07 19:07:32 .rt_throttled : 0 2014-01-07 19:07:32 .rt_time : 0.000000 2014-01-07 19:07:32 .rt_runtime : 950.000000 2014-01-07 19:07:32 2014-01-07 19:07:32 runnable tasks: 2014-01-07 19:07:32 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:32 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:32 migration/0 3 175.381503 301 0 175.381503 107.486801 0.000000 / 2014-01-07 19:07:32 z_null_iss/0 6696 10117081.286249 195619 139 10117081.286249 1292.226634 6023289.570298 / 2014-01-07 19:07:32 R bash 11921 10117091.286249 63 120 10117091.286249 251.842335 9039.052727 / 2014-01-07 19:07:32 2014-01-07 19:07:32 cpu#1, 2593.628 MHz 2014-01-07 19:07:32 .nr_running : 1 2014-01-07 19:07:32 .load : 1024 2014-01-07 19:07:32 .nr_switches : 21644099 2014-01-07 19:07:32 .nr_load_updates : 988022 2014-01-07 19:07:32 .nr_uninterruptible : 26 2014-01-07 19:07:32 .next_balance : 4301.086161 2014-01-07 19:07:32 .curr->pid : 5140 2014-01-07 19:07:32 .clock : 6407478.243115 2014-01-07 19:07:32 .cpu_load[0] : 0 2014-01-07 19:07:32 .cpu_load[1] : 0 2014-01-07 19:07:32 .cpu_load[2] : 0 2014-01-07 19:07:32 .cpu_load[3] : 0 2014-01-07 19:07:32 .cpu_load[4] : 0 2014-01-07 19:07:32 .yld_count : 0 2014-01-07 19:07:32 .sched_switch : 0 2014-01-07 19:07:32 .sched_count : 25988216 2014-01-07 19:07:32 .sched_goidle : 9199940 2014-01-07 19:07:32 .avg_idle : 1000000 2014-01-07 19:07:32 .ttwu_count : 12358362 2014-01-07 19:07:32 .ttwu_local : 3393500 2014-01-07 19:07:32 .bkl_count : 188 2014-01-07 19:07:32 2014-01-07 19:07:32 cfs_rq[1]:/ 2014-01-07 19:07:32 .exec_clock : 495400.397488 2014-01-07 19:07:32 .MIN_vruntime : 0.000001 2014-01-07 19:07:32 .min_vruntime : 8456466.966052 2014-01-07 19:07:32 .max_vruntime : 0.000001 2014-01-07 19:07:32 .spread : 0.000000 2014-01-07 19:07:32 .spread0 : -1660624.320197 2014-01-07 19:07:32 .nr_spread_over : 3585 2014-01-07 19:07:32 .nr_running : 1 2014-01-07 19:07:32 .load : 1024 2014-01-07 19:07:32 .load_avg : 0.000000 2014-01-07 19:07:32 .load_period : 0.000000 2014-01-07 19:07:32 .load_contrib : 0 2014-01-07 19:07:32 .load_tg : 0 2014-01-07 19:07:32 2014-01-07 19:07:32 rt_rq[1]:/ 2014-01-07 19:07:32 .rt_nr_running : 0 2014-01-07 19:07:32 .rt_throttled : 0 2014-01-07 19:07:32 .rt_time : 0.000000 2014-01-07 19:07:32 .rt_runtime : 950.000000 2014-01-07 19:07:32 2014-01-07 19:07:32 runnable tasks: 2014-01-07 19:07:32 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:32 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:32 R xinetd 5140 8456456.999687 234 120 8456456.999687 48.565367 6320588.710789 / 2014-01-07 19:07:32 2014-01-07 19:07:32 cpu#2, 2593.628 MHz 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:32 .nr_switches : 19289101 2014-01-07 19:07:32 .nr_load_updates : 1096521 2014-01-07 19:07:32 .nr_uninterruptible : 27 2014-01-07 19:07:32 .next_balance : 4301.194026 2014-01-07 19:07:32 .curr->pid : 0 2014-01-07 19:07:32 .clock : 6516608.726587 2014-01-07 19:07:32 .cpu_load[0] : 0 2014-01-07 19:07:32 .cpu_load[1] : 0 2014-01-07 19:07:32 .cpu_load[2] : 0 2014-01-07 19:07:32 .cpu_load[3] : 0 2014-01-07 19:07:32 .cpu_load[4] : 0 2014-01-07 19:07:32 .yld_count : 0 2014-01-07 19:07:32 .sched_switch : 0 2014-01-07 19:07:32 .sched_count : 21059118 2014-01-07 19:07:32 .sched_goidle : 8011388 2014-01-07 19:07:32 .avg_idle : 1000000 2014-01-07 19:07:32 .ttwu_count : 11191045 2014-01-07 19:07:32 .ttwu_local : 3387268 2014-01-07 19:07:32 .bkl_count : 47 2014-01-07 19:07:32 2014-01-07 19:07:32 cfs_rq[2]:/ 2014-01-07 19:07:32 .exec_clock : 412319.070522 2014-01-07 19:07:32 .MIN_vruntime : 0.000001 2014-01-07 19:07:32 .min_vruntime : 8327889.510947 2014-01-07 19:07:32 .max_vruntime : 0.000001 2014-01-07 19:07:32 .spread : 0.000000 2014-01-07 19:07:32 .spread0 : -1789201.775302 2014-01-07 19:07:32 .nr_spread_over : 3721 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:32 .load_avg : 0.000000 2014-01-07 19:07:32 .load_period : 0.000000 2014-01-07 19:07:32 .load_contrib : 0 2014-01-07 19:07:32 .load_tg : 0 2014-01-07 19:07:32 2014-01-07 19:07:32 rt_rq[2]:/ 2014-01-07 19:07:32 .rt_nr_running : 0 2014-01-07 19:07:32 .rt_throttled : 0 2014-01-07 19:07:32 .rt_time : 0.004250 2014-01-07 19:07:32 .rt_runtime : 950.000000 2014-01-07 19:07:32 2014-01-07 19:07:32 runnable tasks: 2014-01-07 19:07:32 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:32 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:32 2014-01-07 19:07:32 cpu#3, 2593.628 MHz 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:32 .nr_switches : 19526961 2014-01-07 19:07:32 .nr_load_updates : 1053737 2014-01-07 19:07:32 .nr_uninterruptible : 0 2014-01-07 19:07:32 .next_balance : 4301.196233 2014-01-07 19:07:32 .curr->pid : 0 2014-01-07 19:07:32 .clock : 6516936.282364 2014-01-07 19:07:32 .cpu_load[0] : 0 2014-01-07 19:07:32 .cpu_load[1] : 0 2014-01-07 19:07:32 .cpu_load[2] : 0 2014-01-07 19:07:32 .cpu_load[3] : 0 2014-01-07 19:07:32 .cpu_load[4] : 0 2014-01-07 19:07:32 .yld_count : 0 2014-01-07 19:07:32 .sched_switch : 0 2014-01-07 19:07:32 .sched_count : 20170936 2014-01-07 19:07:32 .sched_goidle : 8090910 2014-01-07 19:07:32 .avg_idle : 1000000 2014-01-07 19:07:32 .ttwu_count : 11337680 2014-01-07 19:07:32 .ttwu_local : 4216342 2014-01-07 19:07:32 .bkl_count : 67 2014-01-07 19:07:32 2014-01-07 19:07:32 cfs_rq[3]:/ 2014-01-07 19:07:32 .exec_clock : 338455.317215 2014-01-07 19:07:32 .MIN_vruntime : 0.000001 2014-01-07 19:07:32 .min_vruntime : 8709622.463392 2014-01-07 19:07:32 .max_vruntime : 0.000001 2014-01-07 19:07:32 .spread : 0.000000 2014-01-07 19:07:32 .spread0 : -1407468.822857 2014-01-07 19:07:32 .nr_spread_over : 3691 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:32 .load_avg : 0.000000 2014-01-07 19:07:32 .load_period : 0.000000 2014-01-07 19:07:32 .load_contrib : 0 2014-01-07 19:07:32 .load_tg : 0 2014-01-07 19:07:32 2014-01-07 19:07:32 rt_rq[3]:/ 2014-01-07 19:07:32 .rt_nr_running : 0 2014-01-07 19:07:32 .rt_throttled : 0 2014-01-07 19:07:32 .rt_time : 0.003113 2014-01-07 19:07:32 .rt_runtime : 950.000000 2014-01-07 19:07:32 2014-01-07 19:07:32 runnable tasks: 2014-01-07 19:07:32 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:32 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:32 2014-01-07 19:07:32 cpu#4, 2593.628 MHz 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:32 .nr_switches : 22072543 2014-01-07 19:07:32 .nr_load_updates : 1022681 2014-01-07 19:07:32 .nr_uninterruptible : 36 2014-01-07 19:07:32 .next_balance : 4301.196004 2014-01-07 19:07:32 .curr->pid : 0 2014-01-07 19:07:32 .clock : 6516893.438901 2014-01-07 19:07:32 .cpu_load[0] : 0 2014-01-07 19:07:32 .cpu_load[1] : 0 2014-01-07 19:07:32 .cpu_load[2] : 0 2014-01-07 19:07:32 .cpu_load[3] : 0 2014-01-07 19:07:32 .cpu_load[4] : 0 2014-01-07 19:07:32 .yld_count : 0 2014-01-07 19:07:32 .sched_switch : 0 2014-01-07 19:07:32 .sched_count : 23313351 2014-01-07 19:07:32 .sched_goidle : 10531762 2014-01-07 19:07:32 .avg_idle : 1000000 2014-01-07 19:07:32 .ttwu_count : 11452444 2014-01-07 19:07:32 .ttwu_local : 1563917 2014-01-07 19:07:32 .bkl_count : 13 2014-01-07 19:07:32 2014-01-07 19:07:32 cfs_rq[4]:/ 2014-01-07 19:07:32 .exec_clock : 509102.143362 2014-01-07 19:07:32 .MIN_vruntime : 0.000001 2014-01-07 19:07:32 .min_vruntime : 8068793.190591 2014-01-07 19:07:32 .max_vruntime : 0.000001 2014-01-07 19:07:32 .spread : 0.000000 2014-01-07 19:07:32 .spread0 : -2048298.095658 2014-01-07 19:07:32 .nr_spread_over : 3630 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:32 .load_avg : 0.000000 2014-01-07 19:07:32 .load_period : 0.000000 2014-01-07 19:07:32 .load_contrib : 0 2014-01-07 19:07:32 .load_tg : 0 2014-01-07 19:07:32 2014-01-07 19:07:32 rt_rq[4]:/ 2014-01-07 19:07:32 .rt_nr_running : 0 2014-01-07 19:07:32 .rt_throttled : 0 2014-01-07 19:07:32 .rt_time : 0.000000 2014-01-07 19:07:32 .rt_runtime : 950.000000 2014-01-07 19:07:32 2014-01-07 19:07:32 runnable tasks: 2014-01-07 19:07:32 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:32 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:32 2014-01-07 19:07:32 cpu#5, 2593.628 MHz 2014-01-07 19:07:32 .nr_running : 0 2014-01-07 19:07:32 .load : 0 2014-01-07 19:07:33 .nr_switches : 18843536 2014-01-07 19:07:33 .nr_load_updates : 972188 2014-01-07 19:07:33 .nr_uninterruptible : 40 2014-01-07 19:07:33 .next_balance : 4301.196001 2014-01-07 19:07:33 .curr->pid : 0 2014-01-07 19:07:33 .clock : 6516890.433874 2014-01-07 19:07:33 .cpu_load[0] : 0 2014-01-07 19:07:33 .cpu_load[1] : 0 2014-01-07 19:07:33 .cpu_load[2] : 0 2014-01-07 19:07:33 .cpu_load[3] : 0 2014-01-07 19:07:33 .cpu_load[4] : 0 2014-01-07 19:07:33 .yld_count : 0 2014-01-07 19:07:33 .sched_switch : 0 2014-01-07 19:07:33 .sched_count : 19755076 2014-01-07 19:07:33 .sched_goidle : 8936994 2014-01-07 19:07:33 .avg_idle : 1000000 2014-01-07 19:07:33 .ttwu_count : 9810151 2014-01-07 19:07:33 .ttwu_local : 1359556 2014-01-07 19:07:33 .bkl_count : 143 2014-01-07 19:07:33 2014-01-07 19:07:33 cfs_rq[5]:/ 2014-01-07 19:07:33 .exec_clock : 496746.352998 2014-01-07 19:07:33 .MIN_vruntime : 0.000001 2014-01-07 19:07:33 .min_vruntime : 8086457.985186 2014-01-07 19:07:33 .max_vruntime : 0.000001 2014-01-07 19:07:33 .spread : 0.000000 2014-01-07 19:07:33 .spread0 : -2030633.301063 2014-01-07 19:07:33 .nr_spread_over : 3565 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .load_avg : 0.000000 2014-01-07 19:07:33 .load_period : 0.000000 2014-01-07 19:07:33 .load_contrib : 0 2014-01-07 19:07:33 .load_tg : 0 2014-01-07 19:07:33 2014-01-07 19:07:33 rt_rq[5]:/ 2014-01-07 19:07:33 .rt_nr_running : 0 2014-01-07 19:07:33 .rt_throttled : 0 2014-01-07 19:07:33 .rt_time : 0.000000 2014-01-07 19:07:33 .rt_runtime : 950.000000 2014-01-07 19:07:33 2014-01-07 19:07:33 runnable tasks: 2014-01-07 19:07:33 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:33 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:33 2014-01-07 19:07:33 cpu#6, 2593.628 MHz 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .nr_switches : 17404684 2014-01-07 19:07:33 .nr_load_updates : 881663 2014-01-07 19:07:33 .nr_uninterruptible : 15 2014-01-07 19:07:33 .next_balance : 4301.195990 2014-01-07 19:07:33 .curr->pid : 0 2014-01-07 19:07:33 .clock : 6516887.508230 2014-01-07 19:07:33 .cpu_load[0] : 0 2014-01-07 19:07:33 .cpu_load[1] : 0 2014-01-07 19:07:33 .cpu_load[2] : 0 2014-01-07 19:07:33 .cpu_load[3] : 0 2014-01-07 19:07:33 .cpu_load[4] : 0 2014-01-07 19:07:33 .yld_count : 0 2014-01-07 19:07:33 .sched_switch : 0 2014-01-07 19:07:33 .sched_count : 18241720 2014-01-07 19:07:33 .sched_goidle : 8276300 2014-01-07 19:07:33 .avg_idle : 1000000 2014-01-07 19:07:33 .ttwu_count : 9031203 2014-01-07 19:07:33 .ttwu_local : 1819022 2014-01-07 19:07:33 .bkl_count : 38 2014-01-07 19:07:33 2014-01-07 19:07:33 cfs_rq[6]:/ 2014-01-07 19:07:33 .exec_clock : 400983.542585 2014-01-07 19:07:33 .MIN_vruntime : 0.000001 2014-01-07 19:07:33 .min_vruntime : 8305978.922386 2014-01-07 19:07:33 .max_vruntime : 0.000001 2014-01-07 19:07:33 .spread : 0.000000 2014-01-07 19:07:33 .spread0 : -1811112.363863 2014-01-07 19:07:33 .nr_spread_over : 3926 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .load_avg : 0.000000 2014-01-07 19:07:33 .load_period : 0.000000 2014-01-07 19:07:33 .load_contrib : 0 2014-01-07 19:07:33 .load_tg : 0 2014-01-07 19:07:33 2014-01-07 19:07:33 rt_rq[6]:/ 2014-01-07 19:07:33 .rt_nr_running : 0 2014-01-07 19:07:33 .rt_throttled : 0 2014-01-07 19:07:33 .rt_time : 0.000000 2014-01-07 19:07:33 .rt_runtime : 950.000000 2014-01-07 19:07:33 2014-01-07 19:07:33 runnable tasks: 2014-01-07 19:07:33 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:33 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:33 2014-01-07 19:07:33 cpu#7, 2593.628 MHz 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .nr_switches : 13998995 2014-01-07 19:07:33 .nr_load_updates : 865024 2014-01-07 19:07:33 .nr_uninterruptible : 3 2014-01-07 19:07:33 .next_balance : 4301.196652 2014-01-07 19:07:33 .curr->pid : 0 2014-01-07 19:07:33 .clock : 6517540.184621 2014-01-07 19:07:33 .cpu_load[0] : 0 2014-01-07 19:07:33 .cpu_load[1] : 0 2014-01-07 19:07:33 .cpu_load[2] : 0 2014-01-07 19:07:33 .cpu_load[3] : 0 2014-01-07 19:07:33 .cpu_load[4] : 0 2014-01-07 19:07:33 .yld_count : 0 2014-01-07 19:07:33 .sched_switch : 0 2014-01-07 19:07:33 .sched_count : 14656339 2014-01-07 19:07:33 .sched_goidle : 6622011 2014-01-07 19:07:33 .avg_idle : 1000000 2014-01-07 19:07:33 .ttwu_count : 7281824 2014-01-07 19:07:33 .ttwu_local : 1556432 2014-01-07 19:07:33 .bkl_count : 30 2014-01-07 19:07:33 2014-01-07 19:07:33 cfs_rq[7]:/ 2014-01-07 19:07:33 .exec_clock : 345254.166504 2014-01-07 19:07:33 .MIN_vruntime : 0.000001 2014-01-07 19:07:33 .min_vruntime : 8680497.196401 2014-01-07 19:07:33 .max_vruntime : 0.000001 2014-01-07 19:07:33 .spread : 0.000000 2014-01-07 19:07:33 .spread0 : -1436594.089848 2014-01-07 19:07:33 .nr_spread_over : 3918 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .load_avg : 0.000000 2014-01-07 19:07:33 .load_period : 0.000000 2014-01-07 19:07:33 .load_contrib : 0 2014-01-07 19:07:33 .load_tg : 0 2014-01-07 19:07:33 2014-01-07 19:07:33 rt_rq[7]:/ 2014-01-07 19:07:33 .rt_nr_running : 0 2014-01-07 19:07:33 .rt_throttled : 0 2014-01-07 19:07:33 .rt_time : 0.000000 2014-01-07 19:07:33 .rt_runtime : 950.000000 2014-01-07 19:07:33 2014-01-07 19:07:33 runnable tasks: 2014-01-07 19:07:33 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:33 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:33 2014-01-07 19:07:33 cpu#8, 2593.628 MHz 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .nr_switches : 16061225 2014-01-07 19:07:33 .nr_load_updates : 811723 2014-01-07 19:07:33 .nr_uninterruptible : 40 2014-01-07 19:07:33 .next_balance : 4301.196978 2014-01-07 19:07:33 .curr->pid : 0 2014-01-07 19:07:33 .clock : 6517881.354130 2014-01-07 19:07:33 .cpu_load[0] : 0 2014-01-07 19:07:33 .cpu_load[1] : 0 2014-01-07 19:07:33 .cpu_load[2] : 0 2014-01-07 19:07:33 .cpu_load[3] : 0 2014-01-07 19:07:33 .cpu_load[4] : 0 2014-01-07 19:07:33 .yld_count : 0 2014-01-07 19:07:33 .sched_switch : 0 2014-01-07 19:07:33 .sched_count : 19279023 2014-01-07 19:07:33 .sched_goidle : 7534617 2014-01-07 19:07:33 .avg_idle : 1000000 2014-01-07 19:07:33 .ttwu_count : 8425284 2014-01-07 19:07:33 .ttwu_local : 1223425 2014-01-07 19:07:33 .bkl_count : 7756 2014-01-07 19:07:33 2014-01-07 19:07:33 cfs_rq[8]:/ 2014-01-07 19:07:33 .exec_clock : 495920.848687 2014-01-07 19:07:33 .MIN_vruntime : 0.000001 2014-01-07 19:07:33 .min_vruntime : 9048880.588890 2014-01-07 19:07:33 .max_vruntime : 0.000001 2014-01-07 19:07:33 .spread : 0.000000 2014-01-07 19:07:33 .spread0 : -1068210.697359 2014-01-07 19:07:33 .nr_spread_over : 4614 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .load_avg : 0.000000 2014-01-07 19:07:33 .load_period : 0.000000 2014-01-07 19:07:33 .load_contrib : 0 2014-01-07 19:07:33 .load_tg : 0 2014-01-07 19:07:33 2014-01-07 19:07:33 rt_rq[8]:/ 2014-01-07 19:07:33 .rt_nr_running : 0 2014-01-07 19:07:33 .rt_throttled : 0 2014-01-07 19:07:33 .rt_time : 0.000000 2014-01-07 19:07:33 .rt_runtime : 950.000000 2014-01-07 19:07:33 2014-01-07 19:07:33 runnable tasks: 2014-01-07 19:07:33 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:33 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:33 2014-01-07 19:07:33 cpu#9, 2593.628 MHz 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .nr_switches : 16478536 2014-01-07 19:07:33 .nr_load_updates : 1306811 2014-01-07 19:07:33 .nr_uninterruptible : 37 2014-01-07 19:07:33 .next_balance : 4301.197152 2014-01-07 19:07:33 .curr->pid : 0 2014-01-07 19:07:33 .clock : 6518050.995473 2014-01-07 19:07:33 .cpu_load[0] : 0 2014-01-07 19:07:33 .cpu_load[1] : 0 2014-01-07 19:07:33 .cpu_load[2] : 0 2014-01-07 19:07:33 .cpu_load[3] : 0 2014-01-07 19:07:33 .cpu_load[4] : 0 2014-01-07 19:07:33 .yld_count : 0 2014-01-07 19:07:33 .sched_switch : 0 2014-01-07 19:07:33 .sched_count : 19994634 2014-01-07 19:07:33 .sched_goidle : 7801692 2014-01-07 19:07:33 .avg_idle : 587893 2014-01-07 19:07:33 .ttwu_count : 8594496 2014-01-07 19:07:33 .ttwu_local : 762998 2014-01-07 19:07:33 .bkl_count : 154 2014-01-07 19:07:33 2014-01-07 19:07:33 cfs_rq[9]:/ 2014-01-07 19:07:33 .exec_clock : 475937.998592 2014-01-07 19:07:33 .MIN_vruntime : 0.000001 2014-01-07 19:07:33 .min_vruntime : 9488039.029134 2014-01-07 19:07:33 .max_vruntime : 0.000001 2014-01-07 19:07:33 .spread : 0.000000 2014-01-07 19:07:33 .spread0 : -629052.257115 2014-01-07 19:07:33 .nr_spread_over : 4501 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .load_avg : 0.000000 2014-01-07 19:07:33 .load_period : 0.000000 2014-01-07 19:07:33 .load_contrib : 0 2014-01-07 19:07:33 .load_tg : 0 2014-01-07 19:07:33 2014-01-07 19:07:33 rt_rq[9]:/ 2014-01-07 19:07:33 .rt_nr_running : 0 2014-01-07 19:07:33 .rt_throttled : 0 2014-01-07 19:07:33 .rt_time : 0.000000 2014-01-07 19:07:33 .rt_runtime : 950.000000 2014-01-07 19:07:33 2014-01-07 19:07:33 runnable tasks: 2014-01-07 19:07:33 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:33 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:33 2014-01-07 19:07:33 cpu#10, 2593.628 MHz 2014-01-07 19:07:33 .nr_running : 0 2014-01-07 19:07:33 .load : 0 2014-01-07 19:07:33 .nr_switches : 15304683 2014-01-07 19:07:33 .nr_load_updates : 902336 2014-01-07 19:07:33 .nr_uninterruptible : 15 2014-01-07 19:07:33 .next_balance : 4301.196428 2014-01-07 19:07:33 .curr->pid : 0 2014-01-07 19:07:33 .clock : 6517328.564710 2014-01-07 19:07:33 .cpu_load[0] : 0 2014-01-07 19:07:33 .cpu_load[1] : 0 2014-01-07 19:07:33 .cpu_load[2] : 0 2014-01-07 19:07:33 .cpu_load[3] : 0 2014-01-07 19:07:33 .cpu_load[4] : 0 2014-01-07 19:07:33 .yld_count : 0 2014-01-07 19:07:33 .sched_switch : 0 2014-01-07 19:07:34 .sched_count : 16882616 2014-01-07 19:07:34 .sched_goidle : 7260861 2014-01-07 19:07:34 .avg_idle : 1000000 2014-01-07 19:07:34 .ttwu_count : 7938910 2014-01-07 19:07:34 .ttwu_local : 624181 2014-01-07 19:07:34 .bkl_count : 31 2014-01-07 19:07:34 2014-01-07 19:07:34 cfs_rq[10]:/ 2014-01-07 19:07:34 .exec_clock : 376979.954567 2014-01-07 19:07:34 .MIN_vruntime : 0.000001 2014-01-07 19:07:34 .min_vruntime : 9384899.691519 2014-01-07 19:07:34 .max_vruntime : 0.000001 2014-01-07 19:07:34 .spread : 0.000000 2014-01-07 19:07:34 .spread0 : -732191.594730 2014-01-07 19:07:34 .nr_spread_over : 4636 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .load_avg : 0.000000 2014-01-07 19:07:34 .load_period : 0.000000 2014-01-07 19:07:34 .load_contrib : 0 2014-01-07 19:07:34 .load_tg : 0 2014-01-07 19:07:34 2014-01-07 19:07:34 rt_rq[10]:/ 2014-01-07 19:07:34 .rt_nr_running : 0 2014-01-07 19:07:34 .rt_throttled : 0 2014-01-07 19:07:34 .rt_time : 0.025615 2014-01-07 19:07:34 .rt_runtime : 950.000000 2014-01-07 19:07:34 2014-01-07 19:07:34 runnable tasks: 2014-01-07 19:07:34 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:34 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:34 2014-01-07 19:07:34 cpu#11, 2593.628 MHz 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .nr_switches : 12109912 2014-01-07 19:07:34 .nr_load_updates : 932055 2014-01-07 19:07:34 .nr_uninterruptible : 5 2014-01-07 19:07:34 .next_balance : 4301.197540 2014-01-07 19:07:34 .curr->pid : 0 2014-01-07 19:07:34 .clock : 6518448.199471 2014-01-07 19:07:34 .cpu_load[0] : 0 2014-01-07 19:07:34 .cpu_load[1] : 0 2014-01-07 19:07:34 .cpu_load[2] : 0 2014-01-07 19:07:34 .cpu_load[3] : 0 2014-01-07 19:07:34 .cpu_load[4] : 0 2014-01-07 19:07:34 .yld_count : 0 2014-01-07 19:07:34 .sched_switch : 0 2014-01-07 19:07:34 .sched_count : 12936691 2014-01-07 19:07:34 .sched_goidle : 5719931 2014-01-07 19:07:34 .avg_idle : 695443 2014-01-07 19:07:34 .ttwu_count : 6287410 2014-01-07 19:07:34 .ttwu_local : 609502 2014-01-07 19:07:34 .bkl_count : 10 2014-01-07 19:07:34 2014-01-07 19:07:34 cfs_rq[11]:/ 2014-01-07 19:07:34 .exec_clock : 320226.526541 2014-01-07 19:07:34 .MIN_vruntime : 0.000001 2014-01-07 19:07:34 .min_vruntime : 9661441.852039 2014-01-07 19:07:34 .max_vruntime : 0.000001 2014-01-07 19:07:34 .spread : 0.000000 2014-01-07 19:07:34 .spread0 : -455649.434210 2014-01-07 19:07:34 .nr_spread_over : 4686 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .load_avg : 0.000000 2014-01-07 19:07:34 .load_period : 0.000000 2014-01-07 19:07:34 .load_contrib : 0 2014-01-07 19:07:34 .load_tg : 0 2014-01-07 19:07:34 2014-01-07 19:07:34 rt_rq[11]:/ 2014-01-07 19:07:34 .rt_nr_running : 0 2014-01-07 19:07:34 .rt_throttled : 0 2014-01-07 19:07:34 .rt_time : 0.000000 2014-01-07 19:07:34 .rt_runtime : 950.000000 2014-01-07 19:07:34 2014-01-07 19:07:34 runnable tasks: 2014-01-07 19:07:34 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:34 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:34 2014-01-07 19:07:34 cpu#12, 2593.628 MHz 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .nr_switches : 18575641 2014-01-07 19:07:34 .nr_load_updates : 1121316 2014-01-07 19:07:34 .nr_uninterruptible : 43 2014-01-07 19:07:34 .next_balance : 4301.197728 2014-01-07 19:07:34 .curr->pid : 0 2014-01-07 19:07:34 .clock : 6518636.815261 2014-01-07 19:07:34 .cpu_load[0] : 0 2014-01-07 19:07:34 .cpu_load[1] : 0 2014-01-07 19:07:34 .cpu_load[2] : 0 2014-01-07 19:07:34 .cpu_load[3] : 0 2014-01-07 19:07:34 .cpu_load[4] : 0 2014-01-07 19:07:34 .yld_count : 0 2014-01-07 19:07:34 .sched_switch : 0 2014-01-07 19:07:34 .sched_count : 19550319 2014-01-07 19:07:34 .sched_goidle : 8772530 2014-01-07 19:07:34 .avg_idle : 876733 2014-01-07 19:07:34 .ttwu_count : 9701379 2014-01-07 19:07:34 .ttwu_local : 651670 2014-01-07 19:07:34 .bkl_count : 7 2014-01-07 19:07:34 2014-01-07 19:07:34 cfs_rq[12]:/ 2014-01-07 19:07:34 .exec_clock : 515240.199220 2014-01-07 19:07:34 .MIN_vruntime : 0.000001 2014-01-07 19:07:34 .min_vruntime : 8963356.184455 2014-01-07 19:07:34 .max_vruntime : 0.000001 2014-01-07 19:07:34 .spread : 0.000000 2014-01-07 19:07:34 .spread0 : -1153735.101794 2014-01-07 19:07:34 .nr_spread_over : 4074 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .load_avg : 0.000000 2014-01-07 19:07:34 .load_period : 0.000000 2014-01-07 19:07:34 .load_contrib : 0 2014-01-07 19:07:34 .load_tg : 0 2014-01-07 19:07:34 2014-01-07 19:07:34 rt_rq[12]:/ 2014-01-07 19:07:34 .rt_nr_running : 0 2014-01-07 19:07:34 .rt_throttled : 0 2014-01-07 19:07:34 .rt_time : 0.000000 2014-01-07 19:07:34 .rt_runtime : 950.000000 2014-01-07 19:07:34 2014-01-07 19:07:34 runnable tasks: 2014-01-07 19:07:34 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:34 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:34 2014-01-07 19:07:34 cpu#13, 2593.628 MHz 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .nr_switches : 18088000 2014-01-07 19:07:34 .nr_load_updates : 1022088 2014-01-07 19:07:34 .nr_uninterruptible : 32 2014-01-07 19:07:34 .next_balance : 4301.197920 2014-01-07 19:07:34 .curr->pid : 0 2014-01-07 19:07:34 .clock : 6518825.431138 2014-01-07 19:07:34 .cpu_load[0] : 0 2014-01-07 19:07:34 .cpu_load[1] : 0 2014-01-07 19:07:34 .cpu_load[2] : 0 2014-01-07 19:07:34 .cpu_load[3] : 0 2014-01-07 19:07:34 .cpu_load[4] : 0 2014-01-07 19:07:34 .yld_count : 0 2014-01-07 19:07:34 .sched_switch : 0 2014-01-07 19:07:34 scsi host7: ib_srp: SRP reset_host called 2014-01-07 19:07:34 .sched_count : 18855449 2014-01-07 19:07:34 .sched_goidle : 8554210 2014-01-07 19:07:34 .avg_idle : 1000000 2014-01-07 19:07:34 .ttwu_count : 9429438 2014-01-07 19:07:34 .ttwu_local : 637737 2014-01-07 19:07:34 .bkl_count : 18 2014-01-07 19:07:34 2014-01-07 19:07:34 cfs_rq[13]:/ 2014-01-07 19:07:34 .exec_clock : 491107.996013 2014-01-07 19:07:34 .MIN_vruntime : 0.000001 2014-01-07 19:07:34 .min_vruntime : 9002320.840370 2014-01-07 19:07:34 .max_vruntime : 0.000001 2014-01-07 19:07:34 .spread : 0.000000 2014-01-07 19:07:34 .spread0 : -1114770.445879 2014-01-07 19:07:34 .nr_spread_over : 4314 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .load_avg : 0.000000 2014-01-07 19:07:34 .load_period : 0.000000 2014-01-07 19:07:34 .load_contrib : 0 2014-01-07 19:07:34 .load_tg : 0 2014-01-07 19:07:34 2014-01-07 19:07:34 rt_rq[13]:/ 2014-01-07 19:07:34 .rt_nr_running : 0 2014-01-07 19:07:34 .rt_throttled : 0 2014-01-07 19:07:34 .rt_time : 0.000000 2014-01-07 19:07:34 .rt_runtime : 950.000000 2014-01-07 19:07:34 2014-01-07 19:07:34 runnable tasks: 2014-01-07 19:07:34 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:34 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:34 2014-01-07 19:07:34 cpu#14, 2593.628 MHz 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .nr_switches : 17110976 2014-01-07 19:07:34 .nr_load_updates : 901161 2014-01-07 19:07:34 .nr_uninterruptible : 18 2014-01-07 19:07:34 .next_balance : 4301.198470 2014-01-07 19:07:34 .curr->pid : 0 2014-01-07 19:07:34 .clock : 6518859.420617 2014-01-07 19:07:34 .cpu_load[0] : 0 2014-01-07 19:07:34 .cpu_load[1] : 0 2014-01-07 19:07:34 .cpu_load[2] : 0 2014-01-07 19:07:34 .cpu_load[3] : 0 2014-01-07 19:07:34 .cpu_load[4] : 0 2014-01-07 19:07:34 .yld_count : 0 2014-01-07 19:07:34 .sched_switch : 0 2014-01-07 19:07:34 .sched_count : 17912808 2014-01-07 19:07:34 .sched_goidle : 8132570 2014-01-07 19:07:34 .avg_idle : 784630 2014-01-07 19:07:34 .ttwu_count : 8868607 2014-01-07 19:07:34 .ttwu_local : 619254 2014-01-07 19:07:34 .bkl_count : 207 2014-01-07 19:07:34 2014-01-07 19:07:34 cfs_rq[14]:/ 2014-01-07 19:07:34 .exec_clock : 398442.832263 2014-01-07 19:07:34 .MIN_vruntime : 0.000001 2014-01-07 19:07:34 .min_vruntime : 9185174.970757 2014-01-07 19:07:34 .max_vruntime : 0.000001 2014-01-07 19:07:34 .spread : 0.000000 2014-01-07 19:07:34 .spread0 : -931916.315492 2014-01-07 19:07:34 .nr_spread_over : 4405 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .load_avg : 0.000000 2014-01-07 19:07:34 .load_period : 0.000000 2014-01-07 19:07:34 .load_contrib : 0 2014-01-07 19:07:34 .load_tg : 0 2014-01-07 19:07:34 2014-01-07 19:07:34 rt_rq[14]:/ 2014-01-07 19:07:34 .rt_nr_running : 0 2014-01-07 19:07:34 .rt_throttled : 0 2014-01-07 19:07:34 .rt_time : 0.000000 2014-01-07 19:07:34 .rt_runtime : 950.000000 2014-01-07 19:07:34 2014-01-07 19:07:34 runnable tasks: 2014-01-07 19:07:34 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:34 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:34 2014-01-07 19:07:34 cpu#15, 2593.628 MHz 2014-01-07 19:07:34 .nr_running : 0 2014-01-07 19:07:34 .load : 0 2014-01-07 19:07:34 .nr_switches : 13490035 2014-01-07 19:07:34 .nr_load_updates : 843070 2014-01-07 19:07:34 .nr_uninterruptible : 1 2014-01-07 19:07:34 .next_balance : 4301.197963 2014-01-07 19:07:34 .curr->pid : 0 2014-01-07 19:07:34 .clock : 6518856.442077 2014-01-07 19:07:34 .cpu_load[0] : 0 2014-01-07 19:07:34 .cpu_load[1] : 0 2014-01-07 19:07:34 .cpu_load[2] : 0 2014-01-07 19:07:34 .cpu_load[3] : 0 2014-01-07 19:07:34 .cpu_load[4] : 0 2014-01-07 19:07:34 .yld_count : 0 2014-01-07 19:07:34 .sched_switch : 0 2014-01-07 19:07:34 .sched_count : 14060454 2014-01-07 19:07:34 .sched_goidle : 6387091 2014-01-07 19:07:34 .avg_idle : 1000000 2014-01-07 19:07:34 .ttwu_count : 6998500 2014-01-07 19:07:34 .ttwu_local : 600689 2014-01-07 19:07:34 .bkl_count : 14 2014-01-07 19:07:34 2014-01-07 19:07:34 cfs_rq[15]:/ 2014-01-07 19:07:34 .exec_clock : 338985.317579 2014-01-07 19:07:34 .MIN_vruntime : 0.000001 2014-01-07 19:07:34 .min_vruntime : 9533427.957305 2014-01-07 19:07:34 .max_vruntime : 0.000001 2014-01-07 19:07:34 .spread : 0.000000 2014-01-07 19:07:34 .spread0 : -583663.328944 2014-01-07 19:07:35 .nr_spread_over : 4585 2014-01-07 19:07:35 .nr_running : 0 2014-01-07 19:07:35 .load : 0 2014-01-07 19:07:35 .load_avg : 0.000000 2014-01-07 19:07:35 .load_period : 0.000000 2014-01-07 19:07:35 .load_contrib : 0 2014-01-07 19:07:35 .load_tg : 0 2014-01-07 19:07:35 2014-01-07 19:07:35 rt_rq[15]:/ 2014-01-07 19:07:35 .rt_nr_running : 0 2014-01-07 19:07:35 .rt_throttled : 0 2014-01-07 19:07:35 .rt_time : 0.000000 2014-01-07 19:07:35 .rt_runtime : 950.000000 2014-01-07 19:07:35 2014-01-07 19:07:35 runnable tasks: 2014-01-07 19:07:35 task PID tree-key switches prio exec-runtime sum-exec sum-sleep 2014-01-07 19:07:35 ---------------------------------------------------------------------------------------------------------- 2014-01-07 19:07:35 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000031 2014-01-07 19:07:35 Lustre: lustre-OST0002: Client 43dfeb08-a728-76b7-7acf-7928adb52f03 (at 192.168.118.139@o2ib1) reconnecting 2014-01-07 19:07:35 Lustre: lustre-OST0002: Client 8b82cd7d-c2d1-6192-199c-7a9c11c1bd7a (at 192.168.118.102@o2ib1) reconnecting 2014-01-07 19:07:35 Lustre: lustre-OST0002: Client 63243c5e-b962-c0ce-0339-931c5e4a1045 (at 192.168.118.114@o2ib1) refused reconnection, still busy with 1 active RPCs 2014-01-07 19:07:35 Lustre: ost_io: This server is not able to keep up with request traffic (cpu-bound). 2014-01-07 19:07:35 Lustre: 7392:0:(service.c:1499:ptlrpc_at_check_timed()) earlyQ=2 reqQ=0 recA=94, svcEst=115, delay=2(jiff) 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000002 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000009 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000000d 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000007 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000033 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000023 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000002b 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000013 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000000e 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000000c 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000028 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000003d 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000027 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000015 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000000 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000001f 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 0000000000000034 2014-01-07 19:07:35 scsi host6: Null scmnd for RSP w/tag 000000000000000b 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000020 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000017 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000033 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 000000000000002d 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000030 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000009 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 000000000000000f 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 000000000000000c 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000028 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 000000000000003a 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000014 2014-01-07 19:07:35 scsi host7: Null scmnd for RSP w/tag 0000000000000019 2014-01-07 19:07:37 scsi host7: ib_srp: connection closed 2014-01-07 19:07:47 device-mapper: multipath: Failing path 8:16. 2014-01-07 19:07:56 Lustre: lustre-OST0002: Client 63243c5e-b962-c0ce-0339-931c5e4a1045 (at 192.168.118.114@o2ib1) reconnecting 2014-01-07 19:07:56 Lustre: Skipped 6 previous similar messages