==> /tmp/serial_fre1311_out <== Lustre: DEBUG MARKER: excepting tests: 61d 53a 53d Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: == replay-single test 70b: dbench 1mdts recovery; 2 clients == 02:56:32 (1436496992) Lustre: DEBUG MARKER: Started rundbench load pid=20896 ... LustreError: 21022:0:(llite_lib.c:1647:ll_setattr_raw()) [0x200019a43:0xfd4:0x0]HSM set dirty failed: rc2 = -22 Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 LustreError: 21022:0:(llite_lib.c:1647:ll_setattr_raw()) [0x200019a43:0xfe6:0x0]HSM set dirty failed: rc2 = -22 LustreError: 21022:0:(llite_lib.c:1647:ll_setattr_raw()) Skipped 5 previous similar messages Lustre: DEBUG MARKER: test_70b fail mds1 1 times LustreError: 21022:0:(llite_lib.c:1647:ll_setattr_raw()) [0x200019a43:0xffa:0x0]HSM set dirty failed: rc2 = -22 LustreError: 11-0: lustre-MDT0000-mdc-ffff880119508c00: operation mds_close to node 192.168.113.9@tcp failed: rc = -19 LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-mdc-ffff880119508c00: Connection to lustre-MDT0000 (at 192.168.113.9@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 3 previous similar messages Lustre: 6272:0:(client.c:2018:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1436497005/real 1436497005] req@ffff8801011399c0 x1506268646965308/t0(0) o400->MGC192.168.113.9@tcp@192.168.113.9@tcp:26/25 lens 224/224 e 0 to 1 dl 1436497012 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 6272:0:(client.c:2018:ptlrpc_expire_one_request()) Skipped 32 previous similar messages LustreError: 166-1: MGC192.168.113.9@tcp: Connection to MGS (at 192.168.113.9@tcp) was lost; in progress operations using this service will fail LustreError: Skipped 4 previous similar messages Lustre: Evicted from MGS (at 192.168.113.9@tcp) after server handle changed from 0xd2cf4c1eb6171615 to 0xd2cf4c1eb6192e75 Lustre: Skipped 4 previous similar messages Lustre: MGC192.168.113.9@tcp: Connection restored to MGS (at 192.168.113.9@tcp) Lustre: Skipped 15 previous similar messages LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) Skipped 1 previous similar message Lustre: 6271:0:(client.c:2018:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1436497087/real 1436497087] req@ffff88011be1d6c0 x1506268646956308/t300647712767(300647712767) o101->lustre-MDT0000-mdc-ffff880119508c00@192.168.113.9@tcp:12/10 lens 872/544 e 3 to 1 dl 1436497089 ref 2 fl Rpc:XP/6/ffffffff rc 0/-1 Lustre: 6271:0:(client.c:2018:ptlrpc_expire_one_request()) Skipped 10 previous similar messages LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) Skipped 2 previous similar messages LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) Skipped 4 previous similar messages LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) request replay timed out, restarting recovery LustreError: 6271:0:(client.c:2814:ptlrpc_replay_interpret()) Skipped 9 previous similar messages LustreError: 167-0: lustre-MDT0000-mdc-ffff880119508c00: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. LustreError: 21022:0:(file.c:184:ll_close_inode_openhandle()) lustre-clilmv-ffff880119508c00: inode [0x200019a43:0xffb:0x0] mdc close failed: rc = -5 LustreError: 21532:0:(vvp_io.c:1475:vvp_io_init()) lustre: refresh file layout [0x200019a43:0xfd4:0x0] error -5. LustreError: 21022:0:(file.c:184:ll_close_inode_openhandle()) Skipped 6 previous similar messages Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 189 sec Lustre: DEBUG MARKER: replay-single test_70b: @@@@@@ FAIL: dbench stopped on some of fre1311,fre1312! Lustre: DEBUG MARKER: replay-single test_70b: @@@@@@ FAIL: rundbench load on fre1311,fre1312 failed! SysRq : Show State task PC stack pid father init S 0000000000000001 0 1 0 0x00000000 ffff88011e7ab908 0000000000000082 0000000000000000 ffff88011e7ab8cc 00000000192e0b18 ffff88011fc23240 ffff880028216840 0000000000000400 ffff88011e7a9ab8 ffff88011e7abfd8 000000000000fbc8 ffff88011e7a9ab8 Call Trace: [] ? get_page_from_freelist+0x3d1/0x870 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? get_page_from_freelist+0x3d1/0x870 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? vsnprintf+0x450/0x5e0 [] ? d_lookup+0x35/0x60 [] core_sys_select+0x18a/0x2c0 [] ? security_task_wait+0x16/0x20 [] ? wait_consider_task+0x9d/0xb20 [] ? remove_wait_queue+0x3c/0x50 [] ? do_wait+0x17f/0x240 [] ? pvclock_clocksource_read+0x58/0xd0 [] sys_select+0x47/0x110 [] ? posix_ktime_get_ts+0x11/0x20 [] system_call_fastpath+0x16/0x1b kthreadd S 0000000000000000 0 2 0 0x00000000 ffff88011e7b1ed0 0000000000000046 ffff88011e7b1f40 ffffffff8100c1a2 ffff88011e7a8aa0 ffff88011e7a8aa0 ffffffff81eb4c88 ffff8801013e3d28 ffff88011e7a9058 ffff88011e7b1fd8 000000000000fbc8 ffff88011e7a9058 Call Trace: [] ? kernel_thread+0x82/0xe0 [] ? kthread+0x0/0xa0 [] kthreadd+0x1b5/0x1c0 [] child_rip+0xa/0x20 [] ? kthreadd+0x0/0x1c0 [] ? child_rip+0x0/0x20 migration/0 S 0000000000000000 0 3 2 0x00000000 ffff88011e7b5e70 0000000000000046 0000000000000000 0000000000000082 ffff88011e7b5df0 ffff88011cdd4080 ffff880028316840 ffff880028316840 ffff88011e7a85f8 ffff88011e7b5fd8 000000000000fbc8 ffff88011e7a85f8 Call Trace: [] migration_thread+0x265/0x2e0 [] ? migration_thread+0x0/0x2e0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksoftirqd/0 S 0000000000000000 0 4 2 0x00000000 ffff88011e7b9ea0 0000000000000046 0000000000000000 ffff88011e7b9e64 0000000000016840 ffff88011fc23040 ffff880028316840 0000000000000400 ffff88011e7b7af8 ffff88011e7b9fd8 000000000000fbc8 ffff88011e7b7af8 Call Trace: [] ksoftirqd+0xd5/0x110 [] ? ksoftirqd+0x0/0x110 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/0 S 0000000000000000 0 5 2 0x00000000 ffff88011e7bbdf0 0000000000000046 0000000000000000 ffffffff81a98a80 0000000000000086 ffffffff81aa6740 ffff88011e7bbd90 ffffffff810b8498 ffff88011e7b7098 ffff88011e7bbfd8 000000000000fbc8 ffff88011e7b7098 Call Trace: [] ? module_refcount+0x58/0x70 [] ? __unlink_module+0x12/0x20 [] ? stop_machine_cpu_stop+0x0/0xf0 [] cpu_stopper_thread+0x125/0x1b0 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? cpu_stopper_thread+0x0/0x1b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 watchdog/0 S 0000000000000000 0 6 2 0x00000000 ffff88011e7bfea0 0000000000000046 0000000000000000 ffffffff8103ea6c ffff88011e7bfe10 ffffffff81014969 ffff88011e7bfe40 ffffffff810a21c5 ffff88011e7b6638 ffff88011e7bffd8 000000000000fbc8 ffff88011e7b6638 Call Trace: [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock+0x9/0x10 [] ? sched_clock_local+0x25/0x90 [] watchdog+0x9a/0xd0 [] ? watchdog+0x0/0xd0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/1 S 0000000000000001 0 7 2 0x00000000 ffff88011e7c3e70 0000000000000046 0000000000000000 0000000000000082 ffff88011e7c3df0 ffff8801197c8aa0 ffff880028216840 ffff880028216840 ffff88011e7c1ab8 ffff88011e7c3fd8 000000000000fbc8 ffff88011e7c1ab8 Call Trace: [] migration_thread+0x265/0x2e0 [] ? migration_thread+0x0/0x2e0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/1 S 0000000000000001 0 8 2 0x00000000 ffff88011e7c5df0 0000000000000046 0000000000000000 000000080000026f 0000000000000082 ffffffff81dfb218 ffff88011e7c5da0 000000008100bb8e ffff88011e7c1058 ffff88011e7c5fd8 000000000000fbc8 ffff88011e7c1058 Call Trace: [] ? stop_machine_cpu_stop+0x0/0xf0 [] cpu_stopper_thread+0x125/0x1b0 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? cpu_stopper_thread+0x0/0x1b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksoftirqd/1 S 0000000000000001 0 9 2 0x00000000 ffff88011e7cbea0 0000000000000046 0000000000000000 ffff88011e7cbe64 0000000000016840 ffff88011fc23240 ffff880028216840 0000000000000400 ffff88011e7c05f8 ffff88011e7cbfd8 000000000000fbc8 ffff88011e7c05f8 Call Trace: [] ksoftirqd+0xd5/0x110 [] ? ksoftirqd+0x0/0x110 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 watchdog/1 S 0000000000000001 0 10 2 0x00000000 ffff88011e7d5ea0 0000000000000046 0000000000000000 ffffffff8103ea6c ffff88011e7d5e10 ffffffff81014969 ffff88011e7d5e40 ffffffff810a21c5 ffff88011e7d1098 ffff88011e7d5fd8 000000000000fbc8 ffff88011e7d1098 Call Trace: [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock+0x9/0x10 [] ? sched_clock_local+0x25/0x90 [] watchdog+0x9a/0xd0 [] ? watchdog+0x0/0xd0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 events/0 S 0000000000000000 0 11 2 0x00000000 ffff88011dc01e30 0000000000000046 0000000000000000 ffff880028219440 00000000ffffffff ffff880028213460 ffff88011dc01fd8 ffff880028219448 ffff88011e7d0638 ffff88011dc01fd8 000000000000fbc8 ffff88011e7d0638 Call Trace: [] ? vmstat_update+0x0/0x40 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 events/1 S 0000000000000001 0 12 2 0x00000000 ffff88011dc05e30 0000000000000046 0000000000000000 ffff880028319440 00000000ffffffff ffff880028313460 ffff88011dc05fd8 ffff880028319448 ffff88011dc03ab8 ffff88011dc05fd8 000000000000fbc8 ffff88011dc03ab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? vmstat_update+0x0/0x40 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 cgroup S 0000000000000001 0 13 2 0x00000000 ffff88011dc07e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc03058 ffff88011dc07fd8 000000000000fbc8 ffff88011dc03058 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khelper S 0000000000000000 0 14 2 0x00000000 ffff88011dc0be30 0000000000000046 0000000000000000 0000000000000001 ffff88011dc0be30 ffff88010265c2c0 0000000000000000 0000000000000000 ffff88011dc025f8 ffff88011dc0bfd8 000000000000fbc8 ffff88011dc025f8 Call Trace: [] ? __call_usermodehelper+0x0/0xd0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 netns S 0000000000000001 0 15 2 0x00000000 ffff88011dc3fe30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc3daf8 ffff88011dc3ffd8 000000000000fbc8 ffff88011dc3daf8 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 async/mgr S 0000000000000000 0 16 2 0x00000000 ffff88011dc51e70 0000000000000046 0000000000000000 0000000000000000 ffff88011dc51df0 ffffffff810555ac ffff88011dc51df0 0000000000000282 ffff88011dc3d098 ffff88011dc51fd8 000000000000fbc8 ffff88011dc3d098 Call Trace: [] ? check_preempt_curr+0x7c/0x90 [] async_manager_thread+0xf3/0x150 [] ? default_wake_function+0x0/0x20 [] ? async_manager_thread+0x0/0x150 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 pm S 0000000000000001 0 17 2 0x00000000 ffff88011dc55e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc3c638 ffff88011dc55fd8 000000000000fbc8 ffff88011dc3c638 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sync_supers S 0000000000000000 0 18 2 0x00000000 ffff88011dcb9ec0 0000000000000046 0000000000000000 ffff88011dcb9e84 ffff88011dcb9ec0 ffff88011fc23240 ffff880028216840 0000000000000800 ffff88011dcb7ab8 ffff88011dcb9fd8 000000000000fbc8 ffff88011dcb7ab8 Call Trace: [] ? bdi_sync_supers+0x0/0x60 [] bdi_sync_supers+0x3b/0x60 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 bdi-default S 0000000000000001 0 19 2 0x00000000 ffff88011dcbbdd0 0000000000000046 0000000000000000 ffff8800282168a8 ffff88011b7a1538 0000000000000286 ffff88011dcbbd70 ffffffff81083e1c ffff88011dcb7058 ffff88011dcbbfd8 000000000000fbc8 ffff88011dcb7058 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] bdi_forker_task+0x263/0x310 [] ? bdi_forker_task+0x0/0x310 [] kthread+0x96/0xa0 [] ? bdi_sync_supers+0x0/0x60 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kintegrityd/0 S 0000000000000000 0 20 2 0x00000000 ffff88011dcbfe30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011dcbfde0 ffffffff8106abeb ffff88011dcb65f8 ffff88011dcbffd8 000000000000fbc8 ffff88011dcb65f8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kintegrityd/1 S 0000000000000001 0 21 2 0x00000000 ffff88011dcc3e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011dcc3de0 ffffffff8106abeb ffff88011dcc1af8 ffff88011dcc3fd8 000000000000fbc8 ffff88011dcc1af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kblockd/0 S 0000000000000000 0 22 2 0x00000000 ffff88011dccbe30 0000000000000046 0000000000000000 0000000000000001 0000000000000001 0000000000000001 ffff880118858070 0000000000000002 ffff88011dcc1098 ffff88011dccbfd8 000000000000fbc8 ffff88011dcc1098 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? cfq_kick_queue+0x0/0x60 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kblockd/1 S 0000000000000001 0 23 2 0x00000000 ffff88011dccfe30 0000000000000046 0000000000000000 ffff8801193a6e68 ffff8801193a6e68 ffff8801193a6e68 ffff8801193a6e68 ffffffff81262420 ffff88011dcc0638 ffff88011dccffd8 000000000000fbc8 ffff88011dcc0638 Call Trace: [] ? blk_unplug_work+0x0/0x70 [] ? prepare_to_wait+0x4e/0x80 [] ? cfq_kick_queue+0x0/0x60 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpid S 0000000000000000 0 24 2 0x00000000 ffff88011de01e30 0000000000000046 ffff88011de01d90 ffffffff81529a8d ffff88011de01e10 ffffffff8106de63 ffff88011de01e10 0000000000000286 ffff88011ddffab8 ffff88011de01fd8 000000000000fbc8 ffff88011ddffab8 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpi_notify S 0000000000000000 0 25 2 0x00000000 ffff88011de03e30 0000000000000046 ffff88011de03d90 ffffffff81529a8d ffff88011de03e10 ffffffff8106de63 ffff88011de03e10 0000000000000286 ffff88011ddff058 ffff88011de03fd8 000000000000fbc8 ffff88011ddff058 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpi_hotplug S 0000000000000000 0 26 2 0x00000000 ffff88011de07e30 0000000000000046 ffff88011de07d90 ffffffff81529a8d ffff88011de07e10 ffffffff8106de63 ffff88011de07e10 0000000000000282 ffff88011ddfe5f8 ffff88011de07fd8 000000000000fbc8 ffff88011ddfe5f8 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_aux S 0000000000000001 0 27 2 0x00000000 ffff88011de89e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011de89de0 ffffffff8106abeb ffff88011de87af8 ffff88011de89fd8 000000000000fbc8 ffff88011de87af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_sff/0 S 0000000000000000 0 28 2 0x00000000 ffff88011de8be30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011de8bde0 ffffffff8106abeb ffff88011de87098 ffff88011de8bfd8 000000000000fbc8 ffff88011de87098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_sff/1 S 0000000000000001 0 29 2 0x00000000 ffff88011def1e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011def1de0 ffffffff8106abeb ffff88011de86638 ffff88011def1fd8 000000000000fbc8 ffff88011de86638 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksuspend_usbd S 0000000000000001 0 30 2 0x00000000 ffff88011def5e30 0000000000000046 0000000000000000 0000000000000402 ffff88011def5df0 ffffffff813cc46c ffff88011def5de0 ffffffff8106abeb ffff88011def3ab8 ffff88011def5fd8 000000000000fbc8 ffff88011def3ab8 Call Trace: [] ? usb_suspend_both+0x1bc/0x340 [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? usb_autosuspend_work+0x0/0x20 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khubd S 0000000000000001 0 31 2 0x00000000 ffff88011def7d60 0000000000000046 0000000000000000 0000000000000000 0000000000000000 000004008103f9d8 00000000ffffffff ffff8801190eec00 ffff88011def3058 ffff88011def7fd8 000000000000fbc8 ffff88011def3058 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] hub_thread+0x379/0x1a40 [] ? dequeue_task_fair+0x12b/0x130 [] ? autoremove_wake_function+0x0/0x40 [] ? hub_thread+0x0/0x1a40 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kseriod S 0000000000000001 0 32 2 0x00000000 ffff88011defbe50 0000000000000046 ffffffffffffffae ffffffff8150d6ca ffff88011defbe10 ffff88011de72b38 ffff88011defbe30 0000000000000282 ffff88011def25f8 ffff88011defbfd8 000000000000fbc8 ffff88011def25f8 Call Trace: [] ? klist_next+0x2a/0xf0 [] ? prepare_to_wait+0x4e/0x80 [] serio_thread+0x39a/0x450 [] ? autoremove_wake_function+0x0/0x40 [] ? serio_thread+0x0/0x450 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md/0 S 0000000000000000 0 33 2 0x00000000 ffff88011deffe30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011deffde0 ffffffff8106abeb ffff88011defdaf8 ffff88011defffd8 000000000000fbc8 ffff88011defdaf8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md/1 S 0000000000000001 0 34 2 0x00000000 ffff88011df01e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011df01de0 ffffffff8106abeb ffff88011defd098 ffff88011df01fd8 000000000000fbc8 ffff88011defd098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md_misc/0 S 0000000000000000 0 35 2 0x00000000 ffff88011df05e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011df05de0 ffffffff8106abeb ffff88011defc638 ffff88011df05fd8 000000000000fbc8 ffff88011defc638 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] ? worker_thread+0x0/0x2a0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md_misc/1 S 0000000000000001 0 36 2 0x00000000 ffff88011df0be30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff88011df0bde0 ffffffff8106abeb ffff88011df09ab8 ffff88011df0bfd8 000000000000fbc8 ffff88011df09ab8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 linkwatch S 0000000000000001 0 37 2 0x00000000 ffff88011df0de30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000002 ffff880028219d88 0000000000000000 ffff88011df09058 ffff88011df0dfd8 000000000000fbc8 ffff88011df09058 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? linkwatch_event+0x0/0x30 [] ? linkwatch_event+0x0/0x30 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khungtaskd S 0000000000000001 0 38 2 0x00000000 ffff880119617dd0 0000000000000046 0000000000000000 ffffffff8160bf20 0000000000000001 0000000000000286 ffff880119617d70 ffffffff81083e1c ffff88011df085f8 ffff880119617fd8 000000000000fbc8 ffff88011df085f8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] watchdog+0x52/0x250 [] ? watchdog+0x0/0x250 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kswapd0 S 0000000000000001 0 39 2 0x00000000 ffff88011961be20 0000000000000046 0000000000000000 0000000281529c7a ffff88002804d000 0000000000000000 0000000000000000 ffffffff81c064c0 ffff880119619af8 ffff88011961bfd8 000000000000fbc8 ffff880119619af8 Call Trace: [] kswapd+0x309/0x3b0 [] ? autoremove_wake_function+0x0/0x40 [] ? kswapd+0x0/0x3b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksmd S 0000000000000001 0 40 2 0x00000000 ffff88011961de10 0000000000000046 0000000000000000 ffff880119618ae0 ffff88011961dda0 ffffffff8106a33b ffff88011961dda0 ffff880119618ae0 ffff880119619098 ffff88011961dfd8 000000000000fbc8 ffff880119619098 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] ksm_scan_thread+0xa5b/0x1120 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? autoremove_wake_function+0x0/0x40 [] ? ksm_scan_thread+0x0/0x1120 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khugepaged S 0000000000000000 0 41 2 0x00000000 ffff8801196b3ce0 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880119618638 ffff8801196b3fd8 000000000000fbc8 ffff880119618638 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? rwsem_down_read_failed+0x26/0x30 [] ? process_timeout+0x0/0x10 [] khugepaged+0x4ec/0x1310 [] ? autoremove_wake_function+0x0/0x40 [] ? khugepaged+0x0/0x1310 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 aio/0 S 0000000000000000 0 42 2 0x00000000 ffff880119725e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880119723ab8 ffff880119725fd8 000000000000fbc8 ffff880119723ab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 aio/1 S 0000000000000001 0 43 2 0x00000000 ffff880119729e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880119723058 ffff880119729fd8 000000000000fbc8 ffff880119723058 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 crypto/0 S 0000000000000000 0 44 2 0x00000000 ffff88011972de30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff8801197225f8 ffff88011972dfd8 000000000000fbc8 ffff8801197225f8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 crypto/1 S 0000000000000001 0 45 2 0x00000000 ffff8801197a1e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011972faf8 ffff8801197a1fd8 000000000000fbc8 ffff88011972faf8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kthrotld/0 S 0000000000000000 0 50 2 0x00000000 ffff8801197d3e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff8801197d3de0 ffffffff8106abeb ffff8801197c85f8 ffff8801197d3fd8 000000000000fbc8 ffff8801197c85f8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kthrotld/1 S 0000000000000001 0 51 2 0x00000000 ffff8801197d7e30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff8801197d7de0 ffffffff8106abeb ffff8801197d5af8 ffff8801197d7fd8 000000000000fbc8 ffff8801197d5af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kpsmoused S 0000000000000000 0 53 2 0x00000000 ffff8801190f7e30 0000000000000046 ffff88011e7a9548 ffff8800282168a8 ffff8801190f7db0 ffffffff8105af80 ffff88011e7a9538 ffff8800282168a8 ffff8801197c9ab8 ffff8801190f7fd8 000000000000fbc8 ffff8801197c9ab8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 usbhid_resume S 0000000000000001 0 54 2 0x00000000 ffff880119129e30 0000000000000046 0000000000000000 ffff8800282168a8 ffff880119129db0 ffffffff8105af80 ffff88011e7a9538 ffff8800282168a8 ffff88011972e638 ffff880119129fd8 000000000000fbc8 ffff88011972e638 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kstriped S 0000000000000000 0 83 2 0x00000000 ffff8801191efe30 0000000000000046 0000000000000000 ffff8800282168a8 ffff8801191efdb0 ffffffff8105af80 ffff8801197d40b8 ffff8800282168a8 ffff880119199af8 ffff8801191effd8 000000000000fbc8 ffff880119199af8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 scsi_eh_0 S 0000000000000000 0 228 2 0x00000000 ffff88011930de20 0000000000000046 0000000000000000 0000000000000282 ffff88011930dde0 ffffffff813a3ba7 ffff88011930dde0 ffffffff813a2538 ffff8801193d4638 ffff88011930dfd8 000000000000fbc8 ffff8801193d4638 Call Trace: [] ? ata_scsi_port_error_handler+0x627/0x710 [] ? ata_scsi_cmd_error_handler+0x128/0x180 [] scsi_error_handler+0x99/0x810 [] ? default_wake_function+0x12/0x20 [] ? scsi_error_handler+0x0/0x810 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 scsi_eh_1 S 0000000000000000 0 229 2 0x00000000 ffff880118879e20 0000000000000046 000000000000000f 0000000000000282 ffff880118879de0 ffffffff813a3ba7 ffff880118879de0 ffffffff813a2538 ffff880119193af8 ffff880118879fd8 000000000000fbc8 ffff880119193af8 Call Trace: [] ? ata_scsi_port_error_handler+0x627/0x710 [] ? ata_scsi_cmd_error_handler+0x128/0x180 [] scsi_error_handler+0x99/0x810 [] ? default_wake_function+0x12/0x20 [] ? scsi_error_handler+0x0/0x810 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 virtio-blk S 0000000000000001 0 273 2 0x00000000 ffff880118875e30 0000000000000046 ffff880118819548 ffff8800283168a8 ffff880118875db0 ffffffff8105af80 ffff880118819538 ffff8800283168a8 ffff8801193e5058 ffff880118875fd8 000000000000fbc8 ffff8801193e5058 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 jbd2/vda1-8 S 0000000000000000 0 283 2 0x00000000 ffff880119337e60 0000000000000046 0000000000001a39 0000000000000000 00000000000000e3 0000000000000000 0000000000000000 0000000000000001 ffff88011891fab8 ffff880119337fd8 000000000000fbc8 ffff88011891fab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] kjournald2+0x1fa/0x220 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? kjournald2+0x0/0x220 [jbd2] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ext4-dio-unwr S 0000000000000000 0 284 2 0x00000000 ffff880118953e30 0000000000000046 ffff880118819548 ffff8800282168a8 ffff880118953db0 ffffffff8105af80 ffff880118819538 ffff8800282168a8 ffff88011918f098 ffff880118953fd8 000000000000fbc8 ffff88011918f098 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 udevd S 0000000000000000 0 357 1 0x00000000 ffff8801193fda58 0000000000000086 ffff8801193fd9e8 ffffffff811a08c6 0000000000000000 ffff880119164aa0 ffffffff81061d00 0000000000000000 ffff88011930a5f8 ffff8801193fdfd8 000000000000fbc8 ffff88011930a5f8 Call Trace: [] ? pollwake+0x56/0x60 [] ? default_wake_function+0x0/0x20 [] schedule_hrtimeout_range+0x13d/0x160 [] ? __pollwait+0x75/0xf0 [] ? add_wait_queue+0x46/0x60 [] ? unix_dgram_poll+0x127/0x1c0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? autoremove_wake_function+0x0/0x40 [] ? generic_file_aio_write+0xba/0x100 [] ? do_sync_write+0xfa/0x140 [] ? sys_recvfrom+0xee/0x180 [] ? vfs_write+0x132/0x1a0 [] sys_poll+0x71/0x100 [] system_call_fastpath+0x16/0x1b virtio-net S 0000000000000000 0 388 2 0x00000000 ffff880119ce3e30 0000000000000046 ffff88011930a088 ffff8800282168a8 ffff880119ce3db0 ffffffff8105af80 ffff88011930a078 ffff8800282168a8 ffff880119359af8 ffff880119ce3fd8 000000000000fbc8 ffff880119359af8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] ? cfq_kick_queue+0x0/0x60 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 vballoon S 0000000000000001 0 393 2 0x00000000 ffff880119fa3e40 0000000000000046 ffff880119fa3db0 ffffffff8105af80 ffff880119398ad8 ffff8800283168a8 ffff880119fa3e10 ffffffff810096f0 ffff880119245ab8 ffff880119fa3fd8 000000000000fbc8 ffff880119245ab8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? __switch_to+0xd0/0x320 [] ? vp_get+0x50/0x70 [virtio_pci] [] balloon+0x204/0x260 [virtio_balloon] [] ? autoremove_wake_function+0x0/0x40 [] ? balloon+0x0/0x260 [virtio_balloon] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kauditd S 0000000000000000 0 693 2 0x00000000 ffff880118959e70 0000000000000046 00000000000000ce ffff88011d38b980 ffff88011d38b980 ffff88011bd60080 0000000000000001 ffff88011d38b980 ffff88011bd60638 ffff880118959fd8 000000000000fbc8 ffff88011bd60638 Call Trace: [] kauditd_thread+0x149/0x180 [] ? default_wake_function+0x0/0x20 [] ? kauditd_thread+0x0/0x180 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 dhclient S 0000000000000001 0 872 1 0x00000000 ffff880119c0b908 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000001 0000000100000286 ffff880119c0b8a8 ffffffff8109f4a1 ffff880119491058 ffff880119c0bfd8 000000000000fbc8 ffff880119491058 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? enqueue_task_fair+0xfb/0x100 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? release_sock+0xe5/0x110 [] ? skb_free_datagram_locked+0x36/0x50 [] ? udp_recvmsg+0x17c/0x320 [] ? inet_recvmsg+0x5a/0x90 [] ? sock_recvmsg+0x133/0x160 [] ? autoremove_wake_function+0x0/0x40 [] core_sys_select+0x18a/0x2c0 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] sys_select+0x47/0x110 [] system_call_fastpath+0x16/0x1b auditd S 0000000000000001 0 910 1 0x00000000 ffff88011a7d1da8 0000000000000082 ffff88011a7d1d98 ffffffff8109fde3 ffff880100000001 0000000100000282 ffff88011a7d1d88 ffffffff81061b6e ffff88011891f058 ffff88011a7d1fd8 000000000000fbc8 ffff88011891f058 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? try_to_wake_up+0x24e/0x3e0 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] ? ktime_get_ts+0xb1/0xf0 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b auditd S 0000000000000001 0 911 1 0x00000000 ffff880119ca7bf8 0000000000000082 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880119ca7b88 ffffffff81283079 ffff8801193d5af8 ffff880119ca7fd8 000000000000fbc8 ffff8801193d5af8 Call Trace: [] ? cpumask_next_and+0x29/0x50 [] futex_wait_queue_me+0xb9/0xf0 [] futex_wait+0x1f0/0x360 [] ? futex_wake+0x10e/0x120 [] do_futex+0x121/0xb50 [] ? jbd2_log_wait_commit+0xf5/0x140 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? do_writepages+0x21/0x40 [] ? jbd2_complete_transaction+0x68/0xb0 [jbd2] [] ? ext4_sync_file+0x121/0x1d0 [ext4] [] sys_futex+0x7b/0x170 [] ? vfs_fsync+0x1d/0x20 [] ? do_fsync+0x49/0x60 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000001 0 926 1 0x00000080 ffff88011cc11908 0000000000000086 ffff88011cc118f8 ffffffff8109fde3 0000000000000001 0000000100025dd8 0000000000000001 ffff880000037c20 ffff880119359098 ffff88011cc11fd8 000000000000fbc8 ffff880119359098 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? get_page_from_freelist+0x3d1/0x870 [] ? __rmqueue+0xc3/0x490 [] ? __pollwait+0x0/0xf0 [] ? zone_statistics+0x99/0xc0 [] ? flush_tlb_others_ipi+0x128/0x130 [] ? native_flush_tlb_others+0x76/0x90 [] ? find_get_page+0x1e/0xa0 [] ? filemap_fault+0xd3/0x500 [] ? unlock_page+0x27/0x30 [] ? __do_fault+0x469/0x530 [] ? handle_pte_fault+0xf7/0xb00 [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock_local+0x25/0x90 [] ? pvclock_clocksource_read+0x58/0xd0 [] core_sys_select+0x18a/0x2c0 [] ? __do_page_fault+0x1ec/0x480 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] sys_select+0x47/0x110 [] system_call_fastpath+0x16/0x1b rs:main Q:Reg S 0000000000000001 0 927 1 0x00000080 ffff880119d33bf8 0000000000000086 ffff880119c04440 00000060810129fe ffff8801021fb270 ffff88011a0335d8 0000000000000001 00000000000cd4a8 ffff880119198638 ffff880119d33fd8 000000000000fbc8 ffff880119198638 Call Trace: [] futex_wait_queue_me+0xb9/0xf0 [] futex_wait+0x1f0/0x360 [] ? generic_file_aio_write+0xba/0x100 [] do_futex+0x121/0xb50 [] ? fsnotify_add_notify_event+0x12d/0x280 [] ? autoremove_wake_function+0x0/0x40 [] sys_futex+0x7b/0x170 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000001 0 929 1 0x00000080 ffff88011cc15908 0000000000000086 0000000000000000 ffff88011cc158cc 0000000000000000 ffff88011fc23240 ffff880028216840 0000000000000400 ffff8801193d5098 ffff88011cc15fd8 000000000000fbc8 ffff8801193d5098 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? __pollwait+0x75/0xf0 [] ? unix_dgram_poll+0x127/0x1c0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? sock_recvmsg+0x133/0x160 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? enqueue_entity+0x125/0x450 [] ? check_preempt_wakeup+0x1a4/0x260 [] ? enqueue_task_fair+0xfb/0x100 [] ? check_preempt_curr+0x7c/0x90 [] ? try_to_wake_up+0x24e/0x3e0 [] core_sys_select+0x18a/0x2c0 [] ? pvclock_clocksource_read+0x58/0xd0 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000000 0 930 1 0x00000080 ffff88011cc17df8 0000000000000086 ffff88011cc17dc0 0000000000000282 0000000000000297 ffff880119198080 ffff880119d33c98 00007f436fd42000 ffff880119399058 ffff88011cc17fd8 000000000000fbc8 ffff880119399058 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] do_syslog+0x461/0x4c0 [] ? autoremove_wake_function+0x0/0x40 [] kmsg_read+0x32/0x60 [] proc_reg_read+0x7e/0xc0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rpcbind S 0000000000000001 0 944 1 0x00000080 ffff880119429a58 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000001 0000000100000286 ffff8801194299f8 ffffffff8109f4a1 ffff88011930bab8 ffff880119429fd8 000000000000fbc8 ffff88011930bab8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? fsnotify_clear_marks_by_inode+0x32/0xf0 [] ? apic_timer_interrupt+0xe/0x20 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] ? poll_select_set_timeout+0x95/0xb0 [] sys_poll+0x71/0x100 [] system_call_fastpath+0x16/0x1b rpc.statd S 0000000000000000 0 962 1 0x00000080 ffff88011a7df908 0000000000000086 0000000000000000 ffff8800282168a8 ffff88011930b538 0000000000000cf8 ffff88011930b500 0000000000000000 ffff880118819ab8 ffff88011a7dffd8 000000000000fbc8 ffff880118819ab8 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? default_wake_function+0x0/0x20 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? __wake_up_common+0x59/0x90 [] ? handle_pte_fault+0x2cd/0xb00 [] ? pipe_write+0x318/0x6a0 [] core_sys_select+0x18a/0x2c0 [] ? __do_page_fault+0x1ec/0x480 [] ? __d_free+0x3f/0x60 [] ? d_free+0x58/0x60 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] system_call_fastpath+0x16/0x1b flush-252:0 S 0000000000000000 0 1064 2 0x00000080 ffff88011a7dbda0 0000000000000046 0000000000000000 ffff8801193fbc00 ffff8800283168d8 ffff8801193a7118 00000001006f6195 ffff8801193a7108 ffff880119491ab8 ffff88011a7dbfd8 000000000000fbc8 ffff880119491ab8 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 rpciod/0 S 0000000000000000 0 5055 2 0x00000080 ffff88011cc79e30 0000000000000046 0000000000000000 ffff8800282168a8 ffff88011cc79db0 ffffffff8105af80 ffff880119244ad8 ffff8800282168a8 ffff880119d3faf8 ffff88011cc79fd8 000000000000fbc8 ffff880119d3faf8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 rpciod/1 S 0000000000000001 0 5056 2 0x00000080 ffff88011cc7be30 0000000000000046 0000000000000000 ffffe8ffffd07008 ffff88011cc7bdd0 ffff88011d3ad000 ffff88011d3ad5d0 00000000ffffff95 ffff880119d3f098 ffff88011cc7bfd8 000000000000fbc8 ffff880119d3f098 Call Trace: [] ? xs_tcp_setup_socket+0x0/0x4c0 [sunrpc] [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kslowd000 S 0000000000000000 0 5058 2 0x00000080 ffff8801199c3e60 0000000000000046 000000010000000f 0000000a00000003 ffffffffffffffff ffffffff8106a33b ffff8801199c3df0 ffff8801199c3e80 ffff8801192f8638 ffff8801199c3fd8 000000000000fbc8 ffff8801192f8638 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] ? prepare_to_wait_exclusive+0x4e/0x80 [] slow_work_thread+0x32b/0x360 [] ? autoremove_wake_function+0x0/0x40 [] ? slow_work_thread+0x0/0x360 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kslowd001 S 0000000000000001 0 5059 2 0x00000080 ffff880119bd3e60 0000000000000046 0000000000000000 0000000a00000003 ffffffffffffffff ffffffff8106a33b ffff880119bd3df0 ffff880119bd3e80 ffff880119d3e638 ffff880119bd3fd8 000000000000fbc8 ffff880119d3e638 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] slow_work_thread+0x32b/0x360 [] ? autoremove_wake_function+0x0/0x40 [] ? slow_work_thread+0x0/0x360 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 nfsiod S 0000000000000001 0 5060 2 0x00000080 ffff880118b33e30 0000000000000046 0000000000000000 0000000000000282 ffff880118b33de0 ffffffff815300bc ffff88011891e078 ffff8800283168a8 ffff880119245058 ffff880118b33fd8 000000000000fbc8 ffff880119245058 Call Trace: [] ? kprobe_flush_task+0xbc/0xe0 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 nfsv4.0-svc S 0000000000000001 0 5061 2 0x00000080 ffff880119dd9d70 0000000000000046 0000000000000000 ffffffff8103f9d8 ffff8801192d8600 ffff8800283168a8 0000000000007820 0000000000000001 ffff880119197ab8 ffff880119dd9fd8 000000000000fbc8 ffff880119197ab8 Call Trace: [] ? pvclock_clocksource_read+0x58/0xd0 [] schedule_timeout+0x215/0x2e0 [] ? __dequeue_entity+0x30/0x50 [] ? __switch_to+0xd0/0x320 [] svc_recv+0x5a5/0x850 [sunrpc] [] ? default_wake_function+0x0/0x20 [] nfs4_callback_svc+0x43/0xb0 [nfs] [] ? nfs4_callback_svc+0x0/0xb0 [nfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 master S 0000000000000001 0 5149 1 0x00000080 ffff88011d3ffda8 0000000000000082 ffff88011d3ffd98 ffffffff8109fde3 ffff880100000001 000000018109eeeb 0000000c00000000 ffff88011c99f1c0 ffff8801194905f8 ffff88011d3fffd8 000000000000fbc8 ffff8801194905f8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b qmgr S 0000000000000001 0 5158 5149 0x00000080 ffff8801193abda8 0000000000000086 0000000000000000 ffffffff8109fde3 ffff880100000001 000000018109eeeb ffff8801193abd48 ffffffff8109f4a1 ffff8801192f9098 ffff8801193abfd8 000000000000fbc8 ffff8801192f9098 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b sshd S 0000000000000001 0 5729 1 0x00000080 ffff88011ccd7908 0000000000000086 0000000000000000 ffff88011ccd78cc 0000000000000000 ffff88011fc23240 ffff880028216840 00000000000005ff ffff8801193e45f8 ffff88011ccd7fd8 000000000000fbc8 ffff8801193e45f8 Call Trace: [] ? get_page_from_freelist+0x3d1/0x870 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? call_rcu_sched+0x15/0x20 [] ? call_rcu+0xe/0x10 [] ? vsnprintf+0x450/0x5e0 [] ? d_lookup+0x35/0x60 [] core_sys_select+0x18a/0x2c0 [] ? security_task_wait+0x16/0x20 [] ? wait_consider_task+0x9d/0xb20 [] ? remove_wait_queue+0x3c/0x50 [] ? fpu_finit+0x21/0x40 [] ? init_fpu+0x59/0xc0 [] ? __audit_syscall_exit+0x25e/0x290 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? int_check_syscall_exit_work+0x34/0x3d [] system_call_fastpath+0x16/0x1b agetty S 0000000000000000 0 5749 1 0x00000080 ffff88011d389cc8 0000000000000082 0000000000000000 ffffffff8114a219 0000000118c9e025 0000000000000000 0000000000000000 ffffea0003d81dc8 ffff880119399ab8 ffff88011d389fd8 000000000000fbc8 ffff880119399ab8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? uart_write+0xe9/0x120 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5750 1 0x00000080 ffff88011cc4bcc8 0000000000000082 ffff88011cc4bc90 ffff88011cc4bc8c 0000000118c9e025 ffff88011fc23040 ffff880028316840 00000000000005ff ffff880119199098 ffff88011cc4bfd8 000000000000fbc8 ffff880119199098 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5752 1 0x00000080 ffff880119479cc8 0000000000000082 ffff880119479ca8 ffffffff8114a219 0000000118c9e025 0000000000000000 0000000000000000 ffffea0003da0c60 ffff8801192e1af8 ffff880119479fd8 000000000000fbc8 ffff8801192e1af8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5754 1 0x00000080 ffff880119409cc8 0000000000000086 ffff880119409ca8 ffffffff8114a219 0000000118c9e025 0000000000000000 0000000000000000 ffffea0003d942e8 ffff880119cfc638 ffff880119409fd8 000000000000fbc8 ffff880119cfc638 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5756 1 0x00000080 ffff8801195d5cc8 0000000000000086 ffff8801195d5ca8 ffffffff8114a219 0000000118c9e025 0000000000000000 0000000000000000 ffffea0003d89b90 ffff88011891e5f8 ffff8801195d5fd8 000000000000fbc8 ffff88011891e5f8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b udevd S 0000000000000001 0 5758 357 0x00000080 ffff880118809a08 0000000000000082 ffff880118809998 ffff8800282168a8 ffff8800282168d8 ffff8800282168a8 ffff88011930a078 0000000000000086 ffff880119165058 ffff880118809fd8 000000000000fbc8 ffff880119165058 Call Trace: [] ? resched_task+0x68/0x80 [] ? check_preempt_wakeup+0x1c2/0x260 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? unix_dgram_sendmsg+0x5e5/0x6d0 [] ? sock_sendmsg+0x123/0x150 [] ? autoremove_wake_function+0x0/0x40 [] ? __sys_sendmsg+0x406/0x420 [] ? mntput_no_expire+0x30/0x110 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? sys_sendto+0x139/0x190 [] sys_ppoll+0x4c/0x180 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b udevd S 0000000000000000 0 5759 357 0x00000080 ffff8801193c9a08 0000000000000086 ffff8801193c9998 ffff8800282168a8 ffff8800282168d8 ffff8800282168a8 ffff88011930a078 000000000002b54d ffff880119358638 ffff8801193c9fd8 000000000000fbc8 ffff880119358638 Call Trace: [] ? wakeup_preempt_entity+0x47/0x50 [] ? check_preempt_wakeup+0x1c2/0x260 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? flush_tlb_page+0x48/0xb0 [] ? ptep_set_access_flags+0x6d/0x70 [] ? do_wp_page+0x493/0x920 [] ? handle_pte_fault+0x2cd/0xb00 [] ? autoremove_wake_function+0x0/0x40 [] ? handle_mm_fault+0x22a/0x300 [] ? __do_page_fault+0x1ec/0x480 [] ? __switch_to+0x1ac/0x320 [] sys_ppoll+0x4c/0x180 [] ? audit_syscall_entry+0x1d7/0x200 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5760 1 0x00000080 ffff88011949fcc8 0000000000000082 ffff88011949fc90 ffff88011949fc8c 0000000118c9e025 ffff88011fc23240 ffff880028216840 0000000000000400 ffff8801191645f8 ffff88011949ffd8 000000000000fbc8 ffff8801191645f8 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5762 1 0x00000080 ffff8801199c7cc8 0000000000000082 0000000000000000 ffffffff8114a219 0000000118c9e025 0000000000000000 0000000000000000 ffffea0003d82bc8 ffff8801193985f8 ffff8801199c7fd8 000000000000fbc8 ffff8801193985f8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b cfs_rh_00 S 0000000000000001 0 6195 2 0x00000080 ffff880118a73e40 0000000000000046 0000000000000000 ffffffff8105af80 ffff8801195ad578 ffff8800282168a8 ffff880118a73dd0 ffffffff81283079 ffff880118971af8 ffff880118a73fd8 000000000000fbc8 ffff880118971af8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? cpumask_next_and+0x29/0x50 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 cfs_rh_01 S 0000000000000001 0 6196 2 0x00000080 ffff880119bc7e40 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880119bc7dd0 ffffffff81283079 ffff88011b501ab8 ffff880119bc7fd8 000000000000fbc8 ffff88011b501ab8 Call Trace: [] ? cpumask_next_and+0x29/0x50 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 obd_zombid S 0000000000000000 0 6249 2 0x00000080 ffff880119405e60 0000000000000046 ffff88011cc88028 ffff8800282119a0 ffffffff81aaa5c0 0000000000000282 ffff880119405e00 0000000000000282 ffff88011cc35ab8 ffff880119405fd8 000000000000fbc8 ffff88011cc35ab8 Call Trace: [] obd_zombie_impexp_thread+0xd8/0x190 [obdclass] [] ? default_wake_function+0x0/0x20 [] ? obd_zombie_impexp_thread+0x0/0x190 [obdclass] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpc_hr00_0 S 0000000000000000 0 6260 2 0x00000080 ffff88011bd17dd0 0000000000000046 ffff88011bd17d40 ffffffff8109afb6 ffffffffffffffff ffffffffa06b5ab8 ffff88011bd17d90 ffffffff810546b9 ffff880119cfd098 ffff88011bd17fd8 000000000000fbc8 ffff880119cfd098 Call Trace: [] ? autoremove_wake_function+0x16/0x40 [] ? __wake_up_common+0x59/0x90 [] ptlrpc_hr_main+0x14a/0x770 [ptlrpc] [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpc_hr01_0 S 0000000000000001 0 6261 2 0x00000080 ffff88011cd4fdd0 0000000000000046 0000000000000000 ffffffff8109afb6 ffffffffffffffff ffffffffa06b5ab8 ffff88011cd4fd90 ffffffff810546b9 ffff88011cc35058 ffff88011cd4ffd8 000000000000fbc8 ffff88011cc35058 Call Trace: [] ? autoremove_wake_function+0x16/0x40 [] ? __wake_up_common+0x59/0x90 [] ptlrpc_hr_main+0x14a/0x770 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd00 S 0000000000000001 0 6262 2 0x00000080 ffff880119f79d60 0000000000000046 ffff880119f79cf0 ffffffff81058bd3 0000000000000000 ffff88011c00e000 ffff880119f79cf0 0000000000000246 ffff8801192445f8 ffff880119f79fd8 000000000000fbc8 ffff8801192445f8 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd01 S 0000000000000001 0 6263 2 0x00000080 ffff880119f7bd60 0000000000000046 ffff880119f7bcf0 ffffffff81058bd3 0000000000000000 ffff88011c104000 ffff880119f7bcf0 0000000000000246 ffff880119197058 ffff880119f7bfd8 000000000000fbc8 ffff880119197058 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd02 S 0000000000000001 0 6264 2 0x00000080 ffff880119f7dd60 0000000000000046 ffff880119f7ddc0 ffff880119f7dd30 ffff880119f7de98 000000020000f9d8 0000000000000001 ffff880028310660 ffff88011b5005f8 ffff880119f7dfd8 000000000000fbc8 ffff88011b5005f8 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? __switch_to+0xd0/0x320 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd03 S 0000000000000001 0 6265 2 0x00000080 ffff880119f7fd60 0000000000000046 ffff880119f7fdc0 ffff880119f7fd30 ffff880119f7fe98 000000020000f9d8 0000000000000001 ffff880028310660 ffff8801192e1098 ffff880119f7ffd8 000000000000fbc8 ffff8801192e1098 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? __switch_to+0xd0/0x320 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_reape S 0000000000000000 0 6266 2 0x00000080 ffff8801194a3d30 0000000000000046 0000000000000000 ffff8801194a3cf4 0000000000000000 0000000000000282 ffff8801194a3cd0 ffffffff81083e1c ffff8801197d4638 ffff8801194a3fd8 000000000000fbc8 ffff8801197d4638 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ksocknal_reaper+0xc4b/0xd60 [ksocklnd] [] ? default_wake_function+0x12/0x20 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_reaper+0x0/0xd60 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_sd00_ S 0000000000000000 0 6267 2 0x00000080 ffff8801194a5de0 0000000000000046 0000000000000000 0000000000000000 ffff88011c298038 ffff88011c29803c ffff8801194a5de0 ffffffffa03adf2a ffff880119cfdaf8 ffff8801194a5fd8 000000000000fbc8 ffff880119cfdaf8 Call Trace: [] ? ksocknal_process_receive+0x15a/0xed0 [ksocklnd] [] ksocknal_scheduler+0xdb1/0x1390 [ksocklnd] [] ? autoremove_wake_function+0x0/0x40 [] ? ksocknal_scheduler+0x0/0x1390 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_sd01_ S 0000000000000001 0 6268 2 0x00000080 ffff8801194a7de0 0000000000000046 ffff880119efe0a0 0000000000000000 ffff880119efe038 ffff880119efe03c ffff8801194a7de0 ffffffffa03adf2a ffff880119165ab8 ffff8801194a7fd8 000000000000fbc8 ffff880119165ab8 Call Trace: [] ? ksocknal_process_receive+0x15a/0xed0 [ksocklnd] [] ? prepare_to_wait_exclusive+0x4e/0x80 [] ksocknal_scheduler+0xdb1/0x1390 [ksocklnd] [] ? autoremove_wake_function+0x0/0x40 [] ? ksocknal_scheduler+0x0/0x1390 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 acceptor_000 S 0000000000000001 0 6269 2 0x00000080 ffff8801194abdd0 0000000000000046 ffff8801194abd40 ffffffff81fd0820 ffff88011dc24400 ffff88011c6ad4c8 ffff8801194abd70 ffffffff811a7562 ffff88011930b058 ffff8801194abfd8 000000000000fbc8 ffff88011930b058 Call Trace: [] ? new_inode+0x72/0xb0 [] lnet_sock_accept+0x13d/0x170 [lnet] [] ? default_wake_function+0x0/0x20 [] lnet_acceptor+0x1b7/0xb50 [lnet] [] ? default_wake_function+0x12/0x20 [] ? lnet_acceptor+0x0/0xb50 [lnet] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 router_checke S 0000000000000001 0 6270 2 0x00000080 ffff8801194ade30 0000000000000046 0000000000000000 ffff8800283168a8 0000000000000001 ffff880028316840 ffff8801194adde0 ffffffff8106abeb ffff88011972f098 ffff8801194adfd8 000000000000fbc8 ffff88011972f098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] lnet_router_checker+0x469/0x520 [lnet] [] ? autoremove_wake_function+0x0/0x40 [] ? lnet_router_checker+0x0/0x520 [lnet] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_rcv S 0000000000000001 0 6271 2 0x00000080 ffff8801194afd10 0000000000000046 0000000000000000 ffff8801194afcd4 ffff88011aa05400 0000000000000286 ffff8801194afcb0 ffffffff81083e1c ffff880118971098 ffff8801194affd8 000000000000fbc8 ffff880118971098 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_0 S 0000000000000001 0 6272 2 0x00000080 ffff8801194b3d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff880119ce7280 0000000000000286 ffff8801194b3cb0 ffffffff81083e1c ffff880118970638 ffff8801194b3fd8 000000000000fbc8 ffff880118970638 Call Trace: [] ? __wake_up+0x53/0x70 [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_1 S 0000000000000001 0 6273 2 0x00000080 ffff8801194b5d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff8801012ca580 0000000000000286 ffff8801194b5cb0 ffffffff81083e1c ffff8801195ad098 ffff8801194b5fd8 000000000000fbc8 ffff8801195ad098 Call Trace: [] ? __wake_up+0x53/0x70 [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ping S 0000000000000000 0 6274 2 0x00000080 ffff8801194b7d40 0000000000000046 ffff8801194b7d08 ffff8801194b7d04 00000000ffffffff ffff88011fc23040 ffff880028316840 0000000000000400 ffff88011918e638 ffff8801194b7fd8 000000000000fbc8 ffff88011918e638 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpc_pinger_main+0x928/0xac0 [ptlrpc] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_pinger_main+0x0/0xac0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sptlrpc_gc S 0000000000000001 0 6275 2 0x00000080 ffff8801194bdda0 0000000000000046 0000000000000000 ffff880028216840 ffff8801194bdd10 0000000000000286 ffff8801194bdd40 ffffffff81083e1c ffff88011918faf8 ffff8801194bdfd8 000000000000fbc8 ffff88011918faf8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] sec_gc_main+0x28e/0x390 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? sec_gc_main+0x0/0x390 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_000 S 0000000000000000 0 22119 2 0x00000080 ffff88011c29bd00 0000000000000046 0000001000000000 ffff88011bd61578 ffff8800283168a8 ffff880028316840 0000000000000000 0000000000000001 ffff880119a73058 ffff88011c29bfd8 000000000000fbc8 ffff880119a73058 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_001 S 0000000000000000 0 22120 2 0x00000080 ffff88011b755d00 0000000000000046 ffffffff81eb2640 00000001006c2067 ffff88011b755c70 0000000000000282 ffff88011b755cc0 ffffffff81085f64 ffff88011c29e638 ffff88011b755fd8 000000000000fbc8 ffff88011c29e638 Call Trace: [] ? mod_timer+0x144/0x220 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb01_000 S 0000000000000001 0 22122 2 0x00000080 ffff880119ef1d00 0000000000000046 0000000000000000 00000001006f93a1 ffff880119ef1c70 0000000000000286 ffff880119ef1cc0 ffffffff81085f64 ffff88011af43098 ffff880119ef1fd8 000000000000fbc8 ffff88011af43098 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb01_001 S 0000000000000001 0 22123 2 0x00000080 ffff88011a409d00 0000000000000046 0000000000000028 ffff88011a409d40 ffff88011a409d00 ffffffffa036c5c0 0000000000003039 00020000c0a8710a ffff88011cdd5098 ffff88011a409fd8 000000000000fbc8 ffff88011cdd5098 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_00 S 0000000000000001 0 22124 2 0x00000080 ffff88011cd45e40 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff88011cd45dd0 0000000000000282 ffff88011b50d9c0 ffff88010344c800 ffff88011aa77058 ffff88011cd45fd8 000000000000fbc8 ffff88011aa77058 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_01 S 0000000000000001 0 22125 2 0x00000080 ffff88011aa97e40 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff88011aa97dd0 0000000000000282 ffff88011aeee580 ffff8801027541c0 ffff880119193098 ffff88011aa97fd8 000000000000fbc8 ffff880119193098 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_poold S 0000000000000000 0 22126 2 0x00000080 ffff88011ab17da0 0000000000000046 0000000000000000 ffff88011ab17d50 0000000000000000 0000000000000282 ffff88011ab17d40 ffffffff81083e1c ffff88011b7a1058 ffff88011ab17fd8 000000000000fbc8 ffff88011b7a1058 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ldlm_pools_thread_main+0x1df/0x310 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_pools_thread_main+0x0/0x310 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_cfg_requeu S 0000000000000001 0 22127 2 0x00000080 ffff88011a8b7e30 0000000000000046 0000000000000000 ffffffff81529c7a ffff88011aa77500 0000000000000286 0000000000000000 dead000000200200 ffff88011aa77ab8 ffff88011a8b7fd8 000000000000fbc8 ffff88011aa77ab8 Call Trace: [] ? schedule_timeout+0x19a/0x2e0 [] mgc_requeue_thread+0x5b4/0x7f0 [mgc] [] ? default_wake_function+0x0/0x20 [] ? mgc_requeue_thread+0x0/0x7f0 [mgc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_02 S 0000000000000001 0 1783 2 0x00000080 ffff88011aabfe40 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff88011aabfdd0 0000000000000282 ffff88011a97e780 ffff88010eae91c0 ffff88011a8f8638 ffff88011aabffd8 000000000000fbc8 ffff88011a8f8638 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 pickup S 0000000000000001 0 20632 5149 0x00000080 ffff88011a6a5da8 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000001 000000018109eeeb ffff88011a6a5d48 ffffffff8109f4a1 ffff8801192f9af8 ffff88011a6a5fd8 000000000000fbc8 ffff8801192f9af8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b sshd S 0000000000000001 0 18239 5729 0x00000080 ffff88011950b908 0000000000000086 ffff88011950b8d0 ffff88011950b8cc ffff88011950b888 ffff88011fc23240 ffff880028216840 00000000000006e2 ffff8801191965f8 ffff88011950bfd8 000000000000fbc8 ffff8801191965f8 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? unlock_page+0x27/0x30 [] ? __do_fault+0x469/0x530 [] ? handle_pte_fault+0xf7/0xb00 [] ? release_sock+0xe5/0x110 [] core_sys_select+0x18a/0x2c0 [] ? perf_event_task_sched_out+0x33/0x70 [] ? __dequeue_entity+0x30/0x50 [] ? __switch_to+0x26e/0x320 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sh S 0000000000000000 0 18241 18239 0x00000080 ffff88011a84fe78 0000000000000086 0000000000000000 0000000000000028 0000000000440910 ffff880119492e00 ffff880119540a20 0000000000000014 ffff880119a725f8 ffff88011a84ffd8 000000000000fbc8 ffff880119a725f8 Call Trace: [] do_wait+0x1e4/0x240 [] sys_wait4+0xa3/0x100 [] ? child_wait_callback+0x0/0x70 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b tail S 0000000000000000 0 18250 18241 0x00000080 ffff88010298de28 0000000000000082 0000000000000000 ffffffffa0083e08 0000000000000001 ffff88010298ddc8 ffff88010298ddc8 ffff8801026b7e00 ffff88011b501058 ffff88010298dfd8 000000000000fbc8 ffff88011b501058 Call Trace: [] ? ext4_file_write+0x58/0x190 [ext4] [] inotify_read+0xe9/0x330 [] ? autoremove_wake_function+0x0/0x40 [] ? security_file_permission+0x16/0x20 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sshd S 0000000000000000 0 18291 5729 0x00000080 ffff88010ea19908 0000000000000082 0000000000000000 ffff880101de3868 ffff88010ea19888 ffffffff814b1a5d ffff880101de3868 ffff8801188896e0 ffff880119a73ab8 ffff88010ea19fd8 000000000000fbc8 ffff880119a73ab8 Call Trace: [] ? tcp_wfree+0x3d/0xd0 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? do_wp_page+0x493/0x920 [] ? handle_pte_fault+0x2cd/0xb00 [] core_sys_select+0x18a/0x2c0 [] ? __wake_up_sync_key+0x5e/0x80 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b ldlm_bl_03 S 0000000000000000 0 21397 2 0x00000080 ffff880101de7e40 0000000000000046 ffff880101de7e08 ffff880101de7e04 ffff880101de7dd0 ffff88011fc23040 ffff880028316840 0000000000000400 ffff88011bd61098 ffff880101de7fd8 000000000000fbc8 ffff88011bd61098 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_04 S 0000000000000000 0 21398 2 0x00000080 ffff88010350be40 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff88010350bdd0 0000000000000282 ffff88011c0098c0 ffff88010344c080 ffff8801195adaf8 ffff88010350bfd8 000000000000fbc8 ffff8801195adaf8 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 flush-lustre- S 0000000000000000 0 21532 2 0x00000080 ffff880101003da0 0000000000000046 0000000000000000 0000000000016840 ffff880028210980 ffff88011c310a68 00000001006f61fc ffff88011c310a58 ffff88011b7a1ab8 ffff880101003fd8 000000000000fbc8 ffff88011b7a1ab8 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 bash S 0000000000000001 0 24490 18291 0x00000080 ffff88011b80de78 0000000000000082 0000000000000000 0000000000000029 00000000006dc1e4 ffff880118886d80 ffff88011d377e08 0000000000000007 ffff88011af42638 ffff88011b80dfd8 000000000000fbc8 ffff88011af42638 Call Trace: [] do_wait+0x1e4/0x240 [] sys_wait4+0xa3/0x100 [] ? child_wait_callback+0x0/0x70 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sh R running task 0 24499 24490 0x00000080 ffff880101db1ce8 000000000e08ee9d ffff880101db1d58 ffff88011cdd4080 0000000000000000 ffff880101db1cc8 ffff880028303fc0 ffffffff817d692f ffff880101db1d48 ffffffff81528845 0000000000000010 ffff880101db1d58 Call Trace: [] show_trace_log_lvl+0x55/0x70 [] show_stack_log_lvl+0x9a/0x170 [] show_stack+0x1a/0x20 [] sched_show_task+0x98/0x100 [] show_state_filter+0x7b/0xc0 [] sysrq_handle_showstate+0x10/0x20 [] __handle_sysrq+0x132/0x1a0 [] write_sysrq_trigger+0x4e/0x50 [] proc_reg_write+0x7e/0xc0 [] vfs_write+0xb8/0x1a0 [] sys_write+0x51/0x90 [] system_call_fastpath+0x16/0x1b Sched Debug Version: v0.09, 2.6.32-431.29.2.el6.x86_64 #1 now at 7605571.683372 msecs .jiffies : 4302270256 .sysctl_sched_latency : 10.000000 .sysctl_sched_min_granularity : 2.000000 .sysctl_sched_wakeup_granularity : 2.000000 .sysctl_sched_child_runs_first : 0.000000 .sysctl_sched_features : 3183 .sysctl_sched_tunable_scaling : 1 (logaritmic) cpu#0, 2793.268 MHz .nr_running : 0 .load : 0 .nr_switches : 1554038 .nr_load_updates : 626711 .nr_uninterruptible : 0 .next_balance : 4302.270493 .curr->pid : 0 .clock : 7605590.059597 .cpu_load[0] : 0 .cpu_load[1] : 97 .cpu_load[2] : 238 .cpu_load[3] : 330 .cpu_load[4] : 315 .yld_count : 0 .sched_switch : 0 .sched_count : 1569666 .sched_goidle : 383950 .avg_idle : 1000000 .ttwu_count : 765227 .ttwu_local : 622451 .bkl_count : 392 cfs_rq[0]:/ .exec_clock : 330334.354168 .MIN_vruntime : 0.000001 .min_vruntime : 1034455.600471 .max_vruntime : 0.000001 .spread : 0.000000 .spread0 : 0.000000 .nr_spread_over : 174222 .nr_running : 0 .load : 0 .tg->cfs_bandwidth.timer_active: 0 .throttled : 0 .throttle_count : 0 .load_avg : 0.000000 .load_period : 0.000000 .load_contrib : 0 .load_tg : 0 rt_rq[0]:/ .rt_nr_running : 0 .rt_throttled : 0 .rt_time : 0.000000 .rt_runtime : 950.000000 runnable tasks: task PID tree-key switches prio exec-runtime sum-exec sum-sleep ---------------------------------------------------------------------------------------------------------- cpu#1, 2793.268 MHz .nr_running : 1 .load : 1024 .nr_switches : 1441297 .nr_load_updates : 631697 .nr_uninterruptible : 0 .next_balance : 4302.270497 .curr->pid : 24499 .clock : 7602960.261353 .cpu_load[0] : 1024 .cpu_load[1] : 832 .cpu_load[2] : 730 .cpu_load[3] : 618 .cpu_load[4] : 434 .yld_count : 0 .sched_switch : 0 .sched_count : 1452410 .sched_goidle : 355750 .avg_idle : 772745 .ttwu_count : 697396 .ttwu_local : 571718 .bkl_count : 163 cfs_rq[1]:/ .exec_clock : 313178.354675 .MIN_vruntime : 0.000001 .min_vruntime : 1019388.837348 .max_vruntime : 0.000001 .spread : 0.000000 .spread0 : -15066.763123 .nr_spread_over : 174211 .nr_running : 1 .load : 1024 .tg->cfs_bandwidth.timer_active: 0 .throttled : 0 .throttle_count : 0 .load_avg : 0.000000 .load_period : 0.000000 .load_contrib : 0 .load_tg : 0 rt_rq[1]:/ .rt_nr_running : 0 .rt_throttled : 0 .rt_time : 0.000000 .rt_runtime : 950.000000 runnable tasks: task PID tree-key switches prio exec-runtime sum-exec sum-sleep ---------------------------------------------------------------------------------------------------------- R sh 24499 1019388.837348 1 120 1019388.837348 0.429708 0.000000 / SysRq : Show Memory Mem-Info: Node 0 DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 CPU 1: hi: 0, btch: 1 usd: 0 Node 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 161 CPU 1: hi: 186, btch: 31 usd: 167 Node 0 Normal per-cpu: CPU 0: hi: 186, btch: 31 usd: 104 CPU 1: hi: 186, btch: 31 usd: 131 active_anon:2435 inactive_anon:35 isolated_anon:0 active_file:40818 inactive_file:33581 isolated_file:0 unevictable:0 dirty:84 writeback:0 unstable:0 free:839757 slab_reclaimable:4825 slab_unreclaimable:9183 mapped:1609 shmem:38 pagetables:498 bounce:0 Node 0 DMA free:15732kB min:248kB low:308kB high:372kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15336kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 3512 4017 4017 Node 0 DMA32 free:3251312kB min:58868kB low:73584kB high:88300kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3596500kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:8kB slab_unreclaimable:4kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 505 505 Node 0 Normal free:91984kB min:8464kB low:10580kB high:12696kB active_anon:9740kB inactive_anon:140kB active_file:163268kB inactive_file:134320kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:517120kB mlocked:0kB dirty:336kB writeback:0kB mapped:6436kB shmem:152kB slab_reclaimable:19292kB slab_unreclaimable:36728kB kernel_stack:1024kB pagetables:1992kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Node 0 DMA: 3*4kB 1*8kB 2*16kB 2*32kB 2*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15732kB Node 0 DMA32: 118*4kB 67*8kB 42*16kB 15*32kB 6*64kB 3*128kB 9*256kB 12*512kB 6*1024kB 5*2048kB 787*4096kB = 3251312kB Node 0 Normal: 1934*4kB 1576*8kB 605*16kB 265*32kB 72*64kB 44*128kB 39*256kB 31*512kB 9*1024kB 2*2048kB 1*4096kB = 92008kB 74460 total pagecache pages 0 pages in swap cache Swap cache stats: add 0, delete 0, find 0/0 Free swap = 2538492kB Total swap = 2538492kB 1048575 pages RAM 100404 pages reserved 30235 pages shared 77743 pages non-shared