==> /tmp/serial_fre1309_out <== Lustre: DEBUG MARKER: excepting tests: 61d 53a 53d Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: == replay-single test 70b: dbench 1mdts recovery; 2 clients == 02:56:32 (1436496992) Lustre: DEBUG MARKER: Started rundbench load pid=20896 ... LustreError: 12463:0:(osd_handler.c:1351:osd_ro()) *** setting lustre-MDT0000 read-only *** LustreError: 12463:0:(osd_handler.c:1351:osd_ro()) Skipped 1 previous similar message Turning device vdb (0xfc00010) read-only Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 Lustre: DEBUG MARKER: test_70b fail mds1 1 times Lustre: Failing over lustre-MDT0000 Lustre: Skipped 4 previous similar messages Lustre: lustre-MDT0000: Not available for connect from 192.168.113.11@tcp (stopping) LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 192.168.113.10@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 192.168.113.10@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: Skipped 19 previous similar messages Lustre: 12515:0:(client.c:2018:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1436497007/real 1436497007] req@ffff88010c4e6980 x1506268659400236/t0(0) o251->MGC192.168.113.9@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1436497013 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 12515:0:(client.c:2018:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Removing read-only on unknown block (0xfc00010) Lustre: server umount lustre-MDT0000 complete Lustre: Skipped 4 previous similar messages LDISKFS-fs (vdb): recovery complete LDISKFS-fs (vdb): mounted filesystem with ordered data mode. quota=on. Opts: Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect Lustre: Skipped 4 previous similar messages Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:59 Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:53 Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:47 Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:41 Lustre: Skipped 1 previous similar message Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:29 Lustre: Skipped 3 previous similar messages LustreError: 12604:0:(ldlm_lib.c:2671:target_queue_recovery_request()) @@@ dropping resent queued req req@ffff88010d855980 x1506268646956308/t0(300647712767) o101->eaebf2dc-9ed3-ba69-f9bc-986cad575440@192.168.113.11@tcp:94/0 lens 872/0 e 0 to 0 dl 1436497069 ref 2 fl Interpret:/6/ffffffff rc 0/-1 Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:11 Lustre: Skipped 5 previous similar messages Lustre: lustre-MDT0000: recovery is timed out, evict stale exports LustreError: 12767:0:(ldlm_lib.c:2671:target_queue_recovery_request()) @@@ dropping resent queued req req@ffff880119a29c80 x1506268684524464/t0(300647711170) o101->11306559-fdc5-c1f3-ec5b-9cb4213c1b05@192.168.113.12@tcp:131/0 lens 872/0 e 0 to 0 dl 1436497106 ref 2 fl Interpret:/6/ffffffff rc 0/-1 LustreError: 12767:0:(ldlm_lib.c:2671:target_queue_recovery_request()) Skipped 7 previous similar messages Lustre: lustre-MDT0000: Client 11306559-fdc5-c1f3-ec5b-9cb4213c1b05 (at 192.168.113.12@tcp) reconnecting, waiting for 2 clients in recovery for 0:09 Lustre: Skipped 9 previous similar messages Lustre: lustre-MDT0000: recovery is timed out, evict stale exports Lustre: lustre-MDT0000: recovery is timed out, evict stale exports LustreError: 12602:0:(ldlm_lib.c:2671:target_queue_recovery_request()) @@@ dropping resent queued req req@ffff88010df9cc80 x1506268646956308/t0(300647712767) o101->eaebf2dc-9ed3-ba69-f9bc-986cad575440@192.168.113.11@tcp:195/0 lens 872/0 e 0 to 0 dl 1436497170 ref 2 fl Interpret:/6/ffffffff rc 0/-1 LustreError: 12602:0:(ldlm_lib.c:2671:target_queue_recovery_request()) Skipped 18 previous similar messages Lustre: lustre-MDT0000: Client eaebf2dc-9ed3-ba69-f9bc-986cad575440 (at 192.168.113.11@tcp) reconnecting, waiting for 2 clients in recovery for 0:05 Lustre: Skipped 18 previous similar messages Lustre: lustre-MDT0000: recovery is timed out, evict stale exports Lustre: lustre-MDT0000: recovery is timed out, evict stale exports Lustre: 12633:0:(ldlm_lib.c:1884:target_recovery_overseer()) recovery is aborted by hard timeout Lustre: 12633:0:(ldlm_lib.c:1894:target_recovery_overseer()) recovery is aborted, evict exports in recovery Lustre: 12633:0:(ldlm_lib.c:1894:target_recovery_overseer()) Skipped 2 previous similar messages Lustre: lustre-MDT0000: disconnecting 2 stale clients Lustre: 12633:0:(ldlm_lib.c:1531:abort_req_replay_queue()) @@@ aborted: req@ffff8801028049c0 x1506268646952356/t0(300647711152) o101->eaebf2dc-9ed3-ba69-f9bc-986cad575440@192.168.113.11@tcp:238/0 lens 808/0 e 10 to 0 dl 1436497213 ref 1 fl Complete:/4/ffffffff rc 0/-1 Lustre: lustre-MDT0000: Denying connection for new client eaebf2dc-9ed3-ba69-f9bc-986cad575440(at 192.168.113.11@tcp), waiting for 2 known clients (0 recovered, 0 in progress, and 2 evicted) to recover in 21188505:19 Lustre: 12633:0:(ldlm_lib.c:2441:target_recovery_thread()) too long recovery - read logs LustreError: dumping log to /tmp/lustre-log.1436497207.12633 Lustre: lustre-MDT0000: Recovery over after 3:00, of 2 clients 0 recovered and 2 were evicted. Lustre: Skipped 4 previous similar messages Lustre: DEBUG MARKER: replay-single test_70b: @@@@@@ FAIL: dbench stopped on some of fre1311,fre1312! Lustre: DEBUG MARKER: replay-single test_70b: @@@@@@ FAIL: rundbench load on fre1311,fre1312 failed! SysRq : Show State task PC stack pid father init S 0000000000000000 0 1 0 0x00000000 ffff88011e7ab908 0000000000000086 0000000000000000 ffff88011e7ab8cc 0000000000000000 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011e7a9ab8 ffff88011e7abfd8 000000000000fbc8 ffff88011e7a9ab8 Call Trace: [] ? thread_return+0xa4/0x770 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? get_page_from_freelist+0x3d1/0x870 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? __lru_cache_add+0x40/0x90 [] ? lru_cache_add_lru+0x21/0x40 [] ? page_add_new_anon_rmap+0x9d/0xf0 [] ? handle_pte_fault+0x4af/0xb00 [] ? mutex_lock+0x1e/0x50 [] ? pipe_read+0x2a7/0x4e0 [] core_sys_select+0x18a/0x2c0 [] ? apic_timer_interrupt+0xe/0x20 [] ? security_task_wait+0x16/0x20 [] ? wait_consider_task+0x9d/0xb20 [] ? remove_wait_queue+0x3c/0x50 [] ? do_wait+0x17f/0x240 [] ? pvclock_clocksource_read+0x58/0xd0 [] sys_select+0x47/0x110 [] ? posix_ktime_get_ts+0x11/0x20 [] system_call_fastpath+0x16/0x1b kthreadd S 0000000000000000 0 2 0 0x00000000 ffff88011e7b1ed0 0000000000000046 ffff88011e7b1f40 ffffffff8100c1a2 ffff88011e7a8aa0 ffff88011e7a8aa0 ffffffff81eb4c88 ffff88011cf6dc88 ffff88011e7a9058 ffff88011e7b1fd8 000000000000fbc8 ffff88011e7a9058 Call Trace: [] ? kernel_thread+0x82/0xe0 [] ? kthread+0x0/0xa0 [] kthreadd+0x1b5/0x1c0 [] child_rip+0xa/0x20 [] ? kthreadd+0x0/0x1c0 [] ? child_rip+0x0/0x20 migration/0 S 0000000000000000 0 3 2 0x00000000 ffff88011e7b5e70 0000000000000046 0000000000000000 0000000000000082 ffff88011e7b5df0 ffff88010cf56aa0 ffff880028316880 ffff880028316880 ffff88011e7a85f8 ffff88011e7b5fd8 000000000000fbc8 ffff88011e7a85f8 Call Trace: [] migration_thread+0x265/0x2e0 [] ? migration_thread+0x0/0x2e0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksoftirqd/0 S 0000000000000000 0 4 2 0x00000000 ffff88011e7b9ea0 0000000000000046 0000000000000000 ffff88011e7b9e64 0000000000016880 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011e7b7af8 ffff88011e7b9fd8 000000000000fbc8 ffff88011e7b7af8 Call Trace: [] ksoftirqd+0xd5/0x110 [] ? ksoftirqd+0x0/0x110 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/0 S 0000000000000000 0 5 2 0x00000000 ffff88011e7bbdf0 0000000000000046 0000000000000000 ffff88011e7bbdb4 0000000000000000 ffff88011fc23040 ffff880028316880 0000000000000200 ffff88011e7b7098 ffff88011e7bbfd8 000000000000fbc8 ffff88011e7b7098 Call Trace: [] ? stop_machine_cpu_stop+0x0/0xf0 [] cpu_stopper_thread+0x125/0x1b0 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? cpu_stopper_thread+0x0/0x1b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 watchdog/0 S 0000000000000000 0 6 2 0x00000000 ffff88011e7bfea0 0000000000000046 0000000000000000 ffffffff8103ea6c ffff88011e7bfe10 ffffffff81014969 ffff88011e7bfe40 ffffffff810a21c5 ffff88011e7b6638 ffff88011e7bffd8 000000000000fbc8 ffff88011e7b6638 Call Trace: [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock+0x9/0x10 [] ? sched_clock_local+0x25/0x90 [] watchdog+0x9a/0xd0 [] ? watchdog+0x0/0xd0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/1 S 0000000000000001 0 7 2 0x00000000 ffff88011e7c3e70 0000000000000046 0000000000000000 0000000000000082 ffff88011e7c3df0 ffff88010ac0aae0 ffff880028216880 ffff880028216880 ffff88011e7c1ab8 ffff88011e7c3fd8 000000000000fbc8 ffff88011e7c1ab8 Call Trace: [] migration_thread+0x265/0x2e0 [] ? migration_thread+0x0/0x2e0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/1 S 0000000000000001 0 8 2 0x00000000 ffff88011e7c5df0 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000001 ffff88011e7c4000 0000000000000001 ffff88011e7c1058 ffff88011e7c5fd8 000000000000fbc8 ffff88011e7c1058 Call Trace: [] ? stop_machine_cpu_stop+0x0/0xf0 [] cpu_stopper_thread+0x125/0x1b0 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? cpu_stopper_thread+0x0/0x1b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksoftirqd/1 S 0000000000000001 0 9 2 0x00000000 ffff88011e7cbea0 0000000000000046 0000000000000000 ffff88011e7cbe64 ffff88011e7cbea0 ffff88011fc23240 ffff880028216880 0000000000000400 ffff88011e7c05f8 ffff88011e7cbfd8 000000000000fbc8 ffff88011e7c05f8 Call Trace: [] ksoftirqd+0xd5/0x110 [] ? ksoftirqd+0x0/0x110 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 watchdog/1 S 0000000000000001 0 10 2 0x00000000 ffff88011e7d5ea0 0000000000000046 0000000000000000 ffffffff8103ea6c ffff88011e7d5e10 ffffffff81014969 ffff88011e7d5e40 ffffffff810a21c5 ffff88011e7d1098 ffff88011e7d5fd8 000000000000fbc8 ffff88011e7d1098 Call Trace: [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock+0x9/0x10 [] ? sched_clock_local+0x25/0x90 [] watchdog+0x9a/0xd0 [] ? watchdog+0x0/0xd0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 events/0 S 0000000000000000 0 11 2 0x00000000 ffff88011dc01e30 0000000000000046 0000000000000000 ffff880028219480 00000000ffffffff ffff880028213460 ffff88011dc01fd8 ffff880028219488 ffff88011e7d0638 ffff88011dc01fd8 000000000000fbc8 ffff88011e7d0638 Call Trace: [] ? dst_gc_task+0x0/0x200 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 events/1 S 0000000000000001 0 12 2 0x00000000 ffff88011dc05e30 0000000000000046 000000010000000a ffff880028319480 00000000ffffffff ffff880028313460 ffff88011dc05fd8 ffff880028319488 ffff88011dc03ab8 ffff88011dc05fd8 000000000000fbc8 ffff88011dc03ab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? vmstat_update+0x0/0x40 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 cgroup S 0000000000000000 0 13 2 0x00000000 ffff88011dc07e30 0000000000000046 0000000000000000 ffff8800282168e8 ffff88011dc07db0 ffffffff8105af80 ffff88011e7a9538 ffff8800282168e8 ffff88011dc03058 ffff88011dc07fd8 000000000000fbc8 ffff88011dc03058 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khelper S 0000000000000001 0 14 2 0x00000000 ffff88011dc0be30 0000000000000046 ffff88011dc0bdd0 ffffffff810546b9 ffff88011dc0be30 0000000300000000 0000000000000000 ffff88011cf6dab8 ffff88011dc025f8 ffff88011dc0bfd8 000000000000fbc8 ffff88011dc025f8 Call Trace: [] ? __wake_up_common+0x59/0x90 [] ? prepare_to_wait+0x4e/0x80 [] ? __call_usermodehelper+0x0/0xd0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 netns S 0000000000000001 0 15 2 0x00000000 ffff88011dc3fe30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc3daf8 ffff88011dc3ffd8 000000000000fbc8 ffff88011dc3daf8 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 async/mgr S 0000000000000000 0 16 2 0x00000000 ffff88011dc51e70 0000000000000046 0000000000000000 0000000000000000 ffff88011dc51df0 ffffffff810555ac ffff88011dc51df0 0000000000000282 ffff88011dc3d098 ffff88011dc51fd8 000000000000fbc8 ffff88011dc3d098 Call Trace: [] ? check_preempt_curr+0x7c/0x90 [] async_manager_thread+0xf3/0x150 [] ? default_wake_function+0x0/0x20 [] ? async_manager_thread+0x0/0x150 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 pm S 0000000000000001 0 17 2 0x00000000 ffff88011dc55e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc3c638 ffff88011dc55fd8 000000000000fbc8 ffff88011dc3c638 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sync_supers S 0000000000000000 0 18 2 0x00000000 ffff88011dcb9ec0 0000000000000046 0000000000000000 ffffffff8100b9ce ffff88011dcb9ec0 0000000000000001 000004c4fa460903 00000000ffffffff ffff88011dcb7ab8 ffff88011dcb9fd8 000000000000fbc8 ffff88011dcb7ab8 Call Trace: [] ? common_interrupt+0xe/0x13 [] ? bdi_sync_supers+0x0/0x60 [] bdi_sync_supers+0x3b/0x60 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 bdi-default S 0000000000000001 0 19 2 0x00000000 ffff88011dcbbdd0 0000000000000046 0000000000000000 ffff8800283168e8 ffff88011cdf00b8 0000000000000286 ffff88011dcbbd70 ffffffff81083e1c ffff88011dcb7058 ffff88011dcbbfd8 000000000000fbc8 ffff88011dcb7058 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] bdi_forker_task+0x263/0x310 [] ? bdi_forker_task+0x0/0x310 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kintegrityd/0 S 0000000000000000 0 20 2 0x00000000 ffff88011dcbfe30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011dcbfde0 ffffffff8106abeb ffff88011dcb65f8 ffff88011dcbffd8 000000000000fbc8 ffff88011dcb65f8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kintegrityd/1 S 0000000000000001 0 21 2 0x00000000 ffff88011dcc3e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011dcc3de0 ffffffff8106abeb ffff88011dcc1af8 ffff88011dcc3fd8 000000000000fbc8 ffff88011dcc1af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kblockd/0 S 0000000000000000 0 22 2 0x00000000 ffff88011dccbe30 0000000000000046 0000000000000000 ffff880117c2ee68 ffff880117c2ee68 ffff880117c2ee68 ffff880117c2ee68 ffffffff81262a50 ffff88011dcc1098 ffff88011dccbfd8 000000000000fbc8 ffff88011dcc1098 Call Trace: [] ? blk_unplug_work+0x0/0x70 [] ? blk_unplug_work+0x0/0x70 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kblockd/1 S 0000000000000001 0 23 2 0x00000000 ffff88011dccfe30 0000000000000046 0000000100000000 ffff880117c2ee68 ffff880117c2ee68 ffff880117c2ee68 ffff880117c2ee68 ffffffff81262a50 ffff88011dcc0638 ffff88011dccffd8 000000000000fbc8 ffff88011dcc0638 Call Trace: [] ? blk_unplug_work+0x0/0x70 [] ? prepare_to_wait+0x4e/0x80 [] ? blk_unplug_work+0x0/0x70 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpid S 0000000000000000 0 24 2 0x00000000 ffff88011de01e30 0000000000000046 ffff88011de01d90 ffffffff8152a32d ffff88011de01e10 ffffffff8106de63 ffff88011de01e10 0000000000000286 ffff88011ddffab8 ffff88011de01fd8 000000000000fbc8 ffff88011ddffab8 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpi_notify S 0000000000000000 0 25 2 0x00000000 ffff88011de03e30 0000000000000046 ffff88011de03d90 ffffffff8152a32d ffff88011de03e10 ffffffff8106de63 ffff88011de03e10 0000000000000286 ffff88011ddff058 ffff88011de03fd8 000000000000fbc8 ffff88011ddff058 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpi_hotplug S 0000000000000000 0 26 2 0x00000000 ffff88011de07e30 0000000000000046 ffff88011de07d90 ffffffff8152a32d ffff88011de07e10 ffffffff8106de63 ffff88011de07e10 0000000000000286 ffff88011ddfe5f8 ffff88011de07fd8 000000000000fbc8 ffff88011ddfe5f8 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_aux S 0000000000000001 0 27 2 0x00000000 ffff88011de8de30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011de8dde0 ffffffff8106abeb ffff88011de8baf8 ffff88011de8dfd8 000000000000fbc8 ffff88011de8baf8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_sff/0 S 0000000000000000 0 28 2 0x00000000 ffff88011de8fe30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011de8fde0 ffffffff8106abeb ffff88011de8b098 ffff88011de8ffd8 000000000000fbc8 ffff88011de8b098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] ? worker_thread+0x0/0x2a0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_sff/1 S 0000000000000001 0 29 2 0x00000000 ffff88011df05e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df05de0 ffffffff8106abeb ffff88011de8a638 ffff88011df05fd8 000000000000fbc8 ffff88011de8a638 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksuspend_usbd S 0000000000000001 0 30 2 0x00000000 ffff88011df09e30 0000000000000046 0000000000000000 0000000000000402 ffff88011df09df0 ffffffff813ccd0c ffff88011df09de0 ffffffff8106abeb ffff88011df07ab8 ffff88011df09fd8 000000000000fbc8 ffff88011df07ab8 Call Trace: [] ? usb_suspend_both+0x1bc/0x340 [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? usb_autosuspend_work+0x0/0x20 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khubd S 0000000000000001 0 31 2 0x00000000 ffff88011df0bd60 0000000000000046 0000000000000000 0000000000000000 0000000000000000 000004008103f9d8 00000000ffffffff ffff880118bb8c00 ffff88011df07058 ffff88011df0bfd8 000000000000fbc8 ffff88011df07058 Call Trace: [] hub_thread+0x379/0x1a40 [] ? dequeue_task_fair+0x12b/0x130 [] ? autoremove_wake_function+0x0/0x40 [] ? hub_thread+0x0/0x1a40 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kseriod S 0000000000000000 0 32 2 0x00000000 ffff88011df0fe50 0000000000000046 ffff88011df0fdd0 ffffffff810a0f5f ffff88011df0fe10 ffff88011de74b38 ffff88011df0fe30 0000000000000286 ffff88011df065f8 ffff88011df0ffd8 000000000000fbc8 ffff88011df065f8 Call Trace: [] ? up+0x2f/0x50 [] ? prepare_to_wait+0x4e/0x80 [] serio_thread+0x39a/0x450 [] ? autoremove_wake_function+0x0/0x40 [] ? serio_thread+0x0/0x450 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md/0 S 0000000000000000 0 33 2 0x00000000 ffff88011df13e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df13de0 ffffffff8106abeb ffff88011df11af8 ffff88011df13fd8 000000000000fbc8 ffff88011df11af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md/1 S 0000000000000001 0 34 2 0x00000000 ffff88011df15e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df15de0 ffffffff8106abeb ffff88011df11098 ffff88011df15fd8 000000000000fbc8 ffff88011df11098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md_misc/0 S 0000000000000000 0 35 2 0x00000000 ffff88011df19e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df19de0 ffffffff8106abeb ffff88011df10638 ffff88011df19fd8 000000000000fbc8 ffff88011df10638 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md_misc/1 S 0000000000000001 0 36 2 0x00000000 ffff88011df1fe30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df1fde0 ffffffff8106abeb ffff88011df1dab8 ffff88011df1ffd8 000000000000fbc8 ffff88011df1dab8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 linkwatch S 0000000000000001 0 37 2 0x00000000 ffff88011df21e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df21de0 ffffffff8106abeb ffff88011df1d058 ffff88011df21fd8 000000000000fbc8 ffff88011df1d058 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? linkwatch_event+0x0/0x30 [] ? linkwatch_event+0x0/0x30 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khungtaskd S 0000000000000001 0 38 2 0x00000000 ffff8801188d3dd0 0000000000000046 0000000000000000 ffffffff8160bf40 0000000000000001 0000000000000286 ffff8801188d3d70 ffffffff81083e1c ffff88011df1c5f8 ffff8801188d3fd8 000000000000fbc8 ffff88011df1c5f8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] watchdog+0x52/0x250 [] ? watchdog+0x0/0x250 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kswapd0 S 0000000000000001 0 39 2 0x00000000 ffff8801188d7e20 0000000000000046 0000000000000000 000000028152a51a ffff88002804d000 0000000000000000 0000000000000000 ffffffff81c06500 ffff8801188d5af8 ffff8801188d7fd8 000000000000fbc8 ffff8801188d5af8 Call Trace: [] kswapd+0x309/0x3b0 [] ? autoremove_wake_function+0x0/0x40 [] ? kswapd+0x0/0x3b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksmd S 0000000000000001 0 40 2 0x00000000 ffff880118947e10 0000000000000046 0000000000000000 ffff8801188d4ae0 ffff880118947da0 ffffffff8106a33b ffff880118947da0 ffff8801188d4ae0 ffff8801188d5098 ffff880118947fd8 000000000000fbc8 ffff8801188d5098 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] ksm_scan_thread+0xa5b/0x1120 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? autoremove_wake_function+0x0/0x40 [] ? ksm_scan_thread+0x0/0x1120 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khugepaged S 0000000000000000 0 41 2 0x00000000 ffff88011894dce0 0000000000000046 ffffea00030b3620 ffffea00030b3658 ffffea00030b3690 ffffea00030b36c8 ffffea00030b3700 ffffea00030b3738 ffff8801188d4638 ffff88011894dfd8 000000000000fbc8 ffff8801188d4638 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] khugepaged+0x4ec/0x1310 [] ? autoremove_wake_function+0x0/0x40 [] ? khugepaged+0x0/0x1310 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 aio/0 S 0000000000000000 0 42 2 0x00000000 ffff880118a11e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011894fab8 ffff880118a11fd8 000000000000fbc8 ffff88011894fab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 aio/1 S 0000000000000001 0 43 2 0x00000000 ffff880118a15e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011894f058 ffff880118a15fd8 000000000000fbc8 ffff88011894f058 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 crypto/0 S 0000000000000000 0 44 2 0x00000000 ffff880118a69e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011894e5f8 ffff880118a69fd8 000000000000fbc8 ffff88011894e5f8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 crypto/1 S 0000000000000001 0 45 2 0x00000000 ffff880118a6de30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880118a6baf8 ffff880118a6dfd8 000000000000fbc8 ffff880118a6baf8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kthrotld/0 S 0000000000000000 0 50 2 0x00000000 ffff880118aade30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff880118aadde0 ffffffff8106abeb ffff880118aa25f8 ffff880118aadfd8 000000000000fbc8 ffff880118aa25f8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kthrotld/1 S 0000000000000001 0 51 2 0x00000000 ffff880118ac1e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff880118ac1de0 ffffffff8106abeb ffff880118aafaf8 ffff880118ac1fd8 000000000000fbc8 ffff880118aafaf8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kpsmoused S 0000000000000001 0 53 2 0x00000000 ffff880118be3e30 0000000000000046 0000000000000000 ffff8800282168e8 ffff880118be3db0 ffffffff8105af80 ffff88011e7a9538 ffff8800282168e8 ffff880118aaf098 ffff880118be3fd8 000000000000fbc8 ffff880118aaf098 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 usbhid_resume S 0000000000000001 0 54 2 0x00000000 ffff880118be7e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880118aae638 ffff880118be7fd8 000000000000fbc8 ffff880118aae638 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kstriped S 0000000000000001 0 83 2 0x00000000 ffff8801184cde30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880118445058 ffff8801184cdfd8 000000000000fbc8 ffff880118445058 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 scsi_eh_0 S 0000000000000000 0 228 2 0x00000000 ffff880118769e20 0000000000000046 0000000000000000 0000000000000282 ffff880118769de0 ffffffff813a4447 ffff880118769de0 ffffffff813a2dd8 ffff88011869f098 ffff880118769fd8 000000000000fbc8 ffff88011869f098 Call Trace: [] ? ata_scsi_port_error_handler+0x627/0x710 [] ? ata_scsi_cmd_error_handler+0x128/0x180 [] scsi_error_handler+0x99/0x810 [] ? default_wake_function+0x12/0x20 [] ? scsi_error_handler+0x0/0x810 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 scsi_eh_1 S 0000000000000000 0 229 2 0x00000000 ffff880118735e20 0000000000000046 000000000000000f 0000000000000282 ffff880118735de0 ffffffff813a4447 ffff880118735de0 ffffffff813a2dd8 ffff88011869faf8 ffff880118735fd8 000000000000fbc8 ffff88011869faf8 Call Trace: [] ? ata_scsi_port_error_handler+0x627/0x710 [] ? ata_scsi_cmd_error_handler+0x128/0x180 [] scsi_error_handler+0x99/0x810 [] ? default_wake_function+0x12/0x20 [] ? scsi_error_handler+0x0/0x810 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 virtio-blk S 0000000000000000 0 274 2 0x00000000 ffff880117c29e30 0000000000000046 ffff8801187ecae8 ffff8800282168e8 ffff880117c29db0 ffffffff8105af80 ffff8801187ecad8 ffff8800282168e8 ffff88011844f098 ffff880117c29fd8 000000000000fbc8 ffff88011844f098 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 jbd2/vda1-8 S 0000000000000001 0 287 2 0x00000000 ffff880117c13e60 0000000000000046 0000000000002058 0000000000000000 00000000000000c3 0000000000000000 0000000000000000 0000000000000001 ffff8801187edab8 ffff880117c13fd8 000000000000fbc8 ffff8801187edab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] kjournald2+0x1fa/0x220 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? kjournald2+0x0/0x220 [jbd2] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ext4-dio-unwr S 0000000000000001 0 288 2 0x00000000 ffff880117c07e30 0000000000000046 ffff8801184ca088 ffff8800283168e8 ffff880117c07db0 ffffffff8105af80 ffff8801184ca078 ffff8800283168e8 ffff880118571098 ffff880117c07fd8 000000000000fbc8 ffff880118571098 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 udevd S 0000000000000001 0 361 1 0x00000000 ffff88011d389a58 0000000000000082 ffff88011d3899e8 ffffffff811a0d56 0000000000000000 ffff880118696040 ffffffff81061d00 0000000000000000 ffff880118603058 ffff88011d389fd8 000000000000fbc8 ffff880118603058 Call Trace: [] ? pollwake+0x56/0x60 [] ? default_wake_function+0x0/0x20 [] ? _spin_unlock_irqrestore+0x17/0x20 [] schedule_hrtimeout_range+0x13d/0x160 [] ? __pollwait+0x75/0xf0 [] ? add_wait_queue+0x46/0x60 [] ? unix_dgram_poll+0x127/0x1c0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? autoremove_wake_function+0x0/0x40 [] ? generic_file_aio_write+0xba/0x100 [] ? do_sync_write+0xfa/0x140 [] ? sys_recvfrom+0xee/0x180 [] ? vfs_write+0x132/0x1a0 [] sys_poll+0x71/0x100 [] system_call_fastpath+0x16/0x1b virtio-net S 0000000000000001 0 397 2 0x00000000 ffff880118559e30 0000000000000046 ffff880118696088 ffff8800283168e8 ffff880118559db0 ffffffff8105af80 ffff880118696078 ffff8800283168e8 ffff8801186af058 ffff880118559fd8 000000000000fbc8 ffff8801186af058 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 vballoon S 0000000000000001 0 412 2 0x00000000 ffff880119b1fe40 0000000000000046 0000000000000000 0000000000000000 ffff88011856f028 ffffffffffffff00 0000000000000004 000000000001c074 ffff88011844e638 ffff880119b1ffd8 000000000000fbc8 ffff88011844e638 Call Trace: [] ? vp_get+0x50/0x70 [virtio_pci] [] balloon+0x204/0x260 [virtio_balloon] [] ? autoremove_wake_function+0x0/0x40 [] ? balloon+0x0/0x260 [virtio_balloon] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kauditd S 0000000000000000 0 699 2 0x00000000 ffff88011d3d5e70 0000000000000046 ffff88011d3d5e38 ffff88011d3d5e34 ffff88010ac02b80 ffff88011fc23040 ffff880028316880 00000000000006e2 ffff88011843d098 ffff88011d3d5fd8 000000000000fbc8 ffff88011843d098 Call Trace: [] kauditd_thread+0x149/0x180 [] ? default_wake_function+0x0/0x20 [] ? kauditd_thread+0x0/0x180 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 flush-252:0 S 0000000000000000 0 846 2 0x00000000 ffff880119065da0 0000000000000046 0000000000000000 ffff880119065d64 ffff880100000000 ffff880117c2f118 00000001006edaae ffff880117c2f108 ffff880118603ab8 ffff880119065fd8 000000000000fbc8 ffff880118603ab8 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 dhclient S 0000000000000001 0 880 1 0x00000000 ffff880119a2d908 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000001 0000000100000286 ffff880119a2d8a8 ffffffff8109f4a1 ffff8801187ed058 ffff880119a2dfd8 000000000000fbc8 ffff8801187ed058 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] ? get_page_from_freelist+0x3d1/0x870 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? enqueue_task_fair+0xfb/0x100 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? release_sock+0xe5/0x110 [] ? skb_free_datagram_locked+0x36/0x50 [] ? udp_recvmsg+0x17c/0x320 [] ? inet_recvmsg+0x5a/0x90 [] ? sock_recvmsg+0x133/0x160 [] ? autoremove_wake_function+0x0/0x40 [] core_sys_select+0x18a/0x2c0 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] sys_select+0x47/0x110 [] system_call_fastpath+0x16/0x1b auditd S 0000000000000001 0 918 1 0x00000000 ffff8801192b3da8 0000000000000086 ffff8801192b3d98 ffffffff8109fde3 ffff880100000001 0000000100000282 ffff8801192b3d88 ffffffff81061b6e ffff8801184445f8 ffff8801192b3fd8 000000000000fbc8 ffff8801184445f8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? try_to_wake_up+0x24e/0x3e0 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] ? ktime_get_ts+0xb1/0xf0 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b auditd S 0000000000000001 0 919 1 0x00000000 ffff880119a0fbf8 0000000000000086 0000000000000000 0000000000000000 ffff880119a0fb78 ffffffff81130259 ffff880119a0fb88 ffffffff81283919 ffff880118ff9098 ffff880119a0ffd8 000000000000fbc8 ffff880118ff9098 Call Trace: [] ? free_pages+0x49/0x50 [] ? cpumask_next_and+0x29/0x50 [] futex_wait_queue_me+0xb9/0xf0 [] futex_wait+0x1f0/0x360 [] ? futex_wake+0x10e/0x120 [] do_futex+0x121/0xb50 [] ? jbd2_log_wait_commit+0xf5/0x140 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? do_writepages+0x21/0x40 [] ? jbd2_complete_transaction+0x68/0xb0 [jbd2] [] ? ext4_sync_file+0x121/0x1d0 [ext4] [] sys_futex+0x7b/0x170 [] ? vfs_fsync+0x1d/0x20 [] ? do_fsync+0x49/0x60 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000000 0 934 1 0x00000080 ffff88011a241908 0000000000000082 ffff88011a2418f8 ffffffff8109fde3 0000000000000000 0000000100025dd8 0000000000000001 ffff880000037c20 ffff88011ba67ab8 ffff88011a241fd8 000000000000fbc8 ffff88011ba67ab8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? get_page_from_freelist+0x3d1/0x870 [] ? __rmqueue+0x143/0x490 [] ? __pollwait+0x0/0xf0 [] ? perf_event_task_sched_out+0x33/0x70 [] ? reschedule_interrupt+0xe/0x20 [] ? find_get_page+0x1e/0xa0 [] ? filemap_fault+0xd3/0x500 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? enqueue_entity+0x125/0x450 [] ? check_preempt_wakeup+0x1a4/0x260 [] ? enqueue_task_fair+0xfb/0x100 [] ? check_preempt_curr+0x7c/0x90 [] ? try_to_wake_up+0x24e/0x3e0 [] ? sched_clock_local+0x25/0x90 [] core_sys_select+0x18a/0x2c0 [] ? up_read+0x1f/0x30 [] ? __do_page_fault+0x1ec/0x480 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] sys_select+0x47/0x110 [] system_call_fastpath+0x16/0x1b rs:main Q:Reg S 0000000000000001 0 935 1 0x00000080 ffff8801186c7bf8 0000000000000082 ffff8801186c7bc0 ffff8801186c7bbc ffff880037d2b3d8 ffff88011fc23240 ffff880028216880 00000000000006e2 ffff880119a92638 ffff8801186c7fd8 000000000000fbc8 ffff880119a92638 Call Trace: [] futex_wait_queue_me+0xb9/0xf0 [] futex_wait+0x1f0/0x360 [] ? generic_file_aio_write+0xba/0x100 [] do_futex+0x121/0xb50 [] ? fsnotify_add_notify_event+0x12d/0x280 [] ? autoremove_wake_function+0x0/0x40 [] sys_futex+0x7b/0x170 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000001 0 937 1 0x00000080 ffff880119a73908 0000000000000082 0000000000000000 ffff880119a738cc ffff880119a738c8 ffff88011fc23240 ffff880028216880 0000000000000400 ffff880119271058 ffff880119a73fd8 000000000000fbc8 ffff880119271058 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? __pollwait+0x75/0xf0 [] ? common_interrupt+0xe/0x13 [] ? unix_dgram_poll+0x127/0x1c0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? sock_recvmsg+0x133/0x160 [] ? autoremove_wake_function+0x0/0x40 [] ? enqueue_entity+0x125/0x450 [] ? check_preempt_wakeup+0x1a4/0x260 [] ? enqueue_task_fair+0xfb/0x100 [] ? check_preempt_curr+0x7c/0x90 [] ? try_to_wake_up+0x24e/0x3e0 [] core_sys_select+0x18a/0x2c0 [] ? __sys_recvmsg+0x13c/0x2f0 [] ? pvclock_clocksource_read+0x58/0xd0 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000001 0 938 1 0x00000080 ffff880119269df8 0000000000000082 ffff880119269dc0 0000000000000282 000000000000fbc8 ffff880119a92080 ffff8801186c7c98 00007f1e24541000 ffff8801192705f8 ffff880119269fd8 000000000000fbc8 ffff8801192705f8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] do_syslog+0x461/0x4c0 [] ? autoremove_wake_function+0x0/0x40 [] kmsg_read+0x32/0x60 [] proc_reg_read+0x7e/0xc0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rpcbind S 0000000000000000 0 952 1 0x00000080 ffff880119aa5a58 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000000 0000000100000286 ffff880119aa59f8 ffffffff8109f4a1 ffff880118a6b098 ffff880119aa5fd8 000000000000fbc8 ffff880118a6b098 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? fsnotify_clear_marks_by_inode+0x32/0xf0 [] ? sock_destroy_inode+0x19/0x20 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] ? poll_select_set_timeout+0x95/0xb0 [] sys_poll+0x71/0x100 [] system_call_fastpath+0x16/0x1b rpc.statd S 0000000000000000 0 970 1 0x00000080 ffff880119b11908 0000000000000082 ffff880119b118d0 ffff880119b118cc ffff880118a6ab18 ffff88011fc23040 ffff880028316880 0000000000000400 ffff8801184cb058 ffff880119b11fd8 000000000000fbc8 ffff8801184cb058 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? default_wake_function+0x0/0x20 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? __wake_up_common+0x59/0x90 [] ? handle_pte_fault+0x2cd/0xb00 [] ? pipe_write+0x318/0x6a0 [] core_sys_select+0x18a/0x2c0 [] ? __do_page_fault+0x1ec/0x480 [] ? __d_free+0x3f/0x60 [] ? d_free+0x58/0x60 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] system_call_fastpath+0x16/0x1b rpciod/0 S 0000000000000000 0 5062 2 0x00000080 ffff88011b5b5e30 0000000000000046 0000000000000000 ffffe8ffffc070c8 ffff88011b5b5dd0 ffff88011873e000 ffff88011873e5d0 00000000ffffff95 ffff88011ba61ab8 ffff88011b5b5fd8 000000000000fbc8 ffff88011ba61ab8 Call Trace: [] ? xs_tcp_setup_socket+0x0/0x4c0 [sunrpc] [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 rpciod/1 S 0000000000000001 0 5063 2 0x00000080 ffff88011b5b7e30 0000000000000046 0000000000000000 0000000000000246 ffff88011b5b7da0 ffffffff8152c2cb ffff88011b5b7dd0 ffffffffa01aab71 ffff88011ba605f8 ffff88011b5b7fd8 000000000000fbc8 ffff88011ba605f8 Call Trace: [] ? _spin_unlock_bh+0x1b/0x20 [] ? rpc_wake_up_first+0xc1/0x1e0 [sunrpc] [] ? xprt_autoclose+0x0/0x70 [sunrpc] [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kslowd000 S 0000000000000000 0 5065 2 0x00000080 ffff880118779e60 0000000000000046 ffff880118779e28 ffff880118779e24 ffffffffffffffff ffff88011fc23040 ffff880028316880 0000000000000400 ffff880118aa3ab8 ffff880118779fd8 000000000000fbc8 ffff880118aa3ab8 Call Trace: [] slow_work_thread+0x32b/0x360 [] ? autoremove_wake_function+0x0/0x40 [] ? slow_work_thread+0x0/0x360 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kslowd001 S 0000000000000000 0 5066 2 0x00000080 ffff880118ea7e60 0000000000000046 0000000000000000 0000000a00000003 ffffffffffffffff ffffffff8106a33b ffff880118ea7df0 ffff880118ea7e80 ffff880119a93098 ffff880118ea7fd8 000000000000fbc8 ffff880119a93098 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] slow_work_thread+0x32b/0x360 [] ? autoremove_wake_function+0x0/0x40 [] ? slow_work_thread+0x0/0x360 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 nfsiod S 0000000000000000 0 5067 2 0x00000080 ffff880118eebe30 0000000000000046 0000000000000000 0000000000000286 ffff880118eebde0 ffffffff8153095c ffff880118aa2ad8 ffff8800282168e8 ffff88011843daf8 ffff880118eebfd8 000000000000fbc8 ffff88011843daf8 Call Trace: [] ? kprobe_flush_task+0xbc/0xe0 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 nfsv4.0-svc S 0000000000000001 0 5068 2 0x00000080 ffff8801186d9d70 0000000000000046 0000000000000000 000000020000f9d8 0000000000000001 ffff880028310660 00000000ffffffff 0000000000000008 ffff880118571af8 ffff8801186d9fd8 000000000000fbc8 ffff880118571af8 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? __switch_to+0xd0/0x320 [] svc_recv+0x5a5/0x850 [sunrpc] [] ? default_wake_function+0x0/0x20 [] nfs4_callback_svc+0x43/0xb0 [nfs] [] ? nfs4_callback_svc+0x0/0xb0 [nfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 master S 0000000000000001 0 5156 1 0x00000080 ffff88011b5cfda8 0000000000000082 ffff88011b5cfd98 ffffffff8109fde3 ffff880100000001 000000018109eeeb 0000000c00000000 ffff88011c80a4c0 ffff88011869b098 ffff88011b5cffd8 000000000000fbc8 ffff88011869b098 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b qmgr S 0000000000000000 0 5167 5156 0x00000080 ffff88011b5d3da8 0000000000000086 0000000000000000 ffffffff8109fde3 ffff880100000000 000000011c80dd80 0000000c00000000 ffff88011c9450c0 ffff8801184ca5f8 ffff88011b5d3fd8 000000000000fbc8 ffff8801184ca5f8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b sshd S 0000000000000001 0 5736 1 0x00000080 ffff88011a25f908 0000000000000082 0000000000000000 ffff88011a25f8cc 0000000000000000 ffff88011fc23240 ffff880028216880 00000000000009c5 ffff88011843c638 ffff88011a25ffd8 000000000000fbc8 ffff88011843c638 Call Trace: [] ? get_page_from_freelist+0x3d1/0x870 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? call_rcu_sched+0x15/0x20 [] ? call_rcu+0xe/0x10 [] ? vsnprintf+0x450/0x5e0 [] ? d_lookup+0x35/0x60 [] core_sys_select+0x18a/0x2c0 [] ? security_task_wait+0x16/0x20 [] ? wait_consider_task+0x9d/0xb20 [] ? remove_wait_queue+0x3c/0x50 [] ? fpu_finit+0x21/0x40 [] ? init_fpu+0x59/0xc0 [] ? __audit_syscall_exit+0x25e/0x290 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? int_check_syscall_exit_work+0x34/0x3d [] system_call_fastpath+0x16/0x1b agetty S 0000000000000000 0 5756 1 0x00000080 ffff8801186abcc8 0000000000000082 0000000000000000 ffffffff8114a649 0000000118013025 0000000000000000 0000000000000000 ffffea0003d81ee0 ffff8801186025f8 ffff8801186abfd8 000000000000fbc8 ffff8801186025f8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? uart_write+0xe9/0x120 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5757 1 0x00000080 ffff880118fb9cc8 0000000000000082 ffff880118fb9ca8 ffffffff8114a649 0000000118013025 0000000000000000 0000000000000000 ffffea0003d594c0 ffff880119a93af8 ffff880118fb9fd8 000000000000fbc8 ffff880119a93af8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5759 1 0x00000080 ffff880118597cc8 0000000000000082 ffff880028216880 ffff8801186af538 ffff88011869a0b8 ffff880028216880 ffff880118597c98 ffffffff8105ad54 ffff8801186afab8 ffff880118597fd8 000000000000fbc8 ffff8801186afab8 Call Trace: [] ? check_preempt_wakeup+0x1a4/0x260 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5761 1 0x00000080 ffff880118fd5cc8 0000000000000086 000000000000fbc8 ffff88011869a638 ffff8801186af500 ffff88011869a080 ffff880118fd5c58 00000000186af500 ffff88011869a638 ffff880118fd5fd8 000000000000fbc8 ffff88011869a638 Call Trace: [] ? schedule_timeout+0x215/0x2e0 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5763 1 0x00000080 ffff880119291cc8 0000000000000086 ffff880119291c90 ffff880119291c8c 0000000118013025 ffff88011fc23040 ffff880028316880 0000000000000400 ffff8801184cbab8 ffff880119291fd8 000000000000fbc8 ffff8801184cbab8 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b udevd S 0000000000000001 0 5765 361 0x00000080 ffff880118e95a08 0000000000000086 ffff880118e95998 ffff8800283168e8 ffff880028316918 ffff8800283168e8 ffff880118602ad8 000000000001bfd3 ffff8801186965f8 ffff880118e95fd8 000000000000fbc8 ffff8801186965f8 Call Trace: [] ? wakeup_preempt_entity+0x47/0x50 [] ? check_preempt_wakeup+0x1a4/0x260 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? unix_dgram_sendmsg+0x5e5/0x6d0 [] ? sock_sendmsg+0x123/0x150 [] ? autoremove_wake_function+0x0/0x40 [] ? __sys_sendmsg+0x406/0x420 [] ? mntput_no_expire+0x30/0x110 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? sys_sendto+0x139/0x190 [] sys_ppoll+0x4c/0x180 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b udevd S 0000000000000001 0 5766 361 0x00000080 ffff88011889fa08 0000000000000082 ffff88011889f998 ffff8800282168e8 ffff880028216918 ffff8800282168e8 ffff880118602ad8 000000000002b3e6 ffff88011869baf8 ffff88011889ffd8 000000000000fbc8 ffff88011869baf8 Call Trace: [] ? wakeup_preempt_entity+0x47/0x50 [] ? check_preempt_wakeup+0x1a4/0x260 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? unix_dgram_sendmsg+0x5e5/0x6d0 [] ? sock_sendmsg+0x123/0x150 [] ? autoremove_wake_function+0x0/0x40 [] ? handle_mm_fault+0x22a/0x300 [] ? __do_page_fault+0x1ec/0x480 [] ? sys_sendto+0x139/0x190 [] sys_ppoll+0x4c/0x180 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5767 1 0x00000080 ffff88011cc45cc8 0000000000000086 0000000000000000 ffffffff8114a649 0000000118013025 0000000000000000 0000000000000000 ffffea0003e64950 ffff880119271ab8 ffff88011cc45fd8 000000000000fbc8 ffff880119271ab8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5769 1 0x00000080 ffff880118e59cc8 0000000000000082 0000000000000000 ffffffff8114a649 0000000118013025 0000000000000000 0000000000000000 ffffea0003e0b710 ffff880118aa3058 ffff880118e59fd8 000000000000fbc8 ffff880118aa3058 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b cfs_rh_00 S 0000000000000001 0 5986 2 0x00000080 ffff88011ce2fe40 0000000000000046 00000000ffffff8e 0000000000000000 0000000000000008 0000000000000005 ffff88011ce2fe40 ffffffffa033dcf9 ffff880119019058 ffff88011ce2ffd8 000000000000fbc8 ffff880119019058 Call Trace: [] ? cfs_hash_rehash_worker+0x319/0x4f0 [libcfs] [] ? prepare_to_wait_exclusive+0x4e/0x80 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 cfs_rh_01 S 0000000000000001 0 5987 2 0x00000080 ffff88011ce31e40 0000000000000046 0000000000000000 0000000000000000 0000000000000008 0000000000000005 ffff88011ce31e40 ffffffffa033dcf9 ffff88011ba61058 ffff88011ce31fd8 000000000000fbc8 ffff88011ba61058 Call Trace: [] ? cfs_hash_rehash_worker+0x319/0x4f0 [libcfs] [] ? prepare_to_wait_exclusive+0x4e/0x80 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 obd_zombid S 0000000000000001 0 6008 2 0x00000080 ffff880118cefe60 0000000000000046 0000000000000000 ffff8800283119a0 ffffffff81aaa5c0 0000000000000282 ffff880118cefe00 0000000000000282 ffff880118445ab8 ffff880118ceffd8 000000000000fbc8 ffff880118445ab8 Call Trace: [] obd_zombie_impexp_thread+0xd8/0x190 [obdclass] [] ? default_wake_function+0x0/0x20 [] ? obd_zombie_impexp_thread+0x0/0x190 [obdclass] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpc_hr00_0 S 0000000000000000 0 6009 2 0x00000080 ffff88011909ddd0 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff88011909dd60 0000000000000282 ffff88011871e5c0 ffff88010b29e800 ffff880118a6a638 ffff88011909dfd8 000000000000fbc8 ffff880118a6a638 Call Trace: [] ptlrpc_hr_main+0x14a/0x770 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpc_hr00_0 S 0000000000000000 0 6010 2 0x00000080 ffff880119279dd0 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff880119279d60 0000000000000282 ffff88011871e3c0 ffff88010b29e800 ffff88011ce2bab8 ffff880119279fd8 000000000000fbc8 ffff88011ce2bab8 Call Trace: [] ptlrpc_hr_main+0x14a/0x770 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd00 S 0000000000000000 0 6013 2 0x00000080 ffff88011cee7d60 0000000000000046 ffff88011cee7cf0 ffffffff81058bd3 0000000000000000 ffff88011a912000 ffff88011cee7cf0 0000000000000246 ffff880118e5e638 ffff88011cee7fd8 000000000000fbc8 ffff880118e5e638 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd01 S 0000000000000001 0 6014 2 0x00000080 ffff88011cef1d60 0000000000000046 ffff88011cef1cf0 ffffffff81058bd3 0000000000000000 ffff8801192ee000 ffff88011cef1cf0 0000000000000246 ffff8801184cfab8 ffff88011cef1fd8 000000000000fbc8 ffff8801184cfab8 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd02 S 0000000000000001 0 6015 2 0x00000080 ffff88011ce1bd60 0000000000000046 0000000000000000 ffffffff81058bd3 0000000000000000 ffff88011b044000 ffff88011ce1bcf0 0000000000000246 ffff880118ff9af8 ffff88011ce1bfd8 000000000000fbc8 ffff880118ff9af8 Call Trace: [] ? __wake_up+0x53/0x70 [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd03 S 0000000000000000 0 6016 2 0x00000080 ffff88011ce89d60 0000000000000046 ffff88011ce89cf0 ffffffff81058bd3 0000000000000000 ffff88010df3c000 ffff88011ce89cf0 0000000000000246 ffff880118ff8638 ffff88011ce89fd8 000000000000fbc8 ffff880118ff8638 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_reape S 0000000000000000 0 6017 2 0x00000080 ffff88011cee9d30 0000000000000046 0000000000000000 ffff88011cee9cf4 0000000000000010 0000000000000282 ffff88011cee9cd0 ffffffff81083e1c ffff88011844faf8 ffff88011cee9fd8 000000000000fbc8 ffff88011844faf8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ksocknal_reaper+0xc4b/0xd60 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_reaper+0x0/0xd60 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_sd00_ S 0000000000000001 0 6018 2 0x00000080 ffff88011ceebde0 0000000000000046 ffff88011ceebda8 ffff88011ceebda4 ffff88011ceebdb0 ffff88011fc23240 ffff880028216880 0000000000000400 ffff880118477ab8 ffff88011ceebfd8 000000000000fbc8 ffff880118477ab8 Call Trace: [] ksocknal_scheduler+0xdb1/0x1390 [ksocklnd] [] ? autoremove_wake_function+0x0/0x40 [] ? ksocknal_scheduler+0x0/0x1390 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_sd00_ S 0000000000000001 0 6019 2 0x00000080 ffff88011ceedde0 0000000000000046 0000000000000000 ffff880117ce3d80 ffff88011ceeddb0 ffffffffa03b1c5f ffff88011ceedd70 ffffffff81449581 ffff880118570638 ffff88011ceedfd8 000000000000fbc8 ffff880118570638 Call Trace: [] ? lnet_finalize+0x2bf/0x730 [lnet] [] ? kernel_sendmsg+0x41/0x60 [] ksocknal_scheduler+0xdb1/0x1390 [ksocklnd] [] ? autoremove_wake_function+0x0/0x40 [] ? ksocknal_scheduler+0x0/0x1390 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 acceptor_001 S 0000000000000000 0 6020 2 0x00000080 ffff88011ce83dd0 0000000000000046 ffff88011ce83d40 ffffffff81fd0820 ffff88011dc24400 ffff8801194ff208 ffff88011ce83d70 ffffffff811a79f2 ffff88011ce81af8 ffff88011ce83fd8 000000000000fbc8 ffff88011ce81af8 Call Trace: [] ? new_inode+0x72/0xb0 [] lnet_sock_accept+0x13d/0x170 [lnet] [] ? default_wake_function+0x0/0x20 [] lnet_acceptor+0x1b7/0xb50 [lnet] [] ? lnet_acceptor+0x0/0xb50 [lnet] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 router_checke S 0000000000000000 0 6021 2 0x00000080 ffff88011ce85e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011ce81098 ffff88011ce85fd8 000000000000fbc8 ffff88011ce81098 Call Trace: [] lnet_router_checker+0x469/0x520 [lnet] [] ? autoremove_wake_function+0x0/0x40 [] ? lnet_router_checker+0x0/0x520 [lnet] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_rcv S 0000000000000001 0 6022 2 0x00000080 ffff88011ce87d10 0000000000000046 0000000000000000 ffff88011ce87cd4 ffff88010c0de800 0000000000000286 ffff88011ce87cb0 ffffffff81083e1c ffff88011ce80638 ffff88011ce87fd8 000000000000fbc8 ffff88011ce80638 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_0 S 0000000000000000 0 6023 2 0x00000080 ffff88011ce19d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff8800370b9580 ffff8801185ac0c0 ffff88011ce19cf0 0000000000000282 ffff8801186e7ab8 ffff88011ce19fd8 000000000000fbc8 ffff8801186e7ab8 Call Trace: [] ? __wake_up+0x53/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_1 S 0000000000000001 0 6024 2 0x00000080 ffff8801190a9d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff880118687a80 0000000000000286 ffff8801190a9cb0 ffffffff81083e1c ffff8801186e7058 ffff8801190a9fd8 000000000000fbc8 ffff8801186e7058 Call Trace: [] ? __wake_up+0x53/0x70 [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ping S 0000000000000001 0 6025 2 0x00000080 ffff8801190abd40 0000000000000046 ffffffffa04d70a0 ffff8801106de380 00000000ffffffff ffff8801011fba90 ffff8801190abd10 ffffffff8128daa4 ffff8801186e65f8 ffff8801190abfd8 000000000000fbc8 ffff8801186e65f8 Call Trace: [] ? snprintf+0x34/0x40 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpc_pinger_main+0x928/0xac0 [ptlrpc] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_pinger_main+0x0/0xac0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sptlrpc_gc S 0000000000000000 0 6026 2 0x00000080 ffff880118ce3da0 0000000000000046 0000000000000000 ffff880028316880 ffff880118ce3d10 0000000000000282 ffff880118ce3d40 ffffffff81083e1c ffff880118ce1af8 ffff880118ce3fd8 000000000000fbc8 ffff880118ce1af8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] sec_gc_main+0x28e/0x390 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? sec_gc_main+0x0/0x390 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 flush-252:16 S 0000000000000000 0 8059 2 0x00000080 ffff880101669da0 0000000000000046 0000000000000000 0000000000000001 ffff880028216918 ffff880117c2e5e8 00000001006edaaa ffff880117c2e5d8 ffff8801092ce5f8 ffff880101669fd8 000000000000fbc8 ffff8801092ce5f8 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 pickup S 0000000000000001 0 27351 5156 0x00000080 ffff88010cd73da8 0000000000000086 0000000000000000 ffffffff8109fde3 ffff880100000001 000000018109eeeb ffff88010cd73d48 ffffffff8109f4a1 ffff88010d949058 ffff88010cd73fd8 000000000000fbc8 ffff88010d949058 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b sshd S 0000000000000000 0 11721 5736 0x00000080 ffff880037bc3908 0000000000000082 0000000000000000 ffff880037019828 ffff880037bc3888 ffffffff814b22fd ffff880037019828 ffff880117c706e0 ffff880118ce0638 ffff880037bc3fd8 000000000000fbc8 ffff880118ce0638 Call Trace: [] ? tcp_wfree+0x3d/0xd0 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? unlock_page+0x27/0x30 [] ? __do_fault+0x469/0x530 [] ? handle_pte_fault+0xf7/0xb00 [] ? release_sock+0xe5/0x110 [] core_sys_select+0x18a/0x2c0 [] ? __wake_up_sync_key+0x5e/0x80 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sh S 0000000000000001 0 11723 11721 0x00000080 ffff88003788de78 0000000000000086 0000000000000000 0000000000000028 0000000000440910 ffff88011876e2c0 ffff88011a940530 0000000000000014 ffff8800df6dd058 ffff88003788dfd8 000000000000fbc8 ffff8800df6dd058 Call Trace: [] do_wait+0x1e4/0x240 [] sys_wait4+0xa3/0x100 [] ? child_wait_callback+0x0/0x70 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b tail S 0000000000000001 0 11732 11723 0x00000080 ffff8800378ede28 0000000000000082 0000000000000000 ffffffffa0083e08 0000000000000001 ffff8800378eddc8 ffff8800378eddc8 ffff880119a6b200 ffff88011869e638 ffff8800378edfd8 000000000000fbc8 ffff88011869e638 Call Trace: [] ? ext4_file_write+0x58/0x190 [ext4] [] inotify_read+0xe9/0x330 [] ? autoremove_wake_function+0x0/0x40 [] ? security_file_permission+0x16/0x20 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b jbd2/vdb-8 S 0000000000000000 0 12583 2 0x00000080 ffff88010c0dbe60 0000000000000046 0000000000000000 0000000000000000 00000000000015be 0000000000000000 0000000000000000 0000000000000001 ffff880119019ab8 ffff88010c0dbfd8 000000000000fbc8 ffff880119019ab8 Call Trace: [] kjournald2+0x1fa/0x220 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? kjournald2+0x0/0x220 [jbd2] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldiskfs-dio-u S 0000000000000001 0 12584 2 0x00000080 ffff8801106a1e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff8801106a1de0 ffffffff8106abeb ffff88011a1f1098 ffff8801106a1fd8 000000000000fbc8 ffff88011a1f1098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_000 S 0000000000000001 0 12585 2 0x00000080 ffff88010d45fd00 0000000000000046 ffff880028316880 ffff8800df6dd538 ffff8801092cead8 ffff880028316880 ffff88010d45fcd0 ffffffff8105ad54 ffff8800df6ddab8 ffff88010d45ffd8 000000000000fbc8 ffff8800df6ddab8 Call Trace: [] ? check_preempt_wakeup+0x1a4/0x260 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_001 S 0000000000000001 0 12587 2 0x00000080 ffff88010c7abd00 0000000000000046 0000000000000000 00000001006c35c1 ffff88010c7abc70 0000000000000286 ffff88010c7abcc0 ffffffff81085f64 ffff8800df6dc5f8 ffff88010c7abfd8 000000000000fbc8 ffff8800df6dc5f8 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_000 S 0000000000000001 0 12588 2 0x00000080 ffff88011b77dd00 0000000000000046 ffff88011b77dc60 ffffffff81030b59 ffff88011b77dc70 ffffffff810554f8 ffff88011b77dc90 ffffffff8105559d ffff88011c2ed058 ffff88011b77dfd8 000000000000fbc8 ffff88011c2ed058 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_001 S 0000000000000000 0 12589 2 0x00000080 ffff88011b77fd00 0000000000000046 ffff88011b77fcc8 ffff88011b77fcc4 ffff88011b77fc70 ffff88011fc23040 ffff880028316880 0000000000000600 ffff8801184ce5f8 ffff88011b77ffd8 000000000000fbc8 ffff8801184ce5f8 Call Trace: [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_002 S 0000000000000000 0 12590 2 0x00000080 ffff880109749d00 0000000000000046 0000000000000000 0000000100707012 ffff880109749c70 0000000000000282 ffff880109749cc0 ffffffff81085f64 ffff880118e5f098 ffff880109749fd8 000000000000fbc8 ffff880118e5f098 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_00 S 0000000000000001 0 12591 2 0x00000080 ffff88010974de40 0000000000000046 0000000000000282 ffff88011cdf0ae0 ffff88010974ddd0 0000000000000282 ffff880037530d80 ffff8800dfbc7480 ffff88011cdf1098 ffff88010974dfd8 000000000000fbc8 ffff88011cdf1098 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_01 S 0000000000000001 0 12592 2 0x00000080 ffff88010974fe40 0000000000000046 0000000000000001 ffff88010c5dd6d0 0000000000000000 0000000000000000 ffff88010974fdc0 ffffffff81061d12 ffff88011cdf1af8 ffff88010974ffd8 000000000000fbc8 ffff88011cdf1af8 Call Trace: [] ? default_wake_function+0x12/0x20 [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_elt S 0000000000000001 0 12593 2 0x00000080 ffff88011c1c1e40 0000000000000046 ffff88011c1c1db0 ffffffff8109afb6 ffff88011c1c1de0 ffffffffa07cc3b0 ffff88011c1c1e00 ffffffff810546b9 ffff880037adf098 ffff88011c1c1fd8 000000000000fbc8 ffff880037adf098 Call Trace: [] ? autoremove_wake_function+0x16/0x40 [] ? __wake_up_common+0x59/0x90 [] expired_lock_main+0x272/0x8d0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? expired_lock_main+0x0/0x8d0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_poold S 0000000000000001 0 12594 2 0x00000080 ffff88011c1c3da0 0000000000000046 0000000000000000 ffff88011c1c3d50 0000000000000000 0000000000000286 ffff88011c1c3d40 ffffffff81083e1c ffff880037adfaf8 ffff88011c1c3fd8 000000000000fbc8 ffff880037adfaf8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ldlm_pools_thread_main+0x1df/0x310 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_pools_thread_main+0x0/0x310 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mgs_params_no S 0000000000000001 0 12595 2 0x00000080 ffff88011c1c7e00 0000000000000046 ffff88011c1c7d60 ffff880028316880 ffff88011c1c7d90 ffffffff8106a33b ffff88011c06a800 0000736d61726170 ffff8801187ec5f8 ffff88011c1c7fd8 000000000000fbc8 ffff8801187ec5f8 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] mgs_ir_notify+0x1cf/0x290 [mgs] [] ? default_wake_function+0x0/0x20 [] ? default_wake_function+0x12/0x20 [] ? mgs_ir_notify+0x0/0x290 [mgs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_mgs_0000 S 0000000000000001 0 12597 2 0x00000080 ffff88010c86fd00 0000000000000046 ffff88010c86fc60 ffffffff81030b59 ffff88010c86fc70 ffffffff810554f8 ffff88010c86fc90 ffffffff8105559d ffff88011a1f0638 ffff88010c86ffd8 000000000000fbc8 ffff88011a1f0638 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_mgs_0001 S 0000000000000001 0 12598 2 0x00000080 ffff880106911d00 0000000000000046 000000000000001a ffffffff00012eb3 ffff88011ae49028 00000000a03b0151 ffff880106911c70 ffff880106911c70 ffff88011a1f1af8 ffff880106911fd8 000000000000fbc8 ffff88011a1f1af8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_mgs_0002 S 0000000000000001 0 12599 2 0x00000080 ffff880106913d00 0000000000000046 0000000000000000 ffff880106913cc4 ffff880106913c70 ffff88011fc23040 ffff880028316880 0000000000000400 ffff880118ce1098 ffff880106913fd8 000000000000fbc8 ffff880118ce1098 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_evictor S 0000000000000001 0 12600 2 0x00000080 ffff880106917e00 0000000000000046 ffff8800283168e8 ffff88011c2ed538 000000000000003b 00000000ffffffff ffff880106917db0 ffff88010c5dd748 ffff88011c2edab8 ffff880106917fd8 000000000000fbc8 ffff88011c2edab8 Call Trace: [] ? ping_evictor_main+0x0/0x650 [ptlrpc] [] ping_evictor_main+0x4c4/0x650 [ptlrpc] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ping_evictor_main+0x0/0x650 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_cfg_requeu S 0000000000000001 0 12601 2 0x00000080 ffff8801091b7e30 0000000000000046 ffff8801091b7e30 ffffffff8152a51a ffff88010d45b0b8 0000000000000286 0000000000000000 dead000000200200 ffff88011c2ec5f8 ffff8801091b7fd8 000000000000fbc8 ffff88011c2ec5f8 Call Trace: [] ? schedule_timeout+0x19a/0x2e0 [] mgc_requeue_thread+0x5b4/0x7f0 [mgc] [] ? default_wake_function+0x0/0x20 [] ? mgc_requeue_thread+0x0/0x7f0 [mgc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt00_000 S 0000000000000001 0 12602 2 0x00000080 ffff880101ef5d00 0000000000000046 ffff880101ef5cc8 ffff880101ef5cc4 ffff880101ef5c80 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011ce2b058 ffff880101ef5fd8 000000000000fbc8 ffff88011ce2b058 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt00_001 S 0000000000000001 0 12603 2 0x00000080 ffff880110771d00 0000000000000046 ffff880110771cc8 ffff880110771cc4 ffff880110771c80 ffff88011fc23240 ffff880028216880 0000000000000400 ffff88011ce2a5f8 ffff880110771fd8 000000000000fbc8 ffff88011ce2a5f8 Call Trace: [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt00_002 S 0000000000000000 0 12604 2 0x00000080 ffff880110775d00 0000000000000046 ffff880110775cc8 ffff880110775cc4 000000000000fbc8 ffff88011fc23040 ffff880028316880 0000000000000400 ffff8801092cfab8 ffff880110775fd8 000000000000fbc8 ffff8801092cfab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_server_handle_req_in+0xa56/0xcb0 [ptlrpc] [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_rdpg00_00 S 0000000000000001 0 12605 2 0x00000080 ffff88010d917d00 0000000000000046 0000000000000000 00000001006f3865 ffff88010d917c70 0000000000000286 ffff88010d917cc0 ffffffff81085f64 ffff88010d915af8 ffff88010d917fd8 000000000000fbc8 ffff88010d915af8 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_rdpg00_00 S 0000000000000000 0 12606 2 0x00000080 ffff88011cf6dd00 0000000000000046 ffff880028216880 0000000000000000 0000000000000000 0000000000000000 ffff88011cf6dc90 ffffffff810555ac ffff88010d915098 ffff88011cf6dfd8 000000000000fbc8 ffff88010d915098 Call Trace: [] ? check_preempt_curr+0x7c/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_attr00_00 S 0000000000000001 0 12607 2 0x00000080 ffff88011996fd00 0000000000000046 ffff88011996fc60 ffffffff81030b59 ffff88011996fc70 ffffffff810554f8 ffff88011996fc90 ffffffff8105559d ffff88010d914638 ffff88011996ffd8 000000000000fbc8 ffff88010d914638 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_attr00_00 S 0000000000000001 0 12608 2 0x00000080 ffff88011ab55d00 0000000000000046 ffff88011ab55c60 ffffffff81030b59 ffff88011ab55c70 ffffffff810554f8 ffff88011ab55c90 ffffffff8105559d ffff88011ab53ab8 ffff88011ab55fd8 000000000000fbc8 ffff88011ab53ab8 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_out00_000 S 0000000000000001 0 12609 2 0x00000080 ffff88010da17d00 0000000000000046 ffff88010da17c60 ffffffff81030b59 ffff88010da17c70 ffffffff810554f8 ffff88010da17c90 ffffffff8105559d ffff88011ab53058 ffff88010da17fd8 000000000000fbc8 ffff88011ab53058 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_out00_001 S 0000000000000001 0 12610 2 0x00000080 ffff88010edc9d00 0000000000000046 ffff88010edc9c60 ffffffff81030b59 ffff88010edc9c70 ffffffff810554f8 ffff88010edc9c90 ffffffff8105559d ffff88011ab525f8 ffff88010edc9fd8 000000000000fbc8 ffff88011ab525f8 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_seqs_0000 S 0000000000000001 0 12611 2 0x00000080 ffff88011a7afd00 0000000000000046 ffff88011a7afc60 ffffffff81030b59 ffff88011a7afc70 ffffffff810554f8 ffff88011a7afc90 ffffffff8105559d ffff88011a7adaf8 ffff88011a7affd8 000000000000fbc8 ffff88011a7adaf8 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_seqs_0001 S 0000000000000001 0 12612 2 0x00000080 ffff880117ea5d00 0000000000000046 ffff880117ea5c60 ffffffff81030b59 ffff880117ea5c70 ffffffff810554f8 ffff880117ea5c90 ffffffff8105559d ffff88011a7ad098 ffff880117ea5fd8 000000000000fbc8 ffff88011a7ad098 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_seqm_0000 S 0000000000000001 0 12613 2 0x00000080 ffff880100ecbd00 0000000000000046 ffff880100ecbc60 ffffffff81030b59 ffff880100ecbc70 ffffffff810554f8 ffff880100ecbc90 ffffffff8105559d ffff88011a7ac638 ffff880100ecbfd8 000000000000fbc8 ffff88011a7ac638 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_seqm_0001 S 0000000000000001 0 12614 2 0x00000080 ffff88010ba81d00 0000000000000046 ffff88010ba81c60 ffffffff81030b59 ffff88010ba81c70 ffffffff810554f8 ffff88010ba81c90 ffffffff8105559d ffff880100ecfab8 ffff88010ba81fd8 000000000000fbc8 ffff880100ecfab8 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_fld_0000 S 0000000000000001 0 12615 2 0x00000080 ffff880101fd9d00 0000000000000046 ffff880101fd9c60 ffffffff81030b59 ffff880101fd9c70 ffffffff810554f8 ffff880101fd9c90 ffffffff8105559d ffff880100ecf058 ffff880101fd9fd8 000000000000fbc8 ffff880100ecf058 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_fld_0001 S 0000000000000001 0 12616 2 0x00000080 ffff880101fddd00 0000000000000046 ffff880101fddc60 ffffffff81030b59 ffff880101fddc70 ffffffff810554f8 ffff880101fddc90 ffffffff8105559d ffff880100ece5f8 ffff880101fddfd8 000000000000fbc8 ffff880100ece5f8 Call Trace: [] ? native_smp_send_reschedule+0x49/0x60 [] ? resched_task+0x68/0x80 [] ? check_preempt_curr+0x6d/0x90 [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mgs_lustre_no S 0000000000000001 0 12617 2 0x00000080 ffff88010ac0de00 0000000000000046 ffff88010ac0de00 ffffffffa0c1e55b ffffffffa067e7f0 ffffffffa0c1e860 0000000000000000 ffff88011be6f600 ffff88010ac0baf8 ffff88010ac0dfd8 000000000000fbc8 ffff88010ac0baf8 Call Trace: [] ? mgs_revoke_lock+0x1fb/0x350 [mgs] [] ? ldlm_blocking_ast+0x0/0x180 [ptlrpc] [] ? mgs_completion_ast_ir+0x0/0x20 [mgs] [] mgs_ir_notify+0x1cf/0x290 [mgs] [] ? default_wake_function+0x0/0x20 [] ? default_wake_function+0x12/0x20 [] ? mgs_ir_notify+0x0/0x290 [mgs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 qmt_reba_lust S 0000000000000001 0 12620 2 0x00000080 ffff88010cf45e20 0000000000000046 0000000000000090 00000000000000b8 ffff88010cf45dd0 ffffffffa047b84d ffff88010cf45db0 ffffffff8105af80 ffff88010cf43ab8 ffff88010cf45fd8 000000000000fbc8 ffff88010cf43ab8 Call Trace: [] ? keys_fill+0xdd/0x1c0 [obdclass] [] ? __dequeue_entity+0x30/0x50 [] qmt_reba_thread+0xac6/0x1040 [lquota] [] ? default_wake_function+0x0/0x20 [] ? qmt_reba_thread+0x0/0x1040 [lquota] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 osp-pre-0-0 S 0000000000000000 0 12621 2 0x00000080 ffff8801011e7db0 0000000000000046 ffff8801011e7d50 ffffffffa069828c 0000000000000000 ffff88010cf42aa0 ffff8801011e7d40 000000000000000d ffff88010cf43058 ffff8801011e7fd8 000000000000fbc8 ffff88010cf43058 Call Trace: [] ? ptlrpc_request_bufs_pack+0x5c/0x80 [ptlrpc] [] osp_precreate_thread+0x8ee/0xff0 [osp] [] ? default_wake_function+0x0/0x20 [] ? osp_precreate_thread+0x0/0xff0 [osp] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 osp-syn-0-0 S 0000000000000001 0 12622 2 0x00000080 ffff8801011ef9d0 0000000000000046 0000000000000000 ffff8801011ef990 ffff88011c011000 ffff88011c011800 ffff8801011ef9d0 ffffffffa0f2e6a5 ffff88010cf425f8 ffff8801011effd8 000000000000fbc8 ffff88010cf425f8 Call Trace: [] ? osp_sync_process_committed+0x355/0x720 [osp] [] osp_sync_process_queues+0x29c/0x17a0 [osp] [] ? default_wake_function+0x0/0x20 [] llog_process_thread+0xb82/0xfd0 [obdclass] [] ? osp_sync_process_queues+0x0/0x17a0 [osp] [] llog_process_or_fork+0x13f/0x690 [obdclass] [] llog_cat_process_cb+0x458/0x600 [obdclass] [] llog_process_thread+0xb82/0xfd0 [obdclass] [] ? llog_cat_process_cb+0x0/0x600 [obdclass] [] llog_process_or_fork+0x13f/0x690 [obdclass] [] llog_cat_process_or_fork+0x1ad/0x300 [obdclass] [] ? default_wake_function+0x12/0x20 [] ? __wake_up_common+0x59/0x90 [] ? osp_sync_process_queues+0x0/0x17a0 [osp] [] llog_cat_process+0x19/0x20 [obdclass] [] osp_sync_thread+0x243/0x7f0 [osp] [] ? thread_return+0x4e/0x770 [] ? osp_sync_thread+0x0/0x7f0 [osp] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 osp-pre-1-0 S 0000000000000000 0 12623 2 0x00000080 ffff880119157db0 0000000000000046 ffff880119157d50 ffffffffa069828c 0000000000000000 ffff880119155540 ffff880119157d40 000000000000000d ffff880119155af8 ffff880119157fd8 000000000000fbc8 ffff880119155af8 Call Trace: [] ? ptlrpc_request_bufs_pack+0x5c/0x80 [ptlrpc] [] osp_precreate_thread+0x8ee/0xff0 [osp] [] ? default_wake_function+0x0/0x20 [] ? osp_precreate_thread+0x0/0xff0 [osp] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 osp-syn-1-0 S 0000000000000001 0 12624 2 0x00000080 ffff880100a6b9d0 0000000000000046 0000000000000000 ffff880100a6b990 ffff8801011f3800 ffff88011c01d000 ffff880100a6b9d0 ffffffffa0f2e6a5 ffff880119155098 ffff880100a6bfd8 000000000000fbc8 ffff880119155098 Call Trace: [] ? osp_sync_process_committed+0x355/0x720 [osp] [] osp_sync_process_queues+0x29c/0x17a0 [osp] [] ? default_wake_function+0x0/0x20 [] llog_process_thread+0xb82/0xfd0 [obdclass] [] ? osp_sync_process_queues+0x0/0x17a0 [osp] [] llog_process_or_fork+0x13f/0x690 [obdclass] [] llog_cat_process_cb+0x458/0x600 [obdclass] [] llog_process_thread+0xb82/0xfd0 [obdclass] [] ? llog_cat_process_cb+0x0/0x600 [obdclass] [] llog_process_or_fork+0x13f/0x690 [obdclass] [] llog_cat_process_or_fork+0x1ad/0x300 [obdclass] [] ? default_wake_function+0x12/0x20 [] ? __wake_up_common+0x59/0x90 [] ? osp_sync_process_queues+0x0/0x17a0 [osp] [] llog_cat_process+0x19/0x20 [obdclass] [] osp_sync_thread+0x243/0x7f0 [osp] [] ? thread_return+0x4e/0x770 [] ? osp_sync_thread+0x0/0x7f0 [osp] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 lquota_wb_lus S 0000000000000001 0 12630 2 0x00000080 ffff880100f6dd30 0000000000000046 0000000000000000 0004925000000000 ffff88011fc216e0 0000000000000286 ffff880100f6dcd0 ffffffff81083e1c ffff880100f65098 ffff880100f6dfd8 000000000000fbc8 ffff880100f65098 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] qsd_upd_thread+0xa59/0xf70 [lquota] [] ? default_wake_function+0x0/0x20 [] ? qsd_upd_thread+0x0/0xf70 [lquota] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 tdtd-0 S 0000000000000001 0 12631 2 0x00000080 ffff880100f5bd70 0000000000000046 0000000000000000 0000000000000000 0000000000000000 00000000fffffffe ffff880100f5bd30 ffff8800df6a4930 ffff880100f64638 ffff880100f5bfd8 000000000000fbc8 ffff880100f64638 Call Trace: [] distribute_txn_commit_thread+0x1228/0x1710 [ptlrpc] [] ? default_wake_function+0x12/0x20 [] ? default_wake_function+0x0/0x20 [] ? distribute_txn_commit_thread+0x0/0x1710 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt00_003 S 0000000000000001 0 12767 2 0x00000080 ffff88010da9fd00 0000000000000046 ffff88011a253e80 ffff8801198f9000 ffff88010da9fc80 ffffffffa070404f 0000000000003039 ffffffffa07b61c0 ffff88010cf565f8 ffff88010da9ffd8 000000000000fbc8 ffff88010cf565f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt00_004 S 0000000000000001 0 12865 2 0x00000080 ffff8800374fbd00 0000000000000046 0000000000000000 ffff8800374fbcc4 ffff8800374fbc80 ffff88011fc23040 ffff880028316880 0000000000000400 ffff880118697058 ffff8800374fbfd8 000000000000fbc8 ffff880118697058 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 mdt_rdpg00_00 S 0000000000000000 0 12866 2 0x00000080 ffff8800378e9d00 0000000000000046 0000000000000000 0000000000000000 ffff88011fc21700 0004925000000000 ffff88011fc216e0 ffff88011fc216d0 ffff88010d9485f8 ffff8800378e9fd8 000000000000fbc8 ffff88010d9485f8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sshd S 0000000000000001 0 12867 5736 0x00000080 ffff88011ae93908 0000000000000086 ffff88011ae93868 ffff880119aa8828 ffff88011ae93888 ffffffff814b22fd ffff880119aa8828 ffff880117c706e0 ffff8801092cf058 ffff88011ae93fd8 000000000000fbc8 ffff8801092cf058 Call Trace: [] ? tcp_wfree+0x3d/0xd0 [] ? dev_hard_start_xmit+0x224/0x480 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? do_wp_page+0x493/0x920 [] ? handle_pte_fault+0x2cd/0xb00 [] core_sys_select+0x18a/0x2c0 [] ? __wake_up_sync_key+0x5e/0x80 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b bash S 0000000000000000 0 12929 12867 0x00000080 ffff880119b25e78 0000000000000082 0000000000000000 0000000000000029 00000000006dc1e4 ffff880118448640 ffff880118438ed0 0000000000000007 ffff88011ba665f8 ffff880119b25fd8 000000000000fbc8 ffff88011ba665f8 Call Trace: [] do_wait+0x1e4/0x240 [] sys_wait4+0xa3/0x100 [] ? child_wait_callback+0x0/0x70 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sh R running task 0 12938 12929 0x00000088 ffff880119a5bce8 0000000096695ce8 ffff880119a5bd58 ffff88010ac0aae0 0000000000000000 ffff880119a5bcc8 ffff880028203fc0 ffffffff817d6def ffff880119a5bd48 ffffffff815290e5 0000000000000010 ffff880119a5bd58 Call Trace: [] show_trace_log_lvl+0x55/0x70 [] show_stack_log_lvl+0x9a/0x170 [] show_stack+0x1a/0x20 [] sched_show_task+0x98/0x100 [] show_state_filter+0x7b/0xc0 [] sysrq_handle_showstate+0x10/0x20 [] __handle_sysrq+0x132/0x1a0 [] write_sysrq_trigger+0x4e/0x50 [] proc_reg_write+0x7e/0xc0 [] vfs_write+0xb8/0x1a0 [] sys_write+0x51/0x90 [] system_call_fastpath+0x16/0x1b Sched Debug Version: v0.09, 2.6.32-431.29.2.el6_lustremaster_master__49 #1 now at 7572709.182958 msecs .jiffies : 4302236776 .sysctl_sched_latency : 10.000000 .sysctl_sched_min_granularity : 2.000000 .sysctl_sched_wakeup_granularity : 2.000000 .sysctl_sched_child_runs_first : 0.000000 .sysctl_sched_features : 3183 .sysctl_sched_tunable_scaling : 1 (logaritmic) cpu#0, 2793.268 MHz .nr_running : 1 .load : 1024 .nr_switches : 1168131 .nr_load_updates : 426191 .nr_uninterruptible : 0 .next_balance : 4302.237018 .curr->pid : 12938 .clock : 7570569.152972 .cpu_load[0] : 1024 .cpu_load[1] : 848 .cpu_load[2] : 822 .cpu_load[3] : 785 .cpu_load[4] : 606 .yld_count : 0 .sched_switch : 0 .sched_count : 1177844 .sched_goidle : 342720 .avg_idle : 1000000 .ttwu_count : 635233 .ttwu_local : 495125 .bkl_count : 8773 cfs_rq[0]:/ .exec_clock : 184718.840792 .MIN_vruntime : 0.000001 .min_vruntime : 405208.585960 .max_vruntime : 0.000001 .spread : 0.000000 .spread0 : 0.000000 .nr_spread_over : 55205 .nr_running : 1 .load : 1024 .tg->cfs_bandwidth.timer_active: 0 .throttled : 0 .throttle_count : 0 .load_avg : 0.000000 .load_period : 0.000000 .load_contrib : 0 .load_tg : 0 rt_rq[0]:/ .rt_nr_running : 0 .rt_throttled : 0 .rt_time : 0.000000 .rt_runtime : 950.000000 runnable tasks: task PID tree-key switches prio exec-runtime sum-exec sum-sleep ---------------------------------------------------------------------------------------------------------- R sh 12938 405208.585960 1 120 405208.585960 1089.393142 0.000000 / cpu#1, 2793.268 MHz .nr_running : 0 .load : 0 .nr_switches : 1150057 .nr_load_updates : 411875 .nr_uninterruptible : 0 .next_balance : 4302.236779 .curr->pid : 0 .clock : 7572780.267791 .cpu_load[0] : 0 .cpu_load[1] : 224 .cpu_load[2] : 336 .cpu_load[3] : 275 .cpu_load[4] : 194 .yld_count : 0 .sched_switch : 0 .sched_count : 1175110 .sched_goidle : 339703 .avg_idle : 1000000 .ttwu_count : 625020 .ttwu_local : 483295 .bkl_count : 8730 cfs_rq[1]:/ .exec_clock : 174821.212657 .MIN_vruntime : 0.000001 .min_vruntime : 389507.985031 .max_vruntime : 0.000001 .spread : 0.000000 .spread0 : -15700.600929 .nr_spread_over : 54855 .nr_running : 0 .load : 0 .tg->cfs_bandwidth.timer_active: 0 .throttled : 0 .throttle_count : 0 .load_avg : 0.000000 .load_period : 0.000000 .load_contrib : 0 .load_tg : 0 rt_rq[1]:/ .rt_nr_running : 0 .rt_throttled : 0 .rt_time : 0.014828 .rt_runtime : 950.000000 runnable tasks: task PID tree-key switches prio exec-runtime sum-exec sum-sleep ---------------------------------------------------------------------------------------------------------- SysRq : Show Memory Mem-Info: Node 0 DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 CPU 1: hi: 0, btch: 1 usd: 0 Node 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 181 CPU 1: hi: 186, btch: 31 usd: 163 Node 0 Normal per-cpu: CPU 0: hi: 186, btch: 31 usd: 136 CPU 1: hi: 186, btch: 31 usd: 100 active_anon:2484 inactive_anon:36 isolated_anon:0 active_file:42622 inactive_file:32284 isolated_file:0 unevictable:0 dirty:126 writeback:0 unstable:0 free:809635 slab_reclaimable:4626 slab_unreclaimable:29406 mapped:1609 shmem:39 pagetables:478 bounce:0 Node 0 DMA free:15724kB min:248kB low:308kB high:372kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15320kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 3512 4017 4017 Node 0 DMA32 free:3211584kB min:58868kB low:73584kB high:88300kB active_anon:2132kB inactive_anon:8kB active_file:8324kB inactive_file:9168kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3596500kB mlocked:0kB dirty:0kB writeback:0kB mapped:8kB shmem:8kB slab_reclaimable:872kB slab_unreclaimable:18092kB kernel_stack:40kB pagetables:408kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 505 505 Node 0 Normal free:11232kB min:8464kB low:10580kB high:12696kB active_anon:7804kB inactive_anon:136kB active_file:162164kB inactive_file:119968kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:517120kB mlocked:0kB dirty:504kB writeback:0kB mapped:6428kB shmem:148kB slab_reclaimable:17632kB slab_unreclaimable:99532kB kernel_stack:1232kB pagetables:1504kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Node 0 DMA: 3*4kB 2*8kB 1*16kB 2*32kB 2*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15724kB Node 0 DMA32: 406*4kB 219*8kB 143*16kB 61*32kB 50*64kB 40*128kB 7*256kB 2*512kB 2*1024kB 2*2048kB 778*4096kB = 3211584kB Node 0 Normal: 350*4kB 147*8kB 26*16kB 24*32kB 5*64kB 4*128kB 2*256kB 10*512kB 1*1024kB 0*2048kB 0*4096kB = 11248kB 74871 total pagecache pages 0 pages in swap cache Swap cache stats: add 0, delete 0, find 0/0 Free swap = 2538492kB Total swap = 2538492kB 1048575 pages RAM 100407 pages reserved 35381 pages shared 82257 pages non-shared