==> /tmp/serial_fre1310_out <== Lustre: DEBUG MARKER: excepting tests: 61d 53a 53d Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: == replay-single test 70b: dbench 1mdts recovery; 2 clients == 02:56:32 (1436496992) Lustre: DEBUG MARKER: Started rundbench load pid=20896 ... Lustre: DEBUG MARKER: test_70b fail mds1 1 times LustreError: 11-0: lustre-MDT0000-lwp-OST0000: operation obd_ping to node 192.168.113.9@tcp failed: rc = -107 LustreError: Skipped 7 previous similar messages Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.113.9@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 7 previous similar messages Lustre: 6110:0:(client.c:2018:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1436497011/real 1436497011] req@ffff88010b3db3c0 x1506268669852712/t0(0) o400->MGC192.168.113.9@tcp@192.168.113.9@tcp:26/25 lens 224/224 e 0 to 1 dl 1436497018 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 6110:0:(client.c:2018:ptlrpc_expire_one_request()) Skipped 20 previous similar messages LustreError: 166-1: MGC192.168.113.9@tcp: Connection to MGS (at 192.168.113.9@tcp) was lost; in progress operations using this service will fail LustreError: Skipped 4 previous similar messages Lustre: Evicted from MGS (at 192.168.113.9@tcp) after server handle changed from 0xd2cf4c1eb61715d6 to 0xd2cf4c1eb6192e98 Lustre: Skipped 4 previous similar messages Lustre: MGC192.168.113.9@tcp: Connection restored to MGS (at 192.168.113.9@tcp) Lustre: Skipped 15 previous similar messages LustreError: 167-0: lustre-MDT0000-lwp-OST0001: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. LustreError: Skipped 7 previous similar messages Lustre: lustre-OST0000: deleting orphan objects from 0x0:5802 to 0x0:5889 Lustre: lustre-OST0001: deleting orphan objects from 0x0:5461 to 0x0:5537 Lustre: DEBUG MARKER: replay-single test_70b: @@@@@@ FAIL: dbench stopped on some of fre1311,fre1312! Lustre: DEBUG MARKER: replay-single test_70b: @@@@@@ FAIL: rundbench load on fre1311,fre1312 failed! SysRq : Show State task PC stack pid father init S 0000000000000000 0 1 0 0x00000000 ffff88011e7ab908 0000000000000082 0000000000000000 ffff8800282168e8 ffff88011868c078 00000000000013f0 ffff88011868c040 0000000000000000 ffff88011e7a9ab8 ffff88011e7abfd8 000000000000fbc8 ffff88011e7a9ab8 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? get_page_from_freelist+0x3d1/0x870 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? __lru_cache_add+0x40/0x90 [] ? lru_cache_add_lru+0x21/0x40 [] ? page_add_new_anon_rmap+0x9d/0xf0 [] ? handle_pte_fault+0x4af/0xb00 [] ? mutex_lock+0x1e/0x50 [] ? pipe_read+0x2a7/0x4e0 [] ? apic_timer_interrupt+0xe/0x20 [] core_sys_select+0x18a/0x2c0 [] ? kfree+0x122/0x320 [] ? security_task_wait+0x16/0x20 [] ? wait_consider_task+0x9d/0xb20 [] ? remove_wait_queue+0x3c/0x50 [] ? do_wait+0x17f/0x240 [] ? pvclock_clocksource_read+0x58/0xd0 [] sys_select+0x47/0x110 [] ? posix_ktime_get_ts+0x11/0x20 [] system_call_fastpath+0x16/0x1b kthreadd S 0000000000000001 0 2 0 0x00000000 ffff88011e7b1ed0 0000000000000046 ffff88011e7b1f40 ffffffff8100c1a2 ffff88011e7a8aa0 ffff88011e7a8aa0 ffffffff81eb4c88 ffff88011b81bcc8 ffff88011e7a9058 ffff88011e7b1fd8 000000000000fbc8 ffff88011e7a9058 Call Trace: [] ? kernel_thread+0x82/0xe0 [] ? kthread+0x0/0xa0 [] kthreadd+0x1b5/0x1c0 [] child_rip+0xa/0x20 [] ? kthreadd+0x0/0x1c0 [] ? child_rip+0x0/0x20 migration/0 S 0000000000000000 0 3 2 0x00000000 ffff88011e7b5e70 0000000000000046 0000000000000000 0000000000000082 ffff88011e7b5df0 ffff880109524aa0 ffff880028316880 ffff880028316880 ffff88011e7a85f8 ffff88011e7b5fd8 000000000000fbc8 ffff88011e7a85f8 Call Trace: [] migration_thread+0x265/0x2e0 [] ? migration_thread+0x0/0x2e0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksoftirqd/0 S 0000000000000000 0 4 2 0x00000000 ffff88011e7b9ea0 0000000000000046 0000000000000000 ffff88011e7b9e64 0000000000016880 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011e7b7af8 ffff88011e7b9fd8 000000000000fbc8 ffff88011e7b7af8 Call Trace: [] ksoftirqd+0xd5/0x110 [] ? ksoftirqd+0x0/0x110 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/0 S 0000000000000000 0 5 2 0x00000000 ffff88011e7bbdf0 0000000000000046 0000000000000000 ffffffff81a98a80 0000000000000086 ffffffff81aa6740 ffff88011e7bbd90 ffffffff810b8498 ffff88011e7b7098 ffff88011e7bbfd8 000000000000fbc8 ffff88011e7b7098 Call Trace: [] ? module_refcount+0x58/0x70 [] ? stop_machine_cpu_stop+0x0/0xf0 [] cpu_stopper_thread+0x125/0x1b0 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? cpu_stopper_thread+0x0/0x1b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 watchdog/0 S 0000000000000000 0 6 2 0x00000000 ffff88011e7bfea0 0000000000000046 0000000000000000 ffffffff8103ea6c ffff88011e7bfe10 ffffffff81014969 ffff88011e7bfe40 ffffffff810a21c5 ffff88011e7b6638 ffff88011e7bffd8 000000000000fbc8 ffff88011e7b6638 Call Trace: [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock+0x9/0x10 [] ? sched_clock_local+0x25/0x90 [] watchdog+0x9a/0xd0 [] ? watchdog+0x0/0xd0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/1 S 0000000000000001 0 7 2 0x00000000 ffff88011e7c3e70 0000000000000046 0000000000000000 0000000000000082 ffff88011e7c3df0 ffff88010e816aa0 ffff880028216880 ffff880028216880 ffff88011e7c1ab8 ffff88011e7c3fd8 000000000000fbc8 ffff88011e7c1ab8 Call Trace: [] migration_thread+0x265/0x2e0 [] ? migration_thread+0x0/0x2e0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 migration/1 S 0000000000000001 0 8 2 0x00000000 ffff88011e7c5df0 0000000000000046 0000000000000000 000000080000026f 0000000000000082 ffffffff81dfb218 ffff88011e7c5da0 000000008100bb8e ffff88011e7c1058 ffff88011e7c5fd8 000000000000fbc8 ffff88011e7c1058 Call Trace: [] ? stop_machine_cpu_stop+0x0/0xf0 [] cpu_stopper_thread+0x125/0x1b0 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? cpu_stopper_thread+0x0/0x1b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksoftirqd/1 S 0000000000000001 0 9 2 0x00000000 ffff88011e7cbea0 0000000000000046 0000000000000000 ffff88011e7cbe64 0000000000016880 ffff88011fc23240 ffff880028216880 00000000000006e2 ffff88011e7c05f8 ffff88011e7cbfd8 000000000000fbc8 ffff88011e7c05f8 Call Trace: [] ksoftirqd+0xd5/0x110 [] ? ksoftirqd+0x0/0x110 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 watchdog/1 S 0000000000000001 0 10 2 0x00000000 ffff88011e7d5ea0 0000000000000046 0000000000000000 ffffffff8103ea6c ffff88011e7d5e10 ffffffff81014969 ffff88011e7d5e40 ffffffff810a21c5 ffff88011e7d1098 ffff88011e7d5fd8 000000000000fbc8 ffff88011e7d1098 Call Trace: [] ? kvm_clock_read+0x1c/0x20 [] ? sched_clock+0x9/0x10 [] ? sched_clock_local+0x25/0x90 [] watchdog+0x9a/0xd0 [] ? watchdog+0x0/0xd0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 events/0 S 0000000000000000 0 11 2 0x00000000 ffff88011dc01e30 0000000000000046 0000000000000000 ffffffff81170d41 0000000000000000 0000000000000200 ffffffff81fc6a78 0000000000000000 ffff88011e7d0638 ffff88011dc01fd8 000000000000fbc8 ffff88011e7d0638 Call Trace: [] ? drain_array+0xe1/0x100 [] ? cache_reap+0x0/0x250 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 events/1 S 0000000000000001 0 12 2 0x00000000 ffff88011dc05e30 0000000000000046 0000000000000006 ffff880028319480 00000000ffffffff ffff880028313460 ffff88011dc05fd8 ffff880028319488 ffff88011dc03ab8 ffff88011dc05fd8 000000000000fbc8 ffff88011dc03ab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? vmstat_update+0x0/0x40 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 cgroup S 0000000000000000 0 13 2 0x00000000 ffff88011dc07e30 0000000000000046 0000000000000000 ffff8800282168e8 ffff88011dc07db0 ffffffff8105af80 ffff88011e7a9538 ffff8800282168e8 ffff88011dc03058 ffff88011dc07fd8 000000000000fbc8 ffff88011dc03058 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khelper S 0000000000000001 0 14 2 0x00000000 ffff88011dc0be30 0000000000000046 ffffffff81093960 0000000000000001 ffff88011dc0be30 ffff88011fec1940 0000000000000000 0000000000000001 ffff88011dc025f8 ffff88011dc0bfd8 000000000000fbc8 ffff88011dc025f8 Call Trace: [] ? __call_usermodehelper+0x0/0xd0 [] ? prepare_to_wait+0x4e/0x80 [] ? __call_usermodehelper+0x0/0xd0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 netns S 0000000000000001 0 15 2 0x00000000 ffff88011dc3fe30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc3daf8 ffff88011dc3ffd8 000000000000fbc8 ffff88011dc3daf8 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 async/mgr S 0000000000000000 0 16 2 0x00000000 ffff88011dc51e70 0000000000000046 0000000000000000 0000000000000000 ffff88011dc51df0 ffffffff810555ac ffff88011dc51df0 0000000000000282 ffff88011dc3d098 ffff88011dc51fd8 000000000000fbc8 ffff88011dc3d098 Call Trace: [] ? check_preempt_curr+0x7c/0x90 [] async_manager_thread+0xf3/0x150 [] ? default_wake_function+0x0/0x20 [] ? async_manager_thread+0x0/0x150 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 pm S 0000000000000001 0 17 2 0x00000000 ffff88011dc55e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011dc3c638 ffff88011dc55fd8 000000000000fbc8 ffff88011dc3c638 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sync_supers S 0000000000000000 0 18 2 0x00000000 ffff88011dcb9ec0 0000000000000046 0000000000000000 ffff88011dcb9e84 ffff88011dcb9ee0 ffff88011fc23240 ffff880028216880 0000000000000400 ffff88011dcb7ab8 ffff88011dcb9fd8 000000000000fbc8 ffff88011dcb7ab8 Call Trace: [] ? bdi_sync_supers+0x0/0x60 [] bdi_sync_supers+0x3b/0x60 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 bdi-default S 0000000000000000 0 19 2 0x00000000 ffff88011dcbbdd0 0000000000000046 0000000000000000 ffff8800282168e8 ffff88010d2bcad8 0000000000000282 ffff88011dcbbd70 ffffffff81083e1c ffff88011dcb7058 ffff88011dcbbfd8 000000000000fbc8 ffff88011dcb7058 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] bdi_forker_task+0x263/0x310 [] ? bdi_forker_task+0x0/0x310 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kintegrityd/0 S 0000000000000000 0 20 2 0x00000000 ffff88011dcbfe30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011dcbfde0 ffffffff8106abeb ffff88011dcb65f8 ffff88011dcbffd8 000000000000fbc8 ffff88011dcb65f8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kintegrityd/1 S 0000000000000001 0 21 2 0x00000000 ffff88011dcc3e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011dcc3de0 ffffffff8106abeb ffff88011dcc1af8 ffff88011dcc3fd8 000000000000fbc8 ffff88011dcc1af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kblockd/0 S 0000000000000000 0 22 2 0x00000000 ffff88011dccbe30 0000000000000046 0000000000000000 ffff88011876ae68 ffff88011876ae68 ffff88011876ae68 ffff88011876ae68 ffffffff81262a50 ffff88011dcc1098 ffff88011dccbfd8 000000000000fbc8 ffff88011dcc1098 Call Trace: [] ? blk_unplug_work+0x0/0x70 [] ? blk_unplug_work+0x0/0x70 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kblockd/1 S 0000000000000001 0 23 2 0x00000000 ffff88011dccfe30 0000000000000046 0000000000000000 ffff880117c26ea8 ffff880117c26ea8 ffff880117c26ea8 ffff880117c26ea8 ffffffff81262a50 ffff88011dcc0638 ffff88011dccffd8 000000000000fbc8 ffff88011dcc0638 Call Trace: [] ? blk_unplug_work+0x0/0x70 [] ? blk_unplug_work+0x0/0x70 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpid S 0000000000000000 0 24 2 0x00000000 ffff88011de01e30 0000000000000046 ffff88011de01d90 ffffffff8152a32d ffff88011de01e10 ffffffff8106de63 ffff88011de01e10 0000000000000286 ffff88011ddffab8 ffff88011de01fd8 000000000000fbc8 ffff88011ddffab8 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpi_notify S 0000000000000000 0 25 2 0x00000000 ffff88011de03e30 0000000000000046 ffff88011de03d90 ffffffff8152a32d ffff88011de03e10 ffffffff8106de63 ffff88011de03e10 0000000000000286 ffff88011ddff058 ffff88011de03fd8 000000000000fbc8 ffff88011ddff058 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kacpi_hotplug S 0000000000000000 0 26 2 0x00000000 ffff88011de07e30 0000000000000046 ffff88011de07d90 ffffffff8152a32d ffff88011de07e10 ffffffff8106de63 ffff88011de07e10 0000000000000286 ffff88011ddfe5f8 ffff88011de07fd8 000000000000fbc8 ffff88011ddfe5f8 Call Trace: [] ? wait_for_completion+0x1d/0x20 [] ? set_cpus_allowed_ptr+0x133/0x1d0 [] ? prepare_to_wait+0x4e/0x80 [] ? bind_to_cpu0+0x0/0x32 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_aux S 0000000000000001 0 27 2 0x00000000 ffff88011de8de30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011de8dde0 ffffffff8106abeb ffff88011de8baf8 ffff88011de8dfd8 000000000000fbc8 ffff88011de8baf8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_sff/0 S 0000000000000000 0 28 2 0x00000000 ffff88011de8fe30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011de8fde0 ffffffff8106abeb ffff88011de8b098 ffff88011de8ffd8 000000000000fbc8 ffff88011de8b098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] ? worker_thread+0x0/0x2a0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ata_sff/1 S 0000000000000001 0 29 2 0x00000000 ffff88011df05e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df05de0 ffffffff8106abeb ffff88011de8a638 ffff88011df05fd8 000000000000fbc8 ffff88011de8a638 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksuspend_usbd S 0000000000000001 0 30 2 0x00000000 ffff88011df09e30 0000000000000046 0000000000000000 0000000000000402 ffff88011df09df0 ffffffff813ccd0c ffff88011df09de0 ffffffff8106abeb ffff88011df07ab8 ffff88011df09fd8 000000000000fbc8 ffff88011df07ab8 Call Trace: [] ? usb_suspend_both+0x1bc/0x340 [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? usb_autosuspend_work+0x0/0x20 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khubd S 0000000000000001 0 31 2 0x00000000 ffff88011df0bd60 0000000000000046 0000000000000000 0000000000000000 0000000000000000 000004008103f9d8 00000000ffffffff ffff880118bb7c00 ffff88011df07058 ffff88011df0bfd8 000000000000fbc8 ffff88011df07058 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] hub_thread+0x379/0x1a40 [] ? dequeue_task_fair+0x12b/0x130 [] ? autoremove_wake_function+0x0/0x40 [] ? hub_thread+0x0/0x1a40 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kseriod S 0000000000000001 0 32 2 0x00000000 ffff88011df0fe50 0000000000000046 ffff88011df0fdd0 ffffffff810a0f5f ffff88011df0fe10 ffff88011de76b38 ffff88011df0fe30 0000000000000282 ffff88011df065f8 ffff88011df0ffd8 000000000000fbc8 ffff88011df065f8 Call Trace: [] ? up+0x2f/0x50 [] ? prepare_to_wait+0x4e/0x80 [] serio_thread+0x39a/0x450 [] ? autoremove_wake_function+0x0/0x40 [] ? serio_thread+0x0/0x450 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md/0 S 0000000000000000 0 33 2 0x00000000 ffff88011df13e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df13de0 ffffffff8106abeb ffff88011df11af8 ffff88011df13fd8 000000000000fbc8 ffff88011df11af8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md/1 S 0000000000000001 0 34 2 0x00000000 ffff88011df15e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df15de0 ffffffff8106abeb ffff88011df11098 ffff88011df15fd8 000000000000fbc8 ffff88011df11098 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md_misc/0 S 0000000000000000 0 35 2 0x00000000 ffff88011df19e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df19de0 ffffffff8106abeb ffff88011df10638 ffff88011df19fd8 000000000000fbc8 ffff88011df10638 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 md_misc/1 S 0000000000000001 0 36 2 0x00000000 ffff88011df1fe30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff88011df1fde0 ffffffff8106abeb ffff88011df1dab8 ffff88011df1ffd8 000000000000fbc8 ffff88011df1dab8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 linkwatch S 0000000000000000 0 37 2 0x00000000 ffff88011df41e30 0000000000000046 0000000000000000 0000000000000300 0000000000000000 ffff880118563020 0000000000000000 0000000000000006 ffff88011df1d058 ffff88011df41fd8 000000000000fbc8 ffff88011df1d058 Call Trace: [] ? linkwatch_event+0x0/0x30 [] ? linkwatch_event+0x0/0x30 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khungtaskd S 0000000000000000 0 38 2 0x00000000 ffff8801188d3dd0 0000000000000046 0000000000000000 ffffffff8160bf40 0000000000000001 0000000000000282 ffff8801188d3d70 ffffffff81083e1c ffff88011df1c5f8 ffff8801188d3fd8 000000000000fbc8 ffff88011df1c5f8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] watchdog+0x52/0x250 [] ? watchdog+0x0/0x250 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kswapd0 S 0000000000000001 0 39 2 0x00000000 ffff8801188d7e20 0000000000000046 0000000000000000 000000028152a51a ffff88002804d000 0000000000000000 0000000000000000 ffffffff81c06500 ffff8801188d5af8 ffff8801188d7fd8 000000000000fbc8 ffff8801188d5af8 Call Trace: [] kswapd+0x309/0x3b0 [] ? autoremove_wake_function+0x0/0x40 [] ? kswapd+0x0/0x3b0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ksmd S 0000000000000001 0 40 2 0x00000000 ffff880118947e10 0000000000000046 0000000000000000 ffff8801188d4ae0 ffff880118947da0 ffffffff8106a33b ffff880118947da0 ffff8801188d4ae0 ffff8801188d5098 ffff880118947fd8 000000000000fbc8 ffff8801188d5098 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] ksm_scan_thread+0xa5b/0x1120 [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x12/0x20 [] ? autoremove_wake_function+0x0/0x40 [] ? ksm_scan_thread+0x0/0x1120 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 khugepaged S 0000000000000000 0 41 2 0x00000000 ffff88011894dd90 0000000000000046 0000000000000000 ffffffff8152a51a ffff8801186897c0 0000000000000282 0000000000000000 dead000000200200 ffff8801188d4638 ffff88011894dfd8 000000000000fbc8 ffff8801188d4638 Call Trace: [] ? schedule_timeout+0x19a/0x2e0 [] khugepaged+0xaf2/0x1310 [] ? autoremove_wake_function+0x0/0x40 [] ? khugepaged+0x0/0x1310 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 aio/0 S 0000000000000000 0 42 2 0x00000000 ffff880118a11e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011894fab8 ffff880118a11fd8 000000000000fbc8 ffff88011894fab8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 aio/1 S 0000000000000001 0 43 2 0x00000000 ffff880118a15e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011894f058 ffff880118a15fd8 000000000000fbc8 ffff88011894f058 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 crypto/0 S 0000000000000000 0 44 2 0x00000000 ffff880118a69e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011894e5f8 ffff880118a69fd8 000000000000fbc8 ffff88011894e5f8 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 crypto/1 S 0000000000000001 0 45 2 0x00000000 ffff880118a6de30 0000000000000046 0000000000000000 0000000000000400 0000000000000000 000000000000002a 0000000100000002 ffff880028216880 ffff880118a6baf8 ffff880118a6dfd8 000000000000fbc8 ffff880118a6baf8 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kthrotld/0 S 0000000000000000 0 50 2 0x00000000 ffff880118aade30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff880118aadde0 ffffffff8106abeb ffff880118aa25f8 ffff880118aadfd8 000000000000fbc8 ffff880118aa25f8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kthrotld/1 S 0000000000000001 0 51 2 0x00000000 ffff880118ac1e30 0000000000000046 0000000000000000 ffff8800283168e8 0000000000000001 ffff880028316880 ffff880118ac1de0 ffffffff8106abeb ffff880118aafaf8 ffff880118ac1fd8 000000000000fbc8 ffff880118aafaf8 Call Trace: [] ? dequeue_task_fair+0x12b/0x130 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kpsmoused S 0000000000000000 0 53 2 0x00000000 ffff880118be3e30 0000000000000046 ffff880118be3df8 ffff880118be3df4 0000000000000000 ffff88011fc23040 ffff880028316880 0000000000000400 ffff880118aa3ab8 ffff880118be3fd8 000000000000fbc8 ffff880118aa3ab8 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 usbhid_resume S 0000000000000000 0 54 2 0x00000000 ffff880118be5e30 0000000000000046 0000000000000000 ffff8800283168e8 ffff880118be5db0 ffffffff8105af80 ffff88011e7a9538 ffff8800283168e8 ffff880118a6a638 ffff880118be5fd8 000000000000fbc8 ffff880118a6a638 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kstriped S 0000000000000000 0 83 2 0x00000000 ffff8801184dde30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff880118a6b098 ffff8801184ddfd8 000000000000fbc8 ffff880118a6b098 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 scsi_eh_0 S 0000000000000000 0 176 2 0x00000000 ffff88011877fe20 0000000000000046 0000000000000000 0000000000000282 ffff88011877fde0 ffffffff813a4447 ffff88011877fde0 ffffffff813a2dd8 ffff88011877dab8 ffff88011877ffd8 000000000000fbc8 ffff88011877dab8 Call Trace: [] ? ata_scsi_port_error_handler+0x627/0x710 [] ? ata_scsi_cmd_error_handler+0x128/0x180 [] scsi_error_handler+0x99/0x810 [] ? default_wake_function+0x12/0x20 [] ? scsi_error_handler+0x0/0x810 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 scsi_eh_1 S 0000000000000000 0 179 2 0x00000000 ffff880118727e20 0000000000000046 000000000000000f 0000000000000282 ffff880118727de0 ffffffff813a4447 ffff880118727de0 ffffffff813a2dd8 ffff88011877c5f8 ffff880118727fd8 000000000000fbc8 ffff88011877c5f8 Call Trace: [] ? ata_scsi_port_error_handler+0x627/0x710 [] ? ata_scsi_cmd_error_handler+0x128/0x180 [] scsi_error_handler+0x99/0x810 [] ? default_wake_function+0x12/0x20 [] ? scsi_error_handler+0x0/0x810 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 virtio-blk S 0000000000000001 0 274 2 0x00000000 ffff880118723e30 0000000000000046 ffff880118482ae8 ffff8800283168e8 ffff880118723db0 ffffffff8105af80 ffff880118482ad8 ffff8800283168e8 ffff880118aaf098 ffff880118723fd8 000000000000fbc8 ffff880118aaf098 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 jbd2/vda1-8 S 0000000000000000 0 290 2 0x00000000 ffff8801187fbe60 0000000000000046 000000000000175a 0000000000000000 00000000000000d2 0000000000000000 0000000000000000 0000000000000003 ffff880118451058 ffff8801187fbfd8 000000000000fbc8 ffff880118451058 Call Trace: [] ? prepare_to_wait+0x4e/0x80 [] kjournald2+0x1fa/0x220 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? kjournald2+0x0/0x220 [jbd2] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ext4-dio-unwr S 0000000000000001 0 291 2 0x00000000 ffff8801187f5e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff8801184505f8 ffff8801187f5fd8 000000000000fbc8 ffff8801184505f8 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 udevd S 0000000000000001 0 364 1 0x00000000 ffff880119a5ba58 0000000000000086 0000000000000000 ffffffff811a0d56 0000000000000000 ffff880119b9b500 ffffffff81061d00 0000000000000000 ffff880118587098 ffff880119a5bfd8 000000000000fbc8 ffff880118587098 Call Trace: [] ? pollwake+0x56/0x60 [] ? default_wake_function+0x0/0x20 [] schedule_hrtimeout_range+0x13d/0x160 [] ? __pollwait+0x75/0xf0 [] ? add_wait_queue+0x46/0x60 [] ? unix_dgram_poll+0x127/0x1c0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? autoremove_wake_function+0x0/0x40 [] ? generic_file_aio_write+0xba/0x100 [] ? do_sync_write+0xfa/0x140 [] ? sys_recvfrom+0xee/0x180 [] ? vfs_write+0x132/0x1a0 [] sys_poll+0x71/0x100 [] system_call_fastpath+0x16/0x1b virtio-net S 0000000000000000 0 401 2 0x00000000 ffff880117c91e30 0000000000000046 ffff8801186b7588 ffff8800282168e8 ffff880117c91db0 ffffffff8105af80 ffff8801186b7578 ffff8800282168e8 ffff880118586638 ffff880117c91fd8 000000000000fbc8 ffff880118586638 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? prepare_to_wait+0x4e/0x80 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 vballoon S 0000000000000001 0 425 2 0x00000000 ffff880119bcde40 0000000000000046 ffff880119bcddb0 ffffffff8105af80 ffff880118621578 ffff8800283168e8 ffff880119bcde10 ffffffff810096f0 ffff8801186b7af8 ffff880119bcdfd8 000000000000fbc8 ffff8801186b7af8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] ? __switch_to+0xd0/0x320 [] ? vp_get+0x50/0x70 [virtio_pci] [] balloon+0x204/0x260 [virtio_balloon] [] ? autoremove_wake_function+0x0/0x40 [] ? balloon+0x0/0x260 [virtio_balloon] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kauditd S 0000000000000001 0 704 2 0x00000000 ffff880118569e70 0000000000000046 0000000000000000 ffff88010e7cb8c0 ffff88010e7cb8c0 ffff88011868caa0 0000000000000001 ffff88010e7cb8c0 ffff88011868d058 ffff880118569fd8 000000000000fbc8 ffff88011868d058 Call Trace: [] kauditd_thread+0x149/0x180 [] ? default_wake_function+0x0/0x20 [] ? kauditd_thread+0x0/0x180 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 flush-252:0 S 0000000000000000 0 851 2 0x00000000 ffff88011b03fda0 0000000000000046 0000000000000000 ffff88011b03fd64 ffff880028210980 ffff88011876b118 00000001006f1876 ffff88011876b108 ffff88011848f098 ffff88011b03ffd8 000000000000fbc8 ffff88011848f098 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 dhclient S 0000000000000000 0 886 1 0x00000000 ffff880119bbd908 0000000000000086 0000000000000000 ffffffff8109fde3 ffff880100000000 0000000100000286 ffff880119bbd8a8 ffffffff8109f4a1 ffff880118890638 ffff880119bbdfd8 000000000000fbc8 ffff880118890638 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] ? get_page_from_freelist+0x3d1/0x870 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? enqueue_task_fair+0xfb/0x100 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? release_sock+0xe5/0x110 [] ? skb_free_datagram_locked+0x36/0x50 [] ? udp_recvmsg+0x17c/0x320 [] ? inet_recvmsg+0x5a/0x90 [] ? sock_recvmsg+0x133/0x160 [] ? autoremove_wake_function+0x0/0x40 [] core_sys_select+0x18a/0x2c0 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] sys_select+0x47/0x110 [] system_call_fastpath+0x16/0x1b auditd S 0000000000000000 0 924 1 0x00000000 ffff88011a277da8 0000000000000082 ffff88011a277d98 ffffffff8109fde3 ffff880100000000 000000011a277d08 ffff88011a277d88 ffff88011a277d88 ffff8801184db058 ffff88011a277fd8 000000000000fbc8 ffff8801184db058 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] ? ktime_get_ts+0xb1/0xf0 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b auditd S 0000000000000000 0 925 1 0x00000000 ffff880119b75bf8 0000000000000082 0000000000000000 000000d2810129fe ffff88010abe53d8 ffff88010ab629d0 0000000000000001 000000000019a59a ffff8801185f3058 ffff880119b75fd8 000000000000fbc8 ffff8801185f3058 Call Trace: [] futex_wait_queue_me+0xb9/0xf0 [] futex_wait+0x1f0/0x360 [] ? generic_file_aio_write+0xba/0x100 [] do_futex+0x121/0xb50 [] ? jbd2_log_wait_commit+0xf5/0x140 [jbd2] [] ? __percpu_counter_sum+0x58/0x80 [] ? ext4_statfs+0xef/0x1e0 [ext4] [] ? autoremove_wake_function+0x0/0x40 [] ? do_statfs_native+0x98/0xb0 [] sys_futex+0x7b/0x170 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000001 0 940 1 0x00000080 ffff88011b48b908 0000000000000086 ffff88011b48b8f8 ffffffff8109fde3 ffff880100000001 000000010001dd80 ffff88011b48b9a8 0000000000000001 ffff88011845b098 ffff88011b48bfd8 000000000000fbc8 ffff88011845b098 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? get_page_from_freelist+0x3d1/0x870 [] ? __rmqueue+0xc3/0x490 [] ? __pollwait+0x0/0xf0 [] ? perf_event_task_sched_out+0x33/0x70 [] ? dequeue_entity+0x113/0x2e0 [] ? find_get_page+0x1e/0xa0 [] ? filemap_fault+0xd3/0x500 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? enqueue_entity+0x125/0x450 [] ? check_preempt_wakeup+0x1a4/0x260 [] ? enqueue_task_fair+0xfb/0x100 [] ? check_preempt_curr+0x7c/0x90 [] ? try_to_wake_up+0x24e/0x3e0 [] ? sched_clock_local+0x25/0x90 [] core_sys_select+0x18a/0x2c0 [] ? up_read+0x1f/0x30 [] ? __do_page_fault+0x1ec/0x480 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] sys_select+0x47/0x110 [] system_call_fastpath+0x16/0x1b rs:main Q:Reg S 0000000000000000 0 941 1 0x00000080 ffff88011a979bf8 0000000000000086 0000000000000000 00000020810129fe ffff88010abe53d8 ffff8801197791e0 0000000000000001 00000000000de000 ffff88011cc2daf8 ffff88011a979fd8 000000000000fbc8 ffff88011cc2daf8 Call Trace: [] futex_wait_queue_me+0xb9/0xf0 [] futex_wait+0x1f0/0x360 [] ? generic_file_aio_write+0xba/0x100 [] do_futex+0x121/0xb50 [] ? fsnotify_add_notify_event+0x12d/0x280 [] ? autoremove_wake_function+0x0/0x40 [] sys_futex+0x7b/0x170 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000000 0 942 1 0x00000080 ffff88011b03d908 0000000000000086 ffff88011b03d8d0 ffff88011b03d8cc ffffffff8100bb8e ffff88011fc23040 ffff880028316880 0000000000000600 ffff880119b9b058 ffff88011b03dfd8 000000000000fbc8 ffff880119b9b058 Call Trace: [] ? apic_timer_interrupt+0xe/0x20 [] schedule_hrtimeout_range+0x13d/0x160 [] ? __pollwait+0x75/0xf0 [] ? unix_dgram_poll+0x127/0x1c0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? sock_recvmsg+0x133/0x160 [] ? autoremove_wake_function+0x0/0x40 [] ? enqueue_entity+0x125/0x450 [] ? check_preempt_wakeup+0x1a4/0x260 [] ? enqueue_task_fair+0xfb/0x100 [] ? check_preempt_curr+0x7c/0x90 [] ? try_to_wake_up+0x24e/0x3e0 [] core_sys_select+0x18a/0x2c0 [] ? __sys_recvmsg+0x13c/0x2f0 [] ? pvclock_clocksource_read+0x58/0xd0 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rsyslogd S 0000000000000001 0 944 1 0x00000080 ffff880119a17df8 0000000000000086 ffff880119a17db8 ffffffff810aee5e 000000000000fbc8 ffffffff81ed5d70 00007f0944894000 ffff880118429100 ffff880117cf2638 ffff880119a17fd8 000000000000fbc8 ffff880117cf2638 Call Trace: [] ? futex_wake+0x10e/0x120 [] ? prepare_to_wait+0x4e/0x80 [] do_syslog+0x461/0x4c0 [] ? autoremove_wake_function+0x0/0x40 [] ? __switch_to+0x26e/0x320 [] kmsg_read+0x32/0x60 [] proc_reg_read+0x7e/0xc0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b rpcbind S 0000000000000001 0 958 1 0x00000080 ffff88011d3bba58 0000000000000086 0000000000000000 ffffffff8109fde3 ffff880100000001 0000000100000286 ffff88011d3bb9f8 ffffffff8109f4a1 ffff880119b9a5f8 ffff88011d3bbfd8 000000000000fbc8 ffff880119b9a5f8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? fsnotify_clear_marks_by_inode+0x32/0xf0 [] ? sock_destroy_inode+0x19/0x20 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] ? poll_select_set_timeout+0x95/0xb0 [] sys_poll+0x71/0x100 [] system_call_fastpath+0x16/0x1b rpc.statd S 0000000000000001 0 976 1 0x00000080 ffff880119af3908 0000000000000082 0000000000000000 ffff8800283168e8 ffff880119b9a078 0000000000001441 ffff880119b9a040 0000000000000001 ffff88011ccfbab8 ffff880119af3fd8 000000000000fbc8 ffff88011ccfbab8 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? default_wake_function+0x0/0x20 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? __wake_up_common+0x59/0x90 [] ? handle_pte_fault+0x2cd/0xb00 [] ? pipe_write+0x318/0x6a0 [] core_sys_select+0x18a/0x2c0 [] ? __do_page_fault+0x1ec/0x480 [] ? __d_free+0x3f/0x60 [] ? d_free+0x58/0x60 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] system_call_fastpath+0x16/0x1b rpciod/0 S 0000000000000000 0 5068 2 0x00000080 ffff88011b015e30 0000000000000046 0000000000000000 ffffe8ffffc07188 ffff88011b015dd0 ffff880118ee2800 ffff880118ee2dd0 00000000ffffff95 ffff88011848faf8 ffff88011b015fd8 000000000000fbc8 ffff88011848faf8 Call Trace: [] ? xs_tcp_setup_socket+0x0/0x4c0 [sunrpc] [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 rpciod/1 S 0000000000000001 0 5069 2 0x00000080 ffff88011b017e30 0000000000000046 0000000000000000 0000000000000246 ffff88011b017da0 ffffffff8152c2cb ffff88011b017dd0 ffffffffa01aab71 ffff88011a963098 ffff88011b017fd8 000000000000fbc8 ffff88011a963098 Call Trace: [] ? _spin_unlock_bh+0x1b/0x20 [] ? rpc_wake_up_first+0xc1/0x1e0 [sunrpc] [] ? xprt_autoclose+0x0/0x70 [sunrpc] [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kslowd000 S 0000000000000001 0 5071 2 0x00000080 ffff880119241e60 0000000000000046 ffff880119241e28 ffff880119241e24 ffffffffffffffff ffff88011fc23240 ffff880028216880 0000000000000400 ffff88011845baf8 ffff880119241fd8 000000000000fbc8 ffff88011845baf8 Call Trace: [] slow_work_thread+0x32b/0x360 [] ? autoremove_wake_function+0x0/0x40 [] ? slow_work_thread+0x0/0x360 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 kslowd001 S 0000000000000000 0 5072 2 0x00000080 ffff88011b013e60 0000000000000046 0000000000000000 0000000a00000003 ffffffffffffffff ffffffff8106a33b ffff88011b013df0 ffff88011b013e80 ffff88011a963af8 ffff88011b013fd8 000000000000fbc8 ffff88011a963af8 Call Trace: [] ? enqueue_task_fair+0xfb/0x100 [] slow_work_thread+0x32b/0x360 [] ? autoremove_wake_function+0x0/0x40 [] ? slow_work_thread+0x0/0x360 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 nfsiod S 0000000000000000 0 5073 2 0x00000080 ffff88011b4d1e30 0000000000000046 0000000000000000 0000000000000286 ffff88011b4d1de0 ffffffff8153095c ffff8801185f3538 ffff8800282168e8 ffff88011ccfd058 ffff88011b4d1fd8 000000000000fbc8 ffff88011ccfd058 Call Trace: [] ? kprobe_flush_task+0xbc/0xe0 [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 nfsv4.0-svc S 0000000000000000 0 5074 2 0x00000080 ffff88011b709d70 0000000000000046 0000000000000000 000000020000f9d8 0000000000000000 ffff880028210660 00000000ffffffff 0000000000000008 ffff880118483ab8 ffff88011b709fd8 000000000000fbc8 ffff880118483ab8 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? __switch_to+0xd0/0x320 [] svc_recv+0x5a5/0x850 [sunrpc] [] ? default_wake_function+0x0/0x20 [] nfs4_callback_svc+0x43/0xb0 [nfs] [] ? nfs4_callback_svc+0x0/0xb0 [nfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 master S 0000000000000000 0 5162 1 0x00000080 ffff880119af1da8 0000000000000082 ffff880119af1d98 ffffffff8109fde3 ffff880100000000 000000018109eeeb 0000000c00000000 ffff8801194f6600 ffff880118753af8 ffff880119af1fd8 000000000000fbc8 ffff880118753af8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b qmgr S 0000000000000001 0 5171 5162 0x00000080 ffff880118577da8 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000001 00000001197d4200 0000000c00000000 ffff88011c9a54b8 ffff88011848e638 ffff880118577fd8 000000000000fbc8 ffff88011848e638 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b sshd S 0000000000000001 0 5742 1 0x00000080 ffff88011b701908 0000000000000086 0000000000000000 0000000000000031 0000000000000000 000000000000001b ffff8801097d2380 ffffffffffffff7e ffff88011a962638 ffff88011b701fd8 000000000000fbc8 ffff88011a962638 Call Trace: [] ? get_page_from_freelist+0x3d1/0x870 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? call_rcu_sched+0x15/0x20 [] ? call_rcu+0xe/0x10 [] ? vsnprintf+0x450/0x5e0 [] ? d_lookup+0x35/0x60 [] core_sys_select+0x18a/0x2c0 [] ? security_task_wait+0x16/0x20 [] ? wait_consider_task+0x9d/0xb20 [] ? remove_wait_queue+0x3c/0x50 [] ? fpu_finit+0x21/0x40 [] ? init_fpu+0x59/0xc0 [] ? __audit_syscall_exit+0x25e/0x290 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? int_check_syscall_exit_work+0x34/0x3d [] system_call_fastpath+0x16/0x1b agetty S 0000000000000000 0 5761 1 0x00000080 ffff880118fd5cc8 0000000000000082 0000000000000000 ffffffff8114a649 00000001182bc025 0000000000000000 0000000000000000 ffffea0003d72938 ffff880119be05f8 ffff880118fd5fd8 000000000000fbc8 ffff880119be05f8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? uart_write+0xe9/0x120 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5763 1 0x00000080 ffff88011900dcc8 0000000000000086 ffff88011900dca8 ffffffff8114a649 00000001182bc025 0000000000000000 0000000000000000 ffffea0003d81cb0 ffff88011868dab8 ffff88011900dfd8 000000000000fbc8 ffff88011868dab8 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5765 1 0x00000080 ffff880118f41cc8 0000000000000086 ffff880028216880 ffff88011845a0b8 ffff88011877cad8 ffff880028216880 ffff880118f41c98 ffffffff8105ad54 ffff88011845a638 ffff880118f41fd8 000000000000fbc8 ffff88011845a638 Call Trace: [] ? check_preempt_wakeup+0x1a4/0x260 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5767 1 0x00000080 ffff8801186d7cc8 0000000000000082 ffff880028216880 ffff88011877cad8 ffff8801186b60b8 ffff880028216880 ffff8801186d7c98 ffffffff8105ad54 ffff88011877d058 ffff8801186d7fd8 000000000000fbc8 ffff88011877d058 Call Trace: [] ? check_preempt_wakeup+0x1a4/0x260 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000000 0 5769 1 0x00000080 ffff8801186c9cc8 0000000000000086 000000000000fbc8 ffff8801186b6638 ffff88011845a080 ffff8801186b6080 ffff8801186c9c58 000000001845a080 ffff8801186b6638 ffff8801186c9fd8 000000000000fbc8 ffff8801186b6638 Call Trace: [] ? schedule_timeout+0x215/0x2e0 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b udevd S 0000000000000001 0 5773 364 0x00000080 ffff8801186c7a08 0000000000000082 ffff8801186c7998 ffff8800283168e8 ffff880028316918 ffff8800283168e8 ffff880118586b18 000000000002b1bf ffff880119b9bab8 ffff8801186c7fd8 000000000000fbc8 ffff880119b9bab8 Call Trace: [] ? wakeup_preempt_entity+0x47/0x50 [] ? check_preempt_wakeup+0x1a4/0x260 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? unix_dgram_sendmsg+0x5e5/0x6d0 [] ? sock_sendmsg+0x123/0x150 [] ? autoremove_wake_function+0x0/0x40 [] ? __sys_sendmsg+0x406/0x420 [] ? mntput_no_expire+0x30/0x110 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? sys_sendto+0x139/0x190 [] sys_ppoll+0x4c/0x180 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b udevd S 0000000000000001 0 5774 364 0x00000080 ffff8801186d1a08 0000000000000086 ffff8801186d19d0 ffff8801186d19cc ffff880028316918 ffff88011fc23240 ffff880028216880 00000000000007ff ffff880118591ab8 ffff8801186d1fd8 000000000000fbc8 ffff880118591ab8 Call Trace: [] ? wakeup_preempt_entity+0x47/0x50 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_sys_poll+0x457/0x520 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? unix_dgram_sendmsg+0x5e5/0x6d0 [] ? sock_sendmsg+0x123/0x150 [] ? autoremove_wake_function+0x0/0x40 [] ? handle_mm_fault+0x22a/0x300 [] ? perf_event_task_sched_out+0x33/0x70 [] ? __do_page_fault+0x1ec/0x480 [] ? __dequeue_entity+0x30/0x50 [] ? __switch_to+0x1ac/0x320 [] sys_ppoll+0x4c/0x180 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5775 1 0x00000080 ffff880118c8fcc8 0000000000000086 ffff880118c8fc90 ffff880118c8fc8c 00000001182bc025 ffff88011fc23240 ffff880028216880 00000000000005ff ffff88011cc2f058 ffff880118c8ffd8 000000000000fbc8 ffff88011cc2f058 Call Trace: [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b mingetty S 0000000000000001 0 5777 1 0x00000080 ffff88011889dcc8 0000000000000082 0000000000000000 ffffffff8114a649 00000001182bc025 0000000000000000 0000000000000000 ffffea0003d9d7a8 ffff880119be1058 ffff88011889dfd8 000000000000fbc8 ffff880119be1058 Call Trace: [] ? __do_fault+0x469/0x530 [] schedule_timeout+0x215/0x2e0 [] ? flush_work+0x21/0xc0 [] ? try_to_del_timer_sync+0x7b/0xe0 [] n_tty_read+0x5e6/0x920 [] ? release_console_sem+0x1cf/0x220 [] ? default_wake_function+0x0/0x20 [] tty_read+0xa6/0xf0 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b cfs_rh_00 S 0000000000000000 0 6073 2 0x00000080 ffff88011b647e40 0000000000000046 0000000000000000 0000000000000000 0000000000000008 0000000000000005 ffff88011b647e40 ffffffffa033dcf9 ffff8801185905f8 ffff88011b647fd8 000000000000fbc8 ffff8801185905f8 Call Trace: [] ? cfs_hash_rehash_worker+0x319/0x4f0 [libcfs] [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 cfs_rh_01 S 0000000000000000 0 6074 2 0x00000080 ffff88011b649e40 0000000000000046 0000000000000000 0000000000000000 0000000000000008 0000000000000005 ffff88011b649e40 ffffffffa033dcf9 ffff88011ccfc5f8 ffff88011b649fd8 000000000000fbc8 ffff88011ccfc5f8 Call Trace: [] ? cfs_hash_rehash_worker+0x319/0x4f0 [libcfs] [] ? prepare_to_wait_exclusive+0x4e/0x80 [] cfs_wi_scheduler+0x3d7/0x460 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? cfs_wi_scheduler+0x0/0x460 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 obd_zombid S 0000000000000000 0 6095 2 0x00000080 ffff880118e09e60 0000000000000046 0000000000000000 ffff8800282119a0 ffffffff81aaa5c0 0000000000000282 ffff880118e09e00 0000000000000282 ffff88011ccfdab8 ffff880118e09fd8 000000000000fbc8 ffff88011ccfdab8 Call Trace: [] obd_zombie_impexp_thread+0xd8/0x190 [obdclass] [] ? default_wake_function+0x0/0x20 [] ? obd_zombie_impexp_thread+0x0/0x190 [obdclass] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpc_hr00_0 S 0000000000000001 0 6096 2 0x00000080 ffff88011a9b1dd0 0000000000000046 0000000300000010 0000000a00000003 ffffffffffffffff ffff88011fc23240 ffff88011a9b1d60 ffffffff81283919 ffff880118753098 ffff88011a9b1fd8 000000000000fbc8 ffff880118753098 Call Trace: [] ? cpumask_next_and+0x29/0x50 [] ptlrpc_hr_main+0x14a/0x770 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpc_hr00_0 S 0000000000000001 0 6097 2 0x00000080 ffff88011b7d9dd0 0000000000000046 0000000000000000 ffffffff8109afb6 00000000000000d0 ffffffffa07d4858 ffff88011b7d9d90 ffffffff810546b9 ffff880118752638 ffff88011b7d9fd8 000000000000fbc8 ffff880118752638 Call Trace: [] ? autoremove_wake_function+0x16/0x40 [] ? __wake_up_common+0x59/0x90 [] ptlrpc_hr_main+0x14a/0x770 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_hr_main+0x0/0x770 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd00 S 0000000000000001 0 6100 2 0x00000080 ffff88011b665d60 0000000000000046 ffff88011b665cf0 ffffffff81058bd3 0000000000000000 ffff8801186ba000 ffff88011b665cf0 0000000000000246 ffff880117cf3098 ffff88011b665fd8 000000000000fbc8 ffff880117cf3098 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd01 S 0000000000000001 0 6101 2 0x00000080 ffff88011b667d60 0000000000000046 ffff88011b667cf0 ffffffff81058bd3 0000000000000000 ffff88010d22a000 ffff88011b667cf0 0000000000000246 ffff880118891098 ffff88011b667fd8 000000000000fbc8 ffff880118891098 Call Trace: [] ? __wake_up+0x53/0x70 [] ? ksocknal_create_conn+0x1373/0x1b30 [ksocklnd] [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd02 S 0000000000000000 0 6102 2 0x00000080 ffff880117eadd60 0000000000000046 0000000000000000 ffffffff81058bd3 0000000000000000 ffff88011a29e000 ffff880117eadcf0 0000000000000246 ffff880119be1ab8 ffff880117eadfd8 000000000000fbc8 ffff880119be1ab8 Call Trace: [] ? __wake_up+0x53/0x70 [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_cd03 S 0000000000000001 0 6103 2 0x00000080 ffff88011a2d9d60 0000000000000046 0000000000000000 ffffffff81058bd3 0000000000000000 ffff8801024aa000 ffff88011a2d9cf0 0000000000000246 ffff880118aae638 ffff88011a2d9fd8 000000000000fbc8 ffff880118aae638 Call Trace: [] ? __wake_up+0x53/0x70 [] schedule_timeout+0x215/0x2e0 [] ksocknal_connd+0x364/0xe30 [ksocklnd] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_connd+0x0/0xe30 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_reape S 0000000000000001 0 6104 2 0x00000080 ffff88011a2dbd30 0000000000000046 0000000000000000 ffff88011a2dbcf4 0000000000000286 0000000000000286 ffff88011a2dbcd0 ffffffff81083e1c ffff880118483058 ffff88011a2dbfd8 000000000000fbc8 ffff880118483058 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ksocknal_reaper+0xc4b/0xd60 [ksocklnd] [] ? default_wake_function+0x12/0x20 [] ? default_wake_function+0x0/0x20 [] ? ksocknal_reaper+0x0/0xd60 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_sd00_ S 0000000000000001 0 6105 2 0x00000080 ffff88011a2ddde0 0000000000000046 ffff88011c2660a0 0000000000000000 ffff88011c266038 ffff88011c26603c ffff88011a2ddde0 ffffffffa08e1f2a ffff8801184825f8 ffff88011a2ddfd8 000000000000fbc8 ffff8801184825f8 Call Trace: [] ? ksocknal_process_receive+0x15a/0xed0 [ksocklnd] [] ? prepare_to_wait_exclusive+0x4e/0x80 [] ksocknal_scheduler+0xdb1/0x1390 [ksocklnd] [] ? autoremove_wake_function+0x0/0x40 [] ? ksocknal_scheduler+0x0/0x1390 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 socknal_sd00_ S 0000000000000000 0 6106 2 0x00000080 ffff880117ec9de0 0000000000000046 ffff880117ec9da8 ffff880117ec9da4 ffff880117ec9db0 ffff88011fc23040 ffff880028316880 0000000000000400 ffff880117e6c638 ffff880117ec9fd8 000000000000fbc8 ffff880117e6c638 Call Trace: [] ksocknal_scheduler+0xdb1/0x1390 [ksocklnd] [] ? autoremove_wake_function+0x0/0x40 [] ? ksocknal_scheduler+0x0/0x1390 [ksocklnd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 acceptor_001 S 0000000000000000 0 6107 2 0x00000080 ffff880117ecbdd0 0000000000000046 0000000000000000 ffffffff81fd0820 ffff88011dc24400 ffff8801194ee688 ffff880117ecbd70 ffffffff811a79f2 ffff880118891af8 ffff880117ecbfd8 000000000000fbc8 ffff880118891af8 Call Trace: [] ? new_inode+0x72/0xb0 [] lnet_sock_accept+0x13d/0x170 [lnet] [] ? default_wake_function+0x0/0x20 [] lnet_acceptor+0x1b7/0xb50 [lnet] [] ? lnet_acceptor+0x0/0xb50 [lnet] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 router_checke S 0000000000000000 0 6108 2 0x00000080 ffff880117ecde30 0000000000000046 0000000000000000 ffff8800282168e8 ffff880117ecddb0 ffffffff8105af80 ffff880118587578 ffff8800282168e8 ffff8801184dbab8 ffff880117ecdfd8 000000000000fbc8 ffff8801184dbab8 Call Trace: [] ? __dequeue_entity+0x30/0x50 [] lnet_router_checker+0x469/0x520 [lnet] [] ? autoremove_wake_function+0x0/0x40 [] ? lnet_router_checker+0x0/0x520 [lnet] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_rcv S 0000000000000001 0 6109 2 0x00000080 ffff880118ca1d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff880037c90800 0000000000000286 ffff880118ca1cb0 ffffffff81083e1c ffff8801184da5f8 ffff880118ca1fd8 000000000000fbc8 ffff8801184da5f8 Call Trace: [] ? __wake_up+0x53/0x70 [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_0 S 0000000000000000 0 6110 2 0x00000080 ffff880118ca3d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff880119b39080 0000000000000282 ffff880118ca3cb0 ffffffff81083e1c ffff880118aa3058 ffff880118ca3fd8 000000000000fbc8 ffff880118aa3058 Call Trace: [] ? __wake_up+0x53/0x70 [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ptlrpcd_1 S 0000000000000001 0 6111 2 0x00000080 ffff88011b705d10 0000000000000046 0000000000000000 ffffffff81058bd3 ffff88010c2f25c0 ffff88011b8da3c0 ffff88011b705cf0 0000000000000282 ffff8801186b7098 ffff88011b705fd8 000000000000fbc8 ffff8801186b7098 Call Trace: [] ? __wake_up+0x53/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpcd+0x338/0x430 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpcd+0x0/0x430 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ping S 0000000000000001 0 6112 2 0x00000080 ffff880118ca7d40 0000000000000046 ffffffffa04d70a0 ffff88011b8da3c0 00000000ffffffff ffff88011a0b9290 ffff880118ca7d10 ffffffff8128daa4 ffff880118ca5ab8 ffff880118ca7fd8 000000000000fbc8 ffff880118ca5ab8 Call Trace: [] ? snprintf+0x34/0x40 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ptlrpc_pinger_main+0x928/0xac0 [ptlrpc] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_pinger_main+0x0/0xac0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sptlrpc_gc S 0000000000000001 0 6113 2 0x00000080 ffff88011b67bda0 0000000000000046 0000000000000000 ffff880028216880 ffff88011b67bd10 0000000000000286 ffff88011b67bd40 ffffffff81083e1c ffff880118ca5058 ffff88011b67bfd8 000000000000fbc8 ffff880118ca5058 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] sec_gc_main+0x28e/0x390 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? sec_gc_main+0x0/0x390 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_000 S 0000000000000001 0 6121 2 0x00000080 ffff88011c177d00 0000000000000046 ffff88011c151180 ffff880118ec0800 ffff88011c177c80 ffffffffa070404f 0000000000003039 ffffffffa07b61c0 ffff88011c173058 ffff88011c177fd8 000000000000fbc8 ffff88011c173058 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_001 S 0000000000000000 0 6122 2 0x00000080 ffff880118dd7d00 0000000000000046 ffff88011c151180 ffff880118ec0800 ffff880118dd7c80 ffffffffa070404f 0000000000003039 ffffffffa07b61c0 ffff88011c1725f8 ffff880118dd7fd8 000000000000fbc8 ffff88011c1725f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 lc_watchdogd S 0000000000000000 0 6123 2 0x00000080 ffff88011c17be10 0000000000000046 ffff88011c17bdd8 ffff88011c17bdd4 0000000000000000 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011c179af8 ffff88011c17bfd8 000000000000fbc8 ffff88011c179af8 Call Trace: [] lcw_dispatch_main+0xb9/0x950 [libcfs] [] ? autoremove_wake_function+0x0/0x40 [] ? lcw_dispatch_main+0x0/0x950 [libcfs] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_000 S 0000000000000001 0 6124 2 0x00000080 ffff88011c221d00 0000000000000046 ffff88011c15fdc0 ffff88011c1b8000 ffff88011c221c80 ffffffffa070404f 0000000000003039 ffffffffa07b61c0 ffff88011c179098 ffff88011c221fd8 000000000000fbc8 ffff88011c179098 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_001 S 0000000000000000 0 6125 2 0x00000080 ffff88011c227d00 0000000000000046 ffff88011c227cc8 ffff88011c227cc4 ffff88011c227c80 ffff88011fc23040 ffff880028316880 00000000000005ff ffff88011c178638 ffff88011c227fd8 000000000000fbc8 ffff88011c178638 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_002 S 0000000000000000 0 6126 2 0x00000080 ffff88011c22dd00 0000000000000046 ffff88011c22dcc8 ffff88011c22dcc4 ffff88011c22dc70 ffff88011fc23240 ffff880028216880 0000000000000a00 ffff88011c22bab8 ffff88011c22dfd8 000000000000fbc8 ffff88011c22bab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_00 S 0000000000000000 0 6127 2 0x00000080 ffff88011c231e40 0000000000000046 ffff88011c231e08 ffff88011c231e04 ffff88011c231dd0 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011c22b058 ffff88011c231fd8 000000000000fbc8 ffff88011c22b058 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_01 S 0000000000000000 0 6128 2 0x00000080 ffff88011c235e40 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff88011c235dd0 0000000000000282 ffff8800dd1e5140 ffff88010b2d5080 ffff88011c22a5f8 ffff88011c235fd8 000000000000fbc8 ffff88011c22a5f8 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_elt S 0000000000000001 0 6129 2 0x00000080 ffff88011c239e40 0000000000000046 ffff88011c239db0 ffffffff8109afb6 ffff8801185f3538 ffffffffa07cc3b0 ffff88011c239e00 ffffffff810546b9 ffff88011c237af8 ffff88011c239fd8 000000000000fbc8 ffff88011c237af8 Call Trace: [] ? autoremove_wake_function+0x16/0x40 [] ? __wake_up_common+0x59/0x90 [] expired_lock_main+0x272/0x8d0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? expired_lock_main+0x0/0x8d0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_poold S 0000000000000001 0 6130 2 0x00000080 ffff88011c23bda0 0000000000000046 0000000000000000 ffff88011c23bd50 0000000000000000 ffff88010a8ee600 0000000000000001 0000000000000000 ffff88011c237098 ffff88011c23bfd8 000000000000fbc8 ffff88011c237098 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] ldlm_pools_thread_main+0x1df/0x310 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_pools_thread_main+0x0/0x310 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_cfg_requeu S 0000000000000000 0 6131 2 0x00000080 ffff88011c241e30 0000000000000046 0000000000000000 ffffffff8152a51a ffff88011c236080 0000000000000282 0000000000000000 dead000000200200 ffff88011c236638 ffff88011c241fd8 000000000000fbc8 ffff88011c236638 Call Trace: [] ? schedule_timeout+0x19a/0x2e0 [] mgc_requeue_thread+0x5b4/0x7f0 [mgc] [] ? default_wake_function+0x0/0x20 [] ? mgc_requeue_thread+0x0/0x7f0 [mgc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_000 S 0000000000000000 0 6134 2 0x00000080 ffff88011c26fd00 0000000000000046 0000000000000000 ffff88011c26fcc4 ffff88011c24d828 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011c173ab8 ffff88011c26ffd8 000000000000fbc8 ffff88011c173ab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_001 S 0000000000000000 0 6135 2 0x00000080 ffff88011bc93d00 0000000000000046 000000000000001c ffffffff000089cb ffff88011c24fc28 00000000a03b0151 ffff88011bc93c70 ffff88011bc93c70 ffff88011bc91ab8 ffff88011bc93fd8 000000000000fbc8 ffff88011bc91ab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_002 S 0000000000000000 0 6136 2 0x00000080 ffff88011bc97d00 0000000000000046 0000000000000000 ffff88011bc97cc4 ffff88011c24d428 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88011bc91058 ffff88011bc97fd8 000000000000fbc8 ffff88011bc91058 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_create S 0000000000000000 0 6137 2 0x00000080 ffff88011bea9d00 0000000000000046 0000000000000007 ffffffff00008a0a ffff88011bc85028 00000000a03b0151 ffff88011bea9c70 ffff88011bea9c70 ffff88011bc905f8 ffff88011bea9fd8 000000000000fbc8 ffff88011bc905f8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_create S 0000000000000000 0 6138 2 0x00000080 ffff88011bed3d00 0000000000000046 0000000000000000 00000001006fbdf9 ffff88011bed3c70 0000000000000286 ffff88011bed3cc0 ffffffff81085f64 ffff88011bed1af8 ffff88011bed3fd8 000000000000fbc8 ffff88011bed1af8 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 6139 2 0x00000080 ffff88011c175d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff88011c175c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff880118ca45f8 ffff88011c175fd8 000000000000fbc8 ffff880118ca45f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 6140 2 0x00000080 ffff88011aeffd00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff88011aeffc80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff880118451ab8 ffff88011aefffd8 000000000000fbc8 ffff880118451ab8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 6141 2 0x00000080 ffff88011af0dd00 0000000000000046 0000000000000000 00000001006f0dff ffff88011af0dc70 0000000000000286 ffff88011af0dcc0 ffffffff81085f64 ffff88011bed1098 ffff88011af0dfd8 000000000000fbc8 ffff88011bed1098 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_seq00_ S 0000000000000001 0 6142 2 0x00000080 ffff88011a559d00 0000000000000046 ffff880028316880 0000000000000000 0000000000000001 0000000000000000 ffff88011bed0638 ffff88011a559fd8 ffff88011bed0638 ffff88011a559fd8 000000000000fbc8 ffff88011bed0638 Call Trace: [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_seq00_ S 0000000000000000 0 6143 2 0x00000080 ffff88011a565d00 0000000000000046 ffff880028316880 0000000000000000 0000000000000001 0000000000000000 ffff88011a55fab8 ffff88011a565fd8 ffff88011a55fab8 ffff88011a565fd8 000000000000fbc8 ffff88011a55fab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_out00_ S 0000000000000001 0 6144 2 0x00000080 ffff88010970bd00 0000000000000046 ffff880028316880 0000000000000000 0000000000000001 0000000000000000 ffff88011a55f058 ffff88010970bfd8 ffff88011a55f058 ffff88010970bfd8 000000000000fbc8 ffff88011a55f058 Call Trace: [] ? ptlrpc_server_normal_pending+0x52/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_out00_ S 0000000000000001 0 6145 2 0x00000080 ffff88010970fd00 0000000000000046 ffff880028316880 0000000000000000 0000000000000001 0000000000000000 ffff88011a55e5f8 ffff88010970ffd8 ffff88011a55e5f8 ffff88010970ffd8 000000000000fbc8 ffff88011a55e5f8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? __wake_up+0x53/0x70 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? __switch_to+0xd0/0x320 [] ? thread_return+0x4e/0x770 [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_evictor S 0000000000000001 0 6146 2 0x00000080 ffff88011a57fe00 0000000000000046 ffff8800283168e8 ffff88011a57d578 0000000000000029 0000000000000000 ffff88011a57fdb0 ffff8801192e56e8 ffff88011a57daf8 ffff88011a57ffd8 000000000000fbc8 ffff88011a57daf8 Call Trace: [] ? ping_evictor_main+0x0/0x650 [ptlrpc] [] ping_evictor_main+0x4c4/0x650 [ptlrpc] [] ? thread_return+0x4e/0x770 [] ? default_wake_function+0x0/0x20 [] ? ping_evictor_main+0x0/0x650 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 jbd2/vdc-8 S 0000000000000001 0 6331 2 0x00000080 ffff88010ca67e60 0000000000000046 0000000000000000 0000000000000000 00000000000013b9 0000000000000000 0000000000000000 0000000000000003 ffff8801185f3ab8 ffff88010ca67fd8 000000000000fbc8 ffff8801185f3ab8 Call Trace: [] kjournald2+0x1fa/0x220 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? kjournald2+0x0/0x220 [jbd2] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldiskfs-dio-u S 0000000000000001 0 6332 2 0x00000080 ffff88010c16de30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88011a57c638 ffff88010c16dfd8 000000000000fbc8 ffff88011a57c638 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_02 S 0000000000000001 0 6333 2 0x00000080 ffff88010249de40 0000000000000046 ffff88010249de08 ffff88010249de04 ffff88010249ddd0 ffff88011fc23240 ffff880028216880 00000000000007ff ffff88011cc2d098 ffff88010249dfd8 000000000000fbc8 ffff88011cc2d098 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_bl_02 S 0000000000000001 0 6334 2 0x00000080 ffff8801024a3e40 0000000000000046 ffffffff81aaa5c0 0000000000000282 ffff8801024a3dd0 0000000000000282 ffff8800dd7b43c0 ffff88010b3ac080 ffff88010c04e5f8 ffff8801024a3fd8 000000000000fbc8 ffff88010c04e5f8 Call Trace: [] ldlm_bl_thread_main+0x436/0x4b0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ldlm_bl_thread_main+0x0/0x4b0 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 inconsistency S 0000000000000000 0 6336 2 0x00000080 ffff8801069cddb0 0000000000000046 0000000000000000 ffff8801069cc000 0000000000008050 0000000000000060 ffff88011fc10080 0000000000008050 ffff880118de9af8 ffff8801069cdfd8 000000000000fbc8 ffff880118de9af8 Call Trace: [] ofd_inconsistency_verification_main+0xd2b/0x1190 [ofd] [] ? default_wake_function+0x0/0x20 [] ? ofd_inconsistency_verification_main+0x0/0x1190 [ofd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 lquota_wb_lus S 0000000000000000 0 6340 2 0x00000080 ffff88010d283d30 0000000000000046 0000000000000000 0000000000000003 ffff88010d283cc0 0000000000000282 ffff88010d283cd0 ffffffff81083e1c ffff880117e6daf8 ffff88010d283fd8 000000000000fbc8 ffff880117e6daf8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] qsd_upd_thread+0xa59/0xf70 [lquota] [] ? default_wake_function+0x0/0x20 [] ? qsd_upd_thread+0x0/0xf70 [lquota] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_003 S 0000000000000000 0 6463 2 0x00000080 ffff880109735d00 0000000000000046 000000000000001c ffffffff000089db ffff88011c242c28 00000000a03b0151 ffff880109735c70 ffff880109735c70 ffff880118587af8 ffff880109735fd8 000000000000fbc8 ffff880118587af8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_create S 0000000000000000 0 7186 2 0x00000080 ffff88010d2b5d00 0000000000000046 ffff88010d2b5cc8 ffff88010d2b5cc4 ffff88010d2b5c70 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88010c023058 ffff88010d2b5fd8 000000000000fbc8 ffff88010c023058 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cb00_002 S 0000000000000000 0 7229 2 0x00000080 ffff88010d29dd00 0000000000000046 0000000000000000 00000001006bc76b ffff88010d29dc70 0000000000000282 ffff88010d29dcc0 ffffffff81085f64 ffff88010a07d058 ffff88010d29dfd8 000000000000fbc8 ffff88010a07d058 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 14889 2 0x00000080 ffff88011aafdd00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff88011aafdc80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff880117e6d098 ffff88011aafdfd8 000000000000fbc8 ffff880117e6d098 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_003 S 0000000000000000 0 14890 2 0x00000080 ffff88010957bd00 0000000000000046 0000000000000000 000000010070a2bd ffff88010957bc70 0000000000000282 ffff88010957bcc0 ffffffff81085f64 ffff88011ccfa5f8 ffff88010957bfd8 000000000000fbc8 ffff88011ccfa5f8 Call Trace: [] ? mod_timer+0x144/0x220 [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_server_handle_req_in+0xa56/0xcb0 [ptlrpc] [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 16335 2 0x00000080 ffff88010956fd00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff88010956fc80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88010c023ab8 ffff88010956ffd8 000000000000fbc8 ffff88010c023ab8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 16336 2 0x00000080 ffff880117fe5d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff880117fe5c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88011ccfb058 ffff880117fe5fd8 000000000000fbc8 ffff88011ccfb058 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 16337 2 0x00000080 ffff88010a1f7d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff88010a1f7c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff880118de9098 ffff88010a1f7fd8 000000000000fbc8 ffff880118de9098 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] ? blk_unplug_work+0x0/0x70 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 16338 2 0x00000080 ffff880117f8fd00 0000000000000046 ffff880117f8fcc8 ffff880117f8fcc4 ffff880117f8fc80 ffff88011fc23240 ffff880028216880 0000000000000400 ffff88010cbdb058 ffff880117f8ffd8 000000000000fbc8 ffff88010cbdb058 Call Trace: [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 16339 2 0x00000080 ffff8801095c5d00 0000000000000046 0000000000000000 ffff88011bec3400 ffff8801095c5c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88010cbda5f8 ffff8801095c5fd8 000000000000fbc8 ffff88010cbda5f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] ? blk_unplug_work+0x0/0x70 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_004 S 0000000000000000 0 16369 2 0x00000080 ffff880109473d00 0000000000000046 000000000000001c ffffffff00008a10 ffff880118e21828 00000000a03b0151 ffff880109473c70 ffff880109473c70 ffff88011a57d098 ffff880109473fd8 000000000000fbc8 ffff88011a57d098 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_005 S 0000000000000001 0 16370 2 0x00000080 ffff88010946fd00 0000000000000046 000000000000001c ffffffff000088eb ffff88011c253028 00000000a03b0151 ffff88010946fc70 ffff88010946fc70 ffff8801094eb098 ffff88010946ffd8 000000000000fbc8 ffff8801094eb098 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_006 S 0000000000000000 0 16371 2 0x00000080 ffff880109457d00 0000000000000046 000000000000001c ffffffff000089cc ffff88011c258428 00000000a03b0151 ffff880109457c70 ffff880109457c70 ffff88010c04fab8 ffff880109457fd8 000000000000fbc8 ffff88010c04fab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_007 S 0000000000000001 0 16372 2 0x00000080 ffff88010945fd00 0000000000000046 ffff88010945fcc8 ffff88010945fcc4 000000000000fbc8 ffff88011fc23240 ffff880028216880 00000000000007ff ffff8801094ea638 ffff88010945ffd8 000000000000fbc8 ffff8801094ea638 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ? ptlrpc_server_handle_req_in+0xa56/0xcb0 [ptlrpc] [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_008 S 0000000000000000 0 16373 2 0x00000080 ffff880109487d00 0000000000000046 000000000000001c ffffffff000089e2 ffff88011c24e028 00000000a03b0151 ffff880109487c70 ffff880109487c70 ffff88010a07c5f8 ffff880109487fd8 000000000000fbc8 ffff88010a07c5f8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_009 S 0000000000000000 0 16374 2 0x00000080 ffff8801094e5d00 0000000000000046 000000000000001c ffffffff000089d0 ffff88011c24ec28 00000000a03b0151 ffff8801094e5c70 ffff8801094e5c70 ffff88010a07dab8 ffff8801094e5fd8 000000000000fbc8 ffff88010a07dab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_010 S 0000000000000000 0 16375 2 0x00000080 ffff8801094efd00 0000000000000046 000000000000001c ffffffff000089dd ffff88011c254028 00000000a03b0151 ffff8801094efc70 ffff8801094efc70 ffff880119383ab8 ffff8801094effd8 000000000000fbc8 ffff880119383ab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_011 S 0000000000000001 0 16376 2 0x00000080 ffff880109499d00 0000000000000046 000000000000001c ffffffff000089e1 ffff88011c253828 00000000a03b0151 ffff880109499c70 ffff880109499c70 ffff880109483af8 ffff880109499fd8 000000000000fbc8 ffff880109483af8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_012 S 0000000000000000 0 16377 2 0x00000080 ffff8801094c3d00 0000000000000046 000000000000001c ffffffff000089de ffff88011c255028 00000000a03b0151 ffff8801094c3c70 ffff8801094c3c70 ffff880109483098 ffff8801094c3fd8 000000000000fbc8 ffff880109483098 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_013 S 0000000000000000 0 16378 2 0x00000080 ffff8801094d3d00 0000000000000046 000000000000001c ffffffff00008a06 ffff88011c255828 00000000a03b0151 ffff8801094d3c70 ffff8801094d3c70 ffff88010c0225f8 ffff8801094d3fd8 000000000000fbc8 ffff88010c0225f8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_014 S 0000000000000000 0 16379 2 0x00000080 ffff8801094d7d00 0000000000000046 000000000000001c ffffffff00008a12 ffff88011c250c28 00000000a03b0151 ffff8801094d7c70 ffff8801094d7c70 ffff8801094dfab8 ffff8801094d7fd8 000000000000fbc8 ffff8801094dfab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_015 S 0000000000000001 0 16380 2 0x00000080 ffff88010946dd00 0000000000000046 000000000000001c ffffffff000089e0 ffff88011c254428 00000000a03b0151 ffff88010946dc70 ffff88010946dc70 ffff880109482638 ffff88010946dfd8 000000000000fbc8 ffff880109482638 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_016 S 0000000000000001 0 16381 2 0x00000080 ffff880109517d00 0000000000000046 000000000000001c ffffffff000089df ffff88011c24f428 00000000a03b0151 ffff880109517c70 ffff880109517c70 ffff880109525ab8 ffff880109517fd8 000000000000fbc8 ffff880109525ab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldlm_cn00_004 S 0000000000000000 0 16382 2 0x00000080 ffff880117fedd00 0000000000000046 ffff88011c15fdc0 ffff880118dd3000 ffff880117fedc80 ffffffffa070404f 0000000000003039 ffffffffa07b61c0 ffff8801094ebaf8 ffff880117fedfd8 000000000000fbc8 ffff8801094ebaf8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 flush-252:16 S 0000000000000001 0 17752 2 0x00000080 ffff88010943bda0 0000000000000046 0000000000000000 ffff88011a93e800 ffff880028216918 ffff88011876a5e8 00000001006f1f56 ffff88011876a5d8 ffff88011b3a4638 ffff88010943bfd8 000000000000fbc8 ffff88011b3a4638 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 flush-252:32 S 0000000000000001 0 17753 2 0x00000080 ffff880119ad7da0 0000000000000046 0000000000000000 ffff880119ad7d64 ffff880028216918 ffff880117c27158 00000001006f15e4 ffff880117c27148 ffff88011cc2e5f8 ffff880119ad7fd8 000000000000fbc8 ffff88011cc2e5f8 Call Trace: [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] schedule_timeout_interruptible+0x1e/0x20 [] bdi_writeback_task+0xa0/0x1b0 [] ? bit_waitqueue+0x17/0xd0 [] ? bdi_start_fn+0x0/0x100 [] bdi_start_fn+0x86/0x100 [] ? bdi_start_fn+0x0/0x100 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 pickup S 0000000000000000 0 29689 5162 0x00000080 ffff88011b357da8 0000000000000082 0000000000000000 ffffffff8109fde3 ffff880100000000 000000018109eeeb ffff88011b357d48 ffffffff8109f4a1 ffff8801094de5f8 ffff88011b357fd8 000000000000fbc8 ffff8801094de5f8 Call Trace: [] ? __hrtimer_start_range_ns+0x1a3/0x460 [] ? lock_hrtimer_base+0x31/0x60 [] schedule_hrtimeout_range+0xc8/0x160 [] ? hrtimer_wakeup+0x0/0x30 [] ? hrtimer_start_range_ns+0x14/0x20 [] ep_poll+0x2ad/0x330 [] ? default_wake_function+0x0/0x20 [] sys_epoll_wait+0xc5/0xe0 [] system_call_fastpath+0x16/0x1b ll_ost00_017 S 0000000000000000 0 29931 2 0x00000080 ffff88010af9dd00 0000000000000046 000000000000001c ffffffff000089cf ffff88011c25ac28 00000000a03b0151 ffff88010af9dc70 ffff88010af9dc70 ffff88011b3a5098 ffff88010af9dfd8 000000000000fbc8 ffff88011b3a5098 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost00_018 S 0000000000000000 0 686 2 0x00000080 ffff880109461d00 0000000000000046 000000000000001c ffffffff000089d1 ffff88011bb13828 00000000a03b0151 ffff880109461c70 ffff880109461c70 ffff880117cf3af8 ffff880109461fd8 000000000000fbc8 ffff880117cf3af8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 jbd2/vdb-8 S 0000000000000000 0 3511 2 0x00000080 ffff88011c027e60 0000000000000046 0000000000000000 0000000000000000 00000000000013b8 0000000000000000 0000000000000000 0000000000000003 ffff880118591058 ffff88011c027fd8 000000000000fbc8 ffff880118591058 Call Trace: [] kjournald2+0x1fa/0x220 [jbd2] [] ? autoremove_wake_function+0x0/0x40 [] ? kjournald2+0x0/0x220 [jbd2] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ldiskfs-dio-u S 0000000000000000 0 3512 2 0x00000080 ffff88010a0f1e30 0000000000000046 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffff88010be77058 ffff88010a0f1fd8 000000000000fbc8 ffff88010be77058 Call Trace: [] ? worker_thread+0x0/0x2a0 [] worker_thread+0x1fc/0x2a0 [] ? autoremove_wake_function+0x0/0x40 [] ? worker_thread+0x0/0x2a0 [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 inconsistency S 0000000000000000 0 3514 2 0x00000080 ffff88011a0b7db0 0000000000000046 0000000000000000 ffff88011a0b6000 0000000000008050 0000000000000060 ffff88011fc10080 0000000000008050 ffff880119383058 ffff88011a0b7fd8 000000000000fbc8 ffff880119383058 Call Trace: [] ofd_inconsistency_verification_main+0xd2b/0x1190 [ofd] [] ? default_wake_function+0x0/0x20 [] ? ofd_inconsistency_verification_main+0x0/0x1190 [ofd] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 lquota_wb_lus S 0000000000000000 0 3520 2 0x00000080 ffff88011b81bd30 0000000000000046 0000000000000000 0000000000000003 ffff88011b81bcc0 0000000000000282 ffff88011b81bcd0 ffffffff81083e1c ffff88010b0985f8 ffff88011b81bfd8 000000000000fbc8 ffff88010b0985f8 Call Trace: [] ? lock_timer_base+0x3c/0x70 [] schedule_timeout+0x192/0x2e0 [] ? process_timeout+0x0/0x10 [] qsd_upd_thread+0xa59/0xf70 [lquota] [] ? default_wake_function+0x0/0x20 [] ? qsd_upd_thread+0x0/0xf70 [lquota] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 10869 2 0x00000080 ffff8800df81dd00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff8800df81dc80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88010e8165f8 ffff8800df81dfd8 000000000000fbc8 ffff88010e8165f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sshd S 0000000000000000 0 11001 5742 0x00000080 ffff88010ca07908 0000000000000086 0000000000000000 ffff88010e0df8a8 ffff88010ca07888 ffffffff814b22fd ffff88010e0df8a8 ffff8801185636e0 ffff8801094df058 ffff88010ca07fd8 000000000000fbc8 ffff8801094df058 Call Trace: [] ? tcp_wfree+0x3d/0xd0 [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? unlock_page+0x27/0x30 [] ? __do_fault+0x469/0x530 [] ? handle_pte_fault+0xf7/0xb00 [] ? release_sock+0xe5/0x110 [] core_sys_select+0x18a/0x2c0 [] ? __wake_up_sync_key+0x5e/0x80 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sh S 0000000000000000 0 11003 11001 0x00000080 ffff88011b967e78 0000000000000082 0000000000000000 0000000000000028 0000000000440910 ffff88011861f780 ffff88011873d148 0000000000000014 ffff880118de8638 ffff88011b967fd8 000000000000fbc8 ffff880118de8638 Call Trace: [] do_wait+0x1e4/0x240 [] sys_wait4+0xa3/0x100 [] ? child_wait_callback+0x0/0x70 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b tail S 0000000000000001 0 11012 11003 0x00000080 ffff88011b237e28 0000000000000086 ffff88011b237db8 ffffffffa0083e08 0000000000000000 ffff88011b237dc8 ffff88011b237dc8 ffff88011b3d9a40 ffff88010c04f058 ffff88011b237fd8 000000000000fbc8 ffff88010c04f058 Call Trace: [] ? ext4_file_write+0x58/0x190 [ext4] [] ? prepare_to_wait+0x4e/0x80 [] inotify_read+0xe9/0x330 [] ? autoremove_wake_function+0x0/0x40 [] ? security_file_permission+0x16/0x20 [] vfs_read+0xb5/0x1a0 [] sys_read+0x51/0x90 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b ll_ost_io00_0 S 0000000000000000 0 11601 2 0x00000080 ffff880037131d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff880037131c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff8801191c85f8 ffff880037131fd8 000000000000fbc8 ffff8801191c85f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11602 2 0x00000080 ffff8800df893d00 0000000000000046 5a5a5a5a5a5a5a5a 5a5a5a5a5a5a5a5a 0000000000000000 ffff88011beb3e80 0000000000000000 0000000000000000 ffff88010980c5f8 ffff8800df893fd8 000000000000fbc8 ffff88010980c5f8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11603 2 0x00000080 ffff880036e43d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff880036e43c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff880036ee5058 ffff880036e43fd8 000000000000fbc8 ffff880036ee5058 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 11604 2 0x00000080 ffff880037c9dd00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff880037c9dc80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88010980d058 ffff880037c9dfd8 000000000000fbc8 ffff88010980d058 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 11605 2 0x00000080 ffff8800ded3fd00 0000000000000046 ffff8800ded3fcc8 ffff8800ded3fcc4 ffff8800ded3fc80 ffff88011fc23040 ffff880028316880 0000000000000400 ffff88010b099ab8 ffff8800ded3ffd8 000000000000fbc8 ffff88010b099ab8 Call Trace: [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000000 0 11607 2 0x00000080 ffff8800de8bfd00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff8800de8bfc80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff8801193825f8 ffff8800de8bffd8 000000000000fbc8 ffff8801193825f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11609 2 0x00000080 ffff8800dea19d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff8800dea19c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88010be765f8 ffff8800dea19fd8 000000000000fbc8 ffff88010be765f8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11610 2 0x00000080 ffff8800ddf11d00 0000000000000046 ffff8800ddf11cc8 ffff8800ddf11cc4 ffff8800ddf11c80 ffff88011fc23240 ffff880028216880 0000000000000800 ffff88010980dab8 ffff8800ddf11fd8 000000000000fbc8 ffff88010980dab8 Call Trace: [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11642 2 0x00000080 ffff8800dc7d1d00 0000000000000046 ffff88011beb3e80 ffff88011bec3400 ffff8800dc7d1c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff88010cbdbab8 ffff8800dc7d1fd8 000000000000fbc8 ffff88010cbdbab8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11643 2 0x00000080 ffff8800dc13fd00 0000000000000046 ffff8800dc13fcc8 ffff8800dc13fcc4 ffff8800dc13fc80 ffff88011fc23240 ffff880028216880 0000000000000400 ffff88011cc2fab8 ffff8800dc13ffd8 000000000000fbc8 ffff88011cc2fab8 Call Trace: [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 ll_ost_io00_0 S 0000000000000001 0 11644 2 0x00000080 ffff8800dc227d00 0000000000000046 ffff88011beb3e80 ffff88011bec3800 ffff8800dc227c80 ffffffffa070404f 0000000000000010 ffffffffa07b61c0 ffff8801191c9ab8 ffff8800dc227fd8 000000000000fbc8 ffff8801191c9ab8 Call Trace: [] ? tgt_ses_key_fini+0x12f/0x210 [ptlrpc] [] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc] [] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc] [] ? default_wake_function+0x0/0x20 [] ptlrpc_main+0xa3f/0x1a80 [ptlrpc] [] ? ptlrpc_main+0x0/0x1a80 [ptlrpc] [] kthread+0x96/0xa0 [] child_rip+0xa/0x20 [] ? kthread+0x0/0xa0 [] ? child_rip+0x0/0x20 sshd S 0000000000000001 0 11764 5742 0x00000080 ffff880117e55908 0000000000000086 ffff880117e558d0 ffff880117e558cc ffff880118740240 ffff88011fc23240 ffff880028216880 00000000000006e2 ffff88011cc2c638 ffff880117e55fd8 000000000000fbc8 ffff88011cc2c638 Call Trace: [] schedule_hrtimeout_range+0x13d/0x160 [] ? add_wait_queue+0x46/0x60 [] ? __pollwait+0x75/0xf0 [] poll_schedule_timeout+0x39/0x60 [] do_select+0x57c/0x6c0 [] ? __pollwait+0x0/0xf0 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? do_wp_page+0x493/0x920 [] ? handle_pte_fault+0x2cd/0xb00 [] core_sys_select+0x18a/0x2c0 [] ? __wake_up_sync_key+0x5e/0x80 [] ? mntput_no_expire+0x30/0x110 [] sys_select+0x47/0x110 [] ? audit_syscall_entry+0x1d7/0x200 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b bash S 0000000000000001 0 11825 11764 0x00000080 ffff88010e813e78 0000000000000082 0000000000000000 0000000000000029 00000000006dc1e4 ffff88011861ec80 ffff88011901a250 0000000000000007 ffff88011b3a5af8 ffff88010e813fd8 000000000000fbc8 ffff88011b3a5af8 Call Trace: [] do_wait+0x1e4/0x240 [] sys_wait4+0xa3/0x100 [] ? child_wait_callback+0x0/0x70 [] ? __audit_syscall_exit+0x25e/0x290 [] system_call_fastpath+0x16/0x1b sh R running task 0 11834 11825 0x00000088 ffff88010ca2fce8 00000000ef2290ca ffff88010ca2fd58 ffff880109524aa0 0000000000000000 ffff88010ca2fcc8 ffff880028303fc0 ffffffff817d6def ffff88010ca2fd48 ffffffff815290e5 0000000000000010 ffff88010ca2fd58 Call Trace: [] show_trace_log_lvl+0x55/0x70 [] show_stack_log_lvl+0x9a/0x170 [] show_stack+0x1a/0x20 [] sched_show_task+0x98/0x100 [] show_state_filter+0x7b/0xc0 [] sysrq_handle_showstate+0x10/0x20 [] __handle_sysrq+0x132/0x1a0 [] write_sysrq_trigger+0x4e/0x50 [] proc_reg_write+0x7e/0xc0 [] vfs_write+0xb8/0x1a0 [] sys_write+0x51/0x90 [] system_call_fastpath+0x16/0x1b Sched Debug Version: v0.09, 2.6.32-431.29.2.el6_lustremaster_master__49 #1 now at 7587734.858227 msecs .jiffies : 4302251103 .sysctl_sched_latency : 10.000000 .sysctl_sched_min_granularity : 2.000000 .sysctl_sched_wakeup_granularity : 2.000000 .sysctl_sched_child_runs_first : 0.000000 .sysctl_sched_features : 3183 .sysctl_sched_tunable_scaling : 1 (logaritmic) cpu#0, 2793.268 MHz .nr_running : 0 .load : 0 .nr_switches : 649017 .nr_load_updates : 277293 .nr_uninterruptible : 0 .next_balance : 4302.251107 .curr->pid : 0 .clock : 7587755.026517 .cpu_load[0] : 0 .cpu_load[1] : 352 .cpu_load[2] : 382 .cpu_load[3] : 287 .cpu_load[4] : 200 .yld_count : 0 .sched_switch : 0 .sched_count : 657541 .sched_goidle : 180615 .avg_idle : 1000000 .ttwu_count : 347413 .ttwu_local : 285052 .bkl_count : 856 cfs_rq[0]:/ .exec_clock : 120030.669045 .MIN_vruntime : 0.000001 .min_vruntime : 273272.090736 .max_vruntime : 0.000001 .spread : 0.000000 .spread0 : 0.000000 .nr_spread_over : 38581 .nr_running : 0 .load : 0 .tg->cfs_bandwidth.timer_active: 0 .throttled : 0 .throttle_count : 0 .load_avg : 0.000000 .load_period : 0.000000 .load_contrib : 0 .load_tg : 0 rt_rq[0]:/ .rt_nr_running : 0 .rt_throttled : 0 .rt_time : 0.000000 .rt_runtime : 950.000000 runnable tasks: task PID tree-key switches prio exec-runtime sum-exec sum-sleep ---------------------------------------------------------------------------------------------------------- cpu#1, 2793.268 MHz .nr_running : 1 .load : 1024 .nr_switches : 653929 .nr_load_updates : 273360 .nr_uninterruptible : 0 .next_balance : 4302.251336 .curr->pid : 11834 .clock : 7583929.648363 .cpu_load[0] : 1024 .cpu_load[1] : 816 .cpu_load[2] : 710 .cpu_load[3] : 723 .cpu_load[4] : 631 .yld_count : 0 .sched_switch : 0 .sched_count : 662098 .sched_goidle : 181887 .avg_idle : 1000000 .ttwu_count : 350841 .ttwu_local : 287515 .bkl_count : 923 cfs_rq[1]:/ .exec_clock : 116060.942351 .MIN_vruntime : 0.000001 .min_vruntime : 270521.375677 .max_vruntime : 0.000001 .spread : 0.000000 .spread0 : -2750.715059 .nr_spread_over : 37846 .nr_running : 1 .load : 1024 .tg->cfs_bandwidth.timer_active: 0 .throttled : 0 .throttle_count : 0 .load_avg : 0.000000 .load_period : 0.000000 .load_contrib : 0 .load_tg : 0 rt_rq[1]:/ .rt_nr_running : 0 .rt_throttled : 0 .rt_time : 0.000000 .rt_runtime : 950.000000 runnable tasks: task PID tree-key switches prio exec-runtime sum-exec sum-sleep ---------------------------------------------------------------------------------------------------------- R sh 11834 270521.375677 1 120 270521.375677 122.845362 0.000000 / SysRq : Show Memory Mem-Info: Node 0 DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 CPU 1: hi: 0, btch: 1 usd: 0 Node 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 166 CPU 1: hi: 186, btch: 31 usd: 176 Node 0 Normal per-cpu: CPU 0: hi: 186, btch: 31 usd: 88 CPU 1: hi: 186, btch: 31 usd: 139 active_anon:2452 inactive_anon:37 isolated_anon:0 active_file:40313 inactive_file:29774 isolated_file:0 unevictable:0 dirty:135 writeback:3 unstable:0 free:818911 slab_reclaimable:4830 slab_unreclaimable:27632 mapped:1615 shmem:40 pagetables:469 bounce:0 Node 0 DMA free:15716kB min:248kB low:308kB high:372kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15304kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 3512 4017 4017 Node 0 DMA32 free:3245072kB min:58868kB low:73584kB high:88300kB active_anon:20kB inactive_anon:0kB active_file:3324kB inactive_file:924kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3596500kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:388kB slab_unreclaimable:1356kB kernel_stack:96kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 505 505 Node 0 Normal free:14856kB min:8464kB low:10580kB high:12696kB active_anon:9788kB inactive_anon:148kB active_file:157928kB inactive_file:118172kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:517120kB mlocked:0kB dirty:540kB writeback:12kB mapped:6460kB shmem:160kB slab_reclaimable:18932kB slab_unreclaimable:109172kB kernel_stack:1400kB pagetables:1876kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Node 0 DMA: 3*4kB 1*8kB 1*16kB 2*32kB 2*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15716kB Node 0 DMA32: 208*4kB 196*8kB 175*16kB 130*32kB 98*64kB 70*128kB 60*256kB 44*512kB 24*1024kB 12*2048kB 765*4096kB = 3245072kB Node 0 Normal: 494*4kB 252*8kB 76*16kB 50*32kB 24*64kB 11*128kB 4*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 14872kB 70114 total pagecache pages 0 pages in swap cache Swap cache stats: add 0, delete 0, find 0/0 Free swap = 2538492kB Total swap = 2538492kB 1048575 pages RAM 100409 pages reserved 31341 pages shared 78754 pages non-shared