Mar 21 10:22:51 fir-io1-s1 kernel: SysRq : Show State
Mar 21 10:22:51 fir-io1-s1 kernel: task PC stack pid father
Mar 21 10:22:51 fir-io1-s1 kernel: systemd S ffff983969b18000 0 1 0 0x00000000
Mar 21 10:22:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff8528eaa9>] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:22:51 fir-io1-s1 kernel: kthreadd S ffff983969b19040 0 2 0 0x00000000
Mar 21 10:22:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:51 fir-io1-s1 kernel: [<ffffffff850c2625>] kthreadd+0x2f5/0x300
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c2330>] ? kthread_create_on_cpu+0x60/0x60
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c2330>] ? kthread_create_on_cpu+0x60/0x60
Mar 21 10:22:52 fir-io1-s1 kernel: ksoftirqd/0 S ffff983969b1a080 0 3 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: kworker/0:0H S ffff983969b1c100 0 5 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: migration/0 S ffff983969ba8000 0 8 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff8575bfcb>] ? queued_spin_lock_slowpath+0xb/0xf
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: rcu_bh S ffff983969ba9040 0 9 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff851554c2>] rcu_gp_kthread+0xb2/0x710
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85155410>] ? rcu_gp_fqs+0x90/0x90
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: rcu_sched S ffff983969baa080 0 10 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c27f6>] ? prepare_to_wait+0x56/0x90
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85155759>] rcu_gp_kthread+0x349/0x710
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85155410>] ? rcu_gp_fqs+0x90/0x90
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: lru-add-drain S ffff983969bab0c0 0 11 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: watchdog/0 S ffff983969bac100 0 12 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: watchdog/1 S ffff9848e9f7a080 0 13 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: migration/1 S ffff9848e9f7b0c0 0 14 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: ksoftirqd/1 S ffff9848e9f7c100 0 15 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: kworker/1:0H S ffff9848e9fa9040 0 17 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850b7467>] ? start_worker+0x27/0x30
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850baba9>] ? manage_workers.isra.25+0x189/0x2a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: watchdog/2 S ffff9858e9432080 0 19 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850d9f51>] ? local_clock+0x1/0x30
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: migration/2 R running task 0 20 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff851301e0>] ? cpu_stop_unpark+0x50/0x50
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: ksoftirqd/2 R running task 0 21 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: kworker/2:0H S ffff9858e9459040 0 23 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: watchdog/3 S ffff9868e9492080 0 25 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: migration/3 S ffff9868e94930c0 0 26 2 0x00000000
Mar 21 10:22:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: ksoftirqd/3 S ffff9868e9494100 0 27 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: kworker/3:0H S ffff9868e94c1040 0 29 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: watchdog/4 S ffff9839694d6180 0 31 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: migration/4 S ffff9839694d5140 0 32 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: ksoftirqd/4 S ffff9839694d4100 0 33 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: kworker/4:0H S ffff9839694d2080 0 35 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: watchdog/5 S ffff9848e9fae180 0 36 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: migration/5 S ffff9848e9fad140 0 37 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: ksoftirqd/5 S ffff9848e9fac100 0 38 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: kworker/5:0H S ffff9848e9fe8000 0 40 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: watchdog/6 S ffff9858e945e180 0 41 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: migration/6 S ffff9858e945d140 0 42 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: ksoftirqd/6 S ffff9858e945c100 0 43 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: kworker/6:0H S ffff9858e9498000 0 45 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: watchdog/7 S ffff9868e94c6180 0 46 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: migration/7 S ffff9868e94c5140 0 47 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: ksoftirqd/7 S ffff9868e94c4100 0 48 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: kworker/7:0H S ffff9868e9508000 0 50 2 0x00000000
Mar 21 10:22:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: watchdog/8 S ffff9839694d1040 0 51 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: migration/8 S ffff983969538000 0 52 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: ksoftirqd/8 S ffff983969539040 0 53 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: kworker/8:0H S ffff98396953b0c0 0 55 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: watchdog/9 S ffff9848e9fee180 0 56 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: migration/9 S ffff9848e9fed140 0 57 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: ksoftirqd/9 S ffff9848e9fec100 0 58 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: kworker/9:0H S ffff9848e9fea080 0 60 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: watchdog/10 S ffff9858e949e180 0 61 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: migration/10 S ffff9858e949d140 0 62 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: ksoftirqd/10 S ffff9858e949c100 0 63 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: kworker/10:0H S ffff9858e949a080 0 65 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: watchdog/11 S ffff9868e950e180 0 66 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85148c40>] ? touch_nmi_watchdog+0x30/0x30
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: migration/11 S ffff9868e950d140 0 67 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: ksoftirqd/11 S ffff9868e950c100 0 68 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: kworker/11:0H S ffff9868e950a080 0 70 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: watchdog/12 S ffff98396953e180 0 71 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: migration/12 S ffff98396953d140 0 72 2 0x00000000
Mar 21 10:22:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: ksoftirqd/12 S ffff98396953c100 0 73 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: kworker/12:0H S ffff9839695b1040 0 75 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: watchdog/13 S ffff9848e9fe9040 0 76 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85148c40>] ? touch_nmi_watchdog+0x30/0x30
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: migration/13 S ffff9848e9850000 0 77 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: ksoftirqd/13 S ffff9848e9851040 0 78 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: kworker/13:0H S ffff9848e98530c0 0 80 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: watchdog/14 S ffff9858e9499040 0 81 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: migration/14 S ffff9858e94d8000 0 82 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: ksoftirqd/14 S ffff9858e94d9040 0 83 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: kworker/14:0H S ffff9858e94db0c0 0 85 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: watchdog/15 S ffff9868e9509040 0 86 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: migration/15 S ffff9868e9550000 0 87 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: ksoftirqd/15 S ffff9868e9551040 0 88 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: kworker/15:0H S ffff9868e95530c0 0 90 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: watchdog/16 S ffff9839695b6180 0 91 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85148c40>] ? touch_nmi_watchdog+0x30/0x30
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: migration/16 S ffff9839695b5140 0 92 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: ksoftirqd/16 S ffff9839695b4100 0 93 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: kworker/16:0H S ffff9839695b2080 0 95 2 0x00000000
Mar 21 10:22:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: watchdog/17 S ffff9848e9856180 0 96 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: migration/17 S ffff9848e9855140 0 97 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: ksoftirqd/17 S ffff9848e9854100 0 98 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: kworker/17:0H S ffff9848e9891040 0 100 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: watchdog/18 S ffff9858e94de180 0 101 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: migration/18 S ffff9858e94dd140 0 102 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: ksoftirqd/18 S ffff9858e94dc100 0 103 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: kworker/18:0H S ffff9858e9531040 0 105 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: watchdog/19 S ffff9868e9556180 0 106 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: migration/19 S ffff9868e9555140 0 107 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff8575bfcb>] ? queued_spin_lock_slowpath+0xb/0xf
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: ksoftirqd/19 S ffff9868e9554100 0 108 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: kworker/19:0H S ffff9868e9581040 0 110 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: watchdog/20 S ffff983969618000 0 111 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: migration/20 S ffff983969619040 0 112 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: ksoftirqd/20 S ffff98396961a080 0 113 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: kworker/20:0H S ffff98396961c100 0 115 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: watchdog/21 S ffff9848e9896180 0 116 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: migration/21 S ffff9848e9895140 0 117 2 0x00000000
Mar 21 10:22:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: ksoftirqd/21 S ffff9848e9894100 0 118 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: kworker/21:0H S ffff9848e9892080 0 120 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: watchdog/22 S ffff9858e9536180 0 121 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85148df0>] ? watchdog_cleanup+0x10/0x10
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: migration/22 S ffff9858e9535140 0 122 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: ksoftirqd/22 S ffff9858e9534100 0 123 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: kworker/22:0H S ffff9858e9532080 0 125 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: watchdog/23 S ffff9868e9586180 0 126 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: migration/23 S ffff9868e9585140 0 127 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: ksoftirqd/23 S ffff9868e9584100 0 128 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: kworker/23:0H S ffff9868e9582080 0 130 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: watchdog/24 S ffff98396961e180 0 131 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: migration/24 S ffff98396961d140 0 132 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: ksoftirqd/24 R running task 0 133 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: kworker/24:0H S ffff983969662080 0 135 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: watchdog/25 S ffff9848e98d0000 0 136 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: migration/25 S ffff9848e98d1040 0 137 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff8576a4dc>] ? _raw_spin_lock_irqsave+0xc/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: ksoftirqd/25 S ffff9848e98d2080 0 138 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: kworker/25:0H S ffff9848e98d4100 0 140 2 0x00000000
Mar 21 10:22:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: watchdog/26 S ffff9858e9570000 0 141 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: migration/26 S ffff9858e9571040 0 142 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: ksoftirqd/26 S ffff9858e9572080 0 143 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: kworker/26:0H S ffff9858e9574100 0 145 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: watchdog/27 S ffff9868e95e8000 0 146 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: migration/27 S ffff9868e95e9040 0 147 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: ksoftirqd/27 S ffff9868e95ea080 0 148 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: kworker/27:0H S ffff9868e95ec100 0 150 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: watchdog/28 S ffff983969666180 0 151 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85148df0>] ? watchdog_cleanup+0x10/0x10
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: migration/28 S ffff983969665140 0 152 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: ksoftirqd/28 S ffff983969664100 0 153 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: kworker/28:0H S ffff9839696b0000 0 155 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: watchdog/29 S ffff9848e98d6180 0 156 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: migration/29 S ffff9848e98d5140 0 157 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: ksoftirqd/29 S ffff9848e9908000 0 158 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: kworker/29:0H S ffff9848e990a080 0 160 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: watchdog/30 S ffff9858e9576180 0 161 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: migration/30 S ffff9858e9575140 0 162 2 0x00000000
Mar 21 10:22:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: ksoftirqd/30 S ffff9858e95a8000 0 163 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: kworker/30:0H S ffff9858e95aa080 0 165 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: watchdog/31 S ffff9868e95ee180 0 166 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: migration/31 S ffff9868e95ed140 0 167 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: ksoftirqd/31 S ffff9868e9620000 0 168 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: kworker/31:0H S ffff9868e9622080 0 170 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: watchdog/32 S ffff9839696b6180 0 171 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85148c40>] ? touch_nmi_watchdog+0x30/0x30
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: migration/32 S ffff9839696b5140 0 172 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: ksoftirqd/32 S ffff9839696b4100 0 173 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: kworker/32:0H S ffff9839696b2080 0 175 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: watchdog/33 S ffff9848e990e180 0 176 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: migration/33 S ffff9848e990d140 0 177 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: ksoftirqd/33 S ffff9848e990c100 0 178 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: kworker/33:0H S ffff9848e9958000 0 180 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: watchdog/34 S ffff9858e95ae180 0 181 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85148c40>] ? touch_nmi_watchdog+0x30/0x30
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: migration/34 S ffff9858e95ad140 0 182 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: ksoftirqd/34 S ffff9858e95ac100 0 183 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: kworker/34:0H S ffff9858e95d8000 0 185 2 0x00000000
Mar 21 10:22:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:22:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: watchdog/35 S ffff9868e9626180 0 186 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: migration/35 S ffff9868e9625140 0 187 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: ksoftirqd/35 S ffff9868e9624100 0 188 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: kworker/35:0 S ffff9868e96230c0 0 189 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: kworker/35:0H S ffff9868e9658000 0 190 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: watchdog/36 S ffff9839696b1040 0 191 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: migration/36 S ffff983969740000 0 192 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff8575bfcb>] ? queued_spin_lock_slowpath+0xb/0xf
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: ksoftirqd/36 S ffff983969741040 0 193 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: kworker/36:0H S ffff9839697430c0 0 195 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: watchdog/37 S ffff9848e995e180 0 196 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: migration/37 S ffff9848e995d140 0 197 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: ksoftirqd/37 S ffff9848e995c100 0 198 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: kworker/37:0H S ffff9848e995a080 0 200 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: watchdog/38 S ffff9858e95de180 0 201 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: migration/38 S ffff9858e95dd140 0 202 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: ksoftirqd/38 S ffff9858e95dc100 0 203 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: kworker/38:0H S ffff9858e95da080 0 205 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: watchdog/39 S ffff9868e965e180 0 206 2 0x00000000
Mar 21 10:23:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: migration/39 S ffff9868e965d140 0 207 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: ksoftirqd/39 S ffff9868e965c100 0 208 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: kworker/39:0H S ffff9868e965a080 0 210 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: watchdog/40 S ffff983969746180 0 211 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: migration/40 S ffff983969745140 0 212 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: ksoftirqd/40 S ffff983969744100 0 213 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: kworker/40:0H S ffff983969781040 0 215 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: watchdog/41 S ffff9848e9959040 0 216 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: migration/41 S ffff9848e99a8000 0 217 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: ksoftirqd/41 S ffff9848e99a9040 0 218 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: kworker/41:0H S ffff9848e99ab0c0 0 220 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: watchdog/42 S ffff9858e95d9040 0 221 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: migration/42 S ffff9858e9640000 0 222 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: ksoftirqd/42 S ffff9858e9641040 0 223 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: kworker/42:0H S ffff9858e96430c0 0 225 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: watchdog/43 S ffff9868e9659040 0 226 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: migration/43 S ffff9868e96c0000 0 227 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff8576a4db>] ? _raw_spin_lock_irqsave+0xb/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: ksoftirqd/43 S ffff9868e96c1040 0 228 2 0x00000000
Mar 21 10:23:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: kworker/43:0H S ffff9868e96c30c0 0 230 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: watchdog/44 S ffff983969786180 0 231 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85148c40>] ? touch_nmi_watchdog+0x30/0x30
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: migration/44 S ffff983969785140 0 232 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: ksoftirqd/44 S ffff983969784100 0 233 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: kworker/44:0H S ffff983969782080 0 235 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: watchdog/45 S ffff9848e99ae180 0 236 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: migration/45 S ffff9848e99ad140 0 237 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: ksoftirqd/45 S ffff9848e99ac100 0 238 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: kworker/45:0H S ffff9848e99d9040 0 240 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: watchdog/46 S ffff9858e9646180 0 241 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: migration/46 S ffff9858e9645140 0 242 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: ksoftirqd/46 S ffff9858e9644100 0 243 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: kworker/46:0H S ffff9858e9671040 0 245 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: watchdog/47 S ffff9868e96c6180 0 246 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: migration/47 S ffff9868e96c5140 0 247 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff8512ff20>] ? cpu_stop_queue_work+0x70/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: ksoftirqd/47 S ffff9868e96c4100 0 248 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca562>] smpboot_thread_fn+0xe2/0x1a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850ca480>] ? lg_double_unlock+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: kworker/47:0H S ffff9868e96f9040 0 250 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:02 fir-io1-s1 kernel: kdevtmpfs S ffff983969064100 0 255 2 0x00000000
Mar 21 10:23:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff854aedbd>] devtmpfsd+0x16d/0x180
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff854aec50>] ? handle_create.isra.2+0x220/0x220
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: netns S ffff983969065140 0 256 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: khungtaskd S ffff983969066180 0 257 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff857657ee>] schedule_timeout_interruptible+0x1e/0x20
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514893c>] watchdog+0x4c/0x2c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff851488f0>] ? reset_hung_task_detector+0x20/0x20
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: writeback S ffff9839690630c0 0 258 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: kintegrityd S ffff983969062080 0 259 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: bioset S ffff983969061040 0 260 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: bioset S ffff983969060000 0 261 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: bioset S ffff98483eff8000 0 262 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: kblockd S ffff98483eff9040 0 263 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: md S ffff98483effa080 0 264 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: edac-poller S ffff98483effb0c0 0 265 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: watchdogd S ffff98483effc100 0 266 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: irq/26-AMD-Vi S ffff9858e9674100 0 269 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b3d0>] ? irq_finalize_oneshot.part.31+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b6f1>] irq_thread+0xd1/0x180
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b470>] ? irq_forced_thread_fn+0x50/0x50
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b620>] ? irq_thread_check_affinity+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: irq/27-AMD-Vi S ffff9858e96730c0 0 270 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b3d0>] ? irq_finalize_oneshot.part.31+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b6f1>] irq_thread+0xd1/0x180
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b470>] ? irq_forced_thread_fn+0x50/0x50
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b620>] ? irq_thread_check_affinity+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: irq/28-AMD-Vi S ffff9858e9672080 0 271 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b3d0>] ? irq_finalize_oneshot.part.31+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b6f1>] irq_thread+0xd1/0x180
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b470>] ? irq_forced_thread_fn+0x50/0x50
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b620>] ? irq_thread_check_affinity+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: irq/29-AMD-Vi S ffff98483effe180 0 272 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b3d0>] ? irq_finalize_oneshot.part.31+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b6f1>] irq_thread+0xd1/0x180
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b470>] ? irq_forced_thread_fn+0x50/0x50
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8514b620>] ? irq_thread_check_affinity+0xf0/0xf0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: kswapd0 D ffff98483c4d30c0 0 277 2 0x00000000
Mar 21 10:23:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc1485a2c>] ? ldiskfs_release_dquot+0x5c/0xa0 [ldiskfs]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc1485a2c>] ldiskfs_release_dquot+0x5c/0xa0 [ldiskfs]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff852ae73d>] dqput+0xbd/0x1f0
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff852afd85>] __dquot_drop+0x55/0x70
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff852afdcd>] dquot_drop+0x2d/0x40
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc148a352>] ldiskfs_clear_inode+0x22/0x90 [ldiskfs]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffffc146df3f>] ldiskfs_evict_inode+0x9f/0x630 [ldiskfs]
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8525ebae>] dispose_list+0x3e/0x50
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff8525fbbc>] prune_icache_sb+0x17c/0x330
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff85243fc3>] prune_super+0x173/0x190
Mar 21 10:23:03 fir-io1-s1 kernel: [<ffffffff851c9da5>] shrink_slab+0x175/0x340
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff852374c1>] ? vmpressure+0x21/0x90
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851cdba1>] balance_pgdat+0x4b1/0x5e0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851cde43>] kswapd+0x173/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851cdcd0>] ? balance_pgdat+0x5e0/0x5e0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kswapd1 S ffff98483c4d4100 0 278 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851d7c77>] ? calculate_normal_threshold+0x27/0x50
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851ce05f>] kswapd+0x38f/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851cdcd0>] ? balance_pgdat+0x5e0/0x5e0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kswapd2 S ffff98483c4d5140 0 279 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851d7c77>] ? calculate_normal_threshold+0x27/0x50
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851ce05f>] kswapd+0x38f/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851cdcd0>] ? balance_pgdat+0x5e0/0x5e0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kswapd3 S ffff98483c4d6180 0 280 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851d7c77>] ? calculate_normal_threshold+0x27/0x50
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851ce05f>] kswapd+0x38f/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff851cdcd0>] ? balance_pgdat+0x5e0/0x5e0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: ksmd S ffff98483c4d0000 0 281 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85216e0a>] ksm_scan_thread+0x16a/0x240
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85216ca0>] ? ksm_do_scan+0x11b0/0x11b0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: khugepaged S ffff98483c588000 0 282 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85229e16>] khugepaged+0x3e6/0x480
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85229a30>] ? khugepaged_scan_mm_slot+0xf00/0xf00
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: crypto S ffff98483c589040 0 283 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kthrotld S ffff98483c5b2080 0 291 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kmpath_rdacd S ffff98683cf71040 0 296 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kaluad S ffff98683cf72080 0 297 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kpsmoused S ffff98483c648000 0 301 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: ipv6_addrconf S ffff98483c649040 0 302 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kworker/33:1 S ffff9848e99dd140 0 306 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: deferwq S ffff98483bc030c0 0 321 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kworker/9:1 S ffff98583c240000 0 323 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: kauditd S ffff98483be89040 0 383 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85130fc4>] kauditd_thread+0x184/0x1e0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85130e40>] ? audit_printk_skb+0x70/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: scsi_eh_0 S ffff98483859c100 0 1956 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff854d61b3>] scsi_error_handler+0xa3/0x8b0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff854d6110>] ? scsi_eh_get_sense+0x250/0x250
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:04 fir-io1-s1 kernel: scsi_tmf_0 S ffff98483859d140 0 1957 2 0x00000000
Mar 21 10:23:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:04 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: scsi_eh_1 S ffff98483a3a9040 0 2430 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff854d61b3>] scsi_error_handler+0xa3/0x8b0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff854d6110>] ? scsi_eh_get_sense+0x250/0x250
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: scsi_tmf_1 S ffff98483a3ab0c0 0 2431 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: ata_sff S ffff985837d14100 0 3532 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: poll_mpt3sas0_h S ffff985836f20000 0 5450 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/13:1 S ffff985836354100 0 7251 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/30:1 S ffff9868344aa080 0 7260 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/43:1 S ffff987835de5140 0 7266 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/47:1 S ffff987835de30c0 0 7269 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: scsi_eh_2 S ffff987835e09040 0 7312 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff854d0098>] ? __scsi_iterate_devices+0x68/0x90
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff854d61b3>] scsi_error_handler+0xa3/0x8b0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff854d6110>] ? scsi_eh_get_sense+0x250/0x250
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: scsi_tmf_2 S ffff987835e0a080 0 7313 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: mlx5_health0000 S ffff9868349f30c0 0 7324 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: mlx5_cmd_0000:8 S ffff986834b69040 0 7339 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: mlx5_page_alloc S ffff986834b6b0c0 0 7355 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/u261:0 S ffff986834b6e180 0 7385 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/u262:0 S ffff9848343b4100 0 7386 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/u263:0 S ffff9848e99dc100 0 7387 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: kworker/u265:0 S ffff9878397be180 0 7389 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: mlx5_fc S ffff986834bc4100 0 7433 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:05 fir-io1-s1 kernel: ib-comp-wq S ffff9868351ed140 0 7446 2 0x00000000
Mar 21 10:23:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: ib-comp-unb-wq S ffff9868351eb0c0 0 7447 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: ib_mcast S ffff9868351ec100 0 7448 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: ib_nl_sa_wq S ffff9868351ea080 0 7449 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: mlx5_ib_sigerr_ S ffff9868351e8000 0 7457 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: ib_mad1 S ffff9868351e9040 0 7462 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: to_fifo S ffff986834bc6180 0 7463 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: mkey_cache S ffff986834bc0000 0 7466 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/19:1H S ffff9878362a6180 0 7786 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/0:1H S ffff9848343b30c0 0 7860 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/8:1H S ffff98483a3aa080 0 8731 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: poll_mpt3sas0_s S ffff9868349f4100 0 10088 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/29:2 S ffff985837590000 0 13924 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/41:2 S ffff985837596180 0 13932 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/27:2 S ffff9878383d8000 0 14442 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/44:1H S ffff984832106180 0 14454 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/40:1H S ffff984832105140 0 14455 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/36:1H S ffff984832104100 0 14456 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:06 fir-io1-s1 kernel: kworker/28:1H S ffff9848321030c0 0 14457 2 0x00000000
Mar 21 10:23:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:06 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: kworker/32:1H S ffff984832102080 0 14458 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: kworker/20:1H S ffff984832099040 0 14459 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: kworker/16:1H S ffff98483209a080 0 14460 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: kworker/12:1H S ffff98483209b0c0 0 14461 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: kworker/4:1H S ffff9848327cc100 0 14462 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: jbd2/sdig2-8 S ffff9848327cb0c0 0 14503 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffffc08ccfc3>] kjournald2+0x203/0x260 [jbd2]
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: ext4-rsv-conver S ffff9848327ca080 0 14504 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: systemd-journal S 000000000000000e 0 14578 1 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85251f4b>] ? filename_lookup+0x2b/0xc0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8528eaa9>] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8525406d>] ? do_filp_open+0x4d/0xb0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766eb3>] ? schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff852616f7>] ? __alloc_fd+0x47/0x170
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8529020d>] ? SyS_epoll_wait+0xed/0x120
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8523f4be>] ? SyS_ftruncate+0xe/0x10
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774ddb>] ? system_call_fastpath+0x22/0x27
Mar 21 10:23:07 fir-io1-s1 kernel: systemd-udevd S ffff985836cc9040 0 14605 1 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8521bf25>] ? kmem_cache_alloc+0x35/0x1f0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8528eaa9>] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85253461>] ? do_unlinkat+0xf1/0x2d0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:07 fir-io1-s1 kernel: kmpathd S ffff987837662080 0 18898 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: kmpath_handlerd S ffff9878376630c0 0 18899 2 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: multipathd S ffff98483c7d0640 0 18936 1 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850be7a0>] ? task_work_run+0xc0/0xe0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:07 fir-io1-s1 kernel: multipathd S ffff9878387ee180 0 18942 1 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:07 fir-io1-s1 kernel: multipathd S ffff9878387eb0c0 0 18943 1 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85256f6f>] ? __pollwait+0x7f/0xf0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85673112>] ? netlink_recvmsg+0x212/0x490
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8537ae91>] ? plist_add+0x91/0xd0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff851656c5>] ? tracing_is_on+0x15/0x30
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850d676b>] ? wake_up_q+0x5b/0x80
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510d525>] ? futex_wake_op+0x4a5/0x610
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8510f9da>] ? do_futex+0x17a/0x5a0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:07 fir-io1-s1 kernel: multipathd S ffff9878387ea080 0 18944 1 0x00000000
Mar 21 10:23:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff851e901e>] ? do_numa_page+0x1be/0x250
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff851e93c6>] ? handle_pte_fault+0x316/0xd10
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff850df600>] ? task_numa_fault+0x8d0/0xbb0
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff851e901e>] ? do_numa_page+0x1be/0x250
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff851e93c6>] ? handle_pte_fault+0x316/0xd10
Mar 21 10:23:07 fir-io1-s1 kernel: [<ffffffff8576f915>] ? do_page_fault+0x35/0x90
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85258bde>] SyS_ppoll+0xee/0x1f0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff987830a8d140 0 44779 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff98483c4d2080 0 44794 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff98483c4d1040 0 44810 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e3e180 0 44816 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e39040 0 44829 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e3a080 0 44842 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e3c100 0 44868 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e38000 0 44882 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e3d140 0 44912 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:08 fir-io1-s1 kernel: multipathd S ffff985821e3b0c0 0 44929 1 0x00000000
Mar 21 10:23:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:08 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff985836af9040 0 44941 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff985836af8000 0 44959 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff985834eeb0c0 0 44973 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff985834ee8000 0 44993 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff985834ee9040 0 45004 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8510cbf8>] ? get_futex_key+0x1c8/0x2c0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff853874a8>] ? lockref_put_or_lock+0x48/0x80
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850be7a0>] ? task_work_run+0xc0/0xe0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff986804659040 0 45268 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff98680465a080 0 45304 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff98680465e180 0 45333 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff98680465d140 0 45365 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff986804658000 0 45446 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff987837666180 0 45530 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:09 fir-io1-s1 kernel: multipathd S ffff98582be2c100 0 45551 1 0x00000000
Mar 21 10:23:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582be2e180 0 45620 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98783b7f1040 0 45727 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff985836991040 0 45822 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff9848327c8000 0 45889 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582d251040 0 45957 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582d250000 0 45965 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582d2530c0 0 46006 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582d256180 0 46027 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582d252080 0 46036 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:10 fir-io1-s1 kernel: multipathd S ffff98582d254100 0 46043 1 0x00000000
Mar 21 10:23:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:10 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff9848327ce180 0 46049 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff9848327cd140 0 46055 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff985836afd140 0 46063 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff985836afe180 0 46072 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff985837b06180 0 46091 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff985837b02080 0 46098 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff985837b030c0 0 46105 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff985837b04100 0 46123 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff98482071d140 0 46127 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:11 fir-io1-s1 kernel: multipathd S ffff98482071e180 0 46162 1 0x00000000
Mar 21 10:23:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:11 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff98482071b0c0 0 46180 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff98482071c100 0 46249 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff986816f7c100 0 46303 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff9858376a9040 0 46413 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff9858376ab0c0 0 46570 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff9858376ac100 0 47718 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff9858376ad140 0 47916 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff986816f7e180 0 48189 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff98581cb64100 0 49189 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff98582d352080 0 51605 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:12 fir-io1-s1 kernel: multipathd S ffff98581abba080 0 52061 1 0x00000000
Mar 21 10:23:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:12 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff986836d09040 0 52962 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff985835cbd140 0 53542 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff9858375930c0 0 54003 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff985836eae180 0 54336 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff985836ea9040 0 54556 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff985836ccb0c0 0 54855 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff985836ccc100 0 54976 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff9848342ab0c0 0 55101 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff9848342aa080 0 55261 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:13 fir-io1-s1 kernel: multipathd S ffff98583829e180 0 55391 1 0x00000000
Mar 21 10:23:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:13 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff985838299040 0 55520 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff9848345d4100 0 55860 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff984832781040 0 56039 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98581cb61040 0 56305 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98581af64100 0 56517 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98580ef8c100 0 56841 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98580ef8d140 0 57027 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98580ef8e180 0 57091 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98580ef8b0c0 0 57224 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98580ef8a080 0 57301 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:14 fir-io1-s1 kernel: multipathd S ffff98580ef89040 0 57346 1 0x00000000
Mar 21 10:23:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98783b7f2080 0 57436 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98783b7f6180 0 57478 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98783b7f4100 0 57503 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98783b7f0000 0 57574 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98783b7f5140 0 57612 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98783b7f30c0 0 57679 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98583962e180 0 57832 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98583962c100 0 57885 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff98583962a080 0 57916 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:15 fir-io1-s1 kernel: multipathd S ffff985839628000 0 57951 1 0x00000000
Mar 21 10:23:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:15 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98783bf15140 0 58058 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98783bf16180 0 58071 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98783bf130c0 0 58152 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98580be14100 0 58248 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98580be15140 0 58290 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98580be16180 0 58317 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98783b3ca080 0 58340 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98783b3cc100 0 58363 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98783b3ce180 0 58403 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff98481e2b0000 0 58441 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:16 fir-io1-s1 kernel: multipathd S ffff985808f11040 0 58477 1 0x00000000
Mar 21 10:23:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff985808f130c0 0 58500 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff985808f14100 0 58530 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff985808f16180 0 58560 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff98580cba0000 0 58592 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85260acc>] ? fget_light+0x2c/0xe0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff98580cba1040 0 58633 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff98580cba2080 0 58687 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff98580cba30c0 0 58715 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff98580cba5140 0 58738 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff98580cba6180 0 58773 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:17 fir-io1-s1 kernel: multipathd S ffff985814ed0000 0 58796 1 0x00000000
Mar 21 10:23:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:17 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff985814ed2080 0 58838 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af86b>] ? __set_current_blocked+0x5b/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff985814ed4100 0 58861 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff985814ed5140 0 58883 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff985814ed6180 0 58912 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff98481e2cc100 0 59044 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff98481e2cb0c0 0 59131 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff98481e2c9040 0 59281 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff98481e2ca080 0 59317 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff985808f15140 0 59383 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:18 fir-io1-s1 kernel: multipathd S ffff98481e2ce180 0 59509 1 0x00000000
Mar 21 10:23:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:18 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff985810fe4100 0 59906 1 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff985810fe0000 0 59965 1 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff985810fe6180 0 60631 1 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff98580df0d140 0 61785 1 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff98580df09040 0 62000 1 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff98580df0c100 0 62147 1 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850afb14>] ? SyS_rt_sigprocmask+0xc4/0x100
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: multipathd S ffff984b09bd2080 0 16320 1 0x00000080
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc047f4e1>] dm_wait_event+0xa1/0xf0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485980>] dev_wait+0x50/0xd0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc04860fe>] ctl_ioctl+0x24e/0x550 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc0485930>] ? table_deps+0x1a0/0x1a0 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffffc048640e>] dm_ctl_ioctl+0xe/0x20 [dm_mod]
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256480>] do_vfs_ioctl+0x3a0/0x5a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850ace21>] ? __set_task_blocked+0x41/0xa0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850af852>] ? __set_current_blocked+0x42/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85256721>] SyS_ioctl+0xa1/0xc0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:19 fir-io1-s1 kernel: kworker/18:1H S ffff9868181f2080 0 22148 2 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: kworker/21:1H S ffff98582e3b0000 0 24048 2 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: kworker/13:1H S ffff98582e3b1040 0 24100 2 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: kworker/15:1H S ffff987838305140 0 24101 2 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: kworker/14:1H S ffff98683b39c100 0 24102 2 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:19 fir-io1-s1 kernel: kworker/10:1H S ffff98683b39b0c0 0 24169 2 0x00000000
Mar 21 10:23:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:19 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/43:1H S ffff987839fad140 0 26975 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/45:1H S ffff985835cb8000 0 26976 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/47:1H S ffff987839faa080 0 26977 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/42:1H S ffff986816c630c0 0 26979 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/41:1H S ffff985835cbe180 0 26980 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/39:1H S ffff987839fab0c0 0 27003 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/37:1H S ffff985835cbb0c0 0 27004 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/31:1H S ffff987839fac100 0 27053 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/33:1H S ffff985836f26180 0 27054 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/30:1H S ffff9868348a9040 0 27055 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/35:1H S ffff987839fa8000 0 27056 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/34:1H S ffff9868348ad140 0 27057 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/27:1H S ffff987839fa9040 0 27102 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/23:1H S ffff9878383a2080 0 27134 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/25:1H S ffff985836aca080 0 27135 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/26:1H S ffff9868348ac100 0 27136 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:20 fir-io1-s1 kernel: kworker/24:1H S ffff984833ddc100 0 27137 2 0x00000000
Mar 21 10:23:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:20 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: kworker/22:1H S ffff9868348a8000 0 27138 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: kworker/17:1H S ffff985837b01040 0 27178 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: kworker/11:1H S ffff987839e6a080 0 27207 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: kworker/3:1H S ffff987839e69040 0 27272 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: kworker/2:1H R running task 0 30077 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-1-q2 S ffff9878370d9040 0 33810 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-1-q3 S ffff9878370d8000 0 33811 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-1-q4 S ffff9848325530c0 0 33812 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-2-q0 S ffff98783b721040 0 33903 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-2-q1 S ffff984838746180 0 33904 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-2-q2 S ffff98783ba4d140 0 33905 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-2-q3 S ffff987839e6e180 0 33906 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-2-q4 S ffff987839e6c100 0 33907 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-3-q2 S ffff984832550000 0 33994 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-3-q3 S ffff984832551040 0 33995 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: ccp-3-q4 S ffff984832552080 0 33996 2 0x00000000
Mar 21 10:23:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-4-q0 S ffff9848341ec100 0 34109 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-4-q1 S ffff9848341ee180 0 34110 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-4-q2 S ffff984830ace180 0 34111 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-4-q3 S ffff984830aca080 0 34112 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-4-q4 S ffff984830ac8000 0 34113 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-5-q2 S ffff984836b24100 0 34227 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-5-q3 S ffff984836b22080 0 34228 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-5-q4 S ffff984836b26180 0 34230 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-6-q0 S ffff986837094100 0 34334 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-6-q1 S ffff986837095140 0 34335 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-6-q2 S ffff984832518000 0 34336 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-6-q3 S ffff98483251d140 0 34337 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-6-q4 S ffff984832519040 0 34338 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-7-q2 S ffff98483251e180 0 34430 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-7-q3 S ffff985836350000 0 34432 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-7-q4 S ffff9858363530c0 0 34433 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:22 fir-io1-s1 kernel: ccp-8-q0 S ffff984832052080 0 34600 2 0x00000000
Mar 21 10:23:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:22 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: ccp-8-q1 S ffff984832051040 0 34601 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: ccp-8-q2 S ffff984832050000 0 34602 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: ccp-8-q3 S ffff9848320530c0 0 34603 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: ccp-8-q4 S ffff98483273e180 0 34604 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e86e4>] ccp_cmd_queue_thread+0x94/0x2b0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8380>] ? ccp_do_cmd_backlog+0xd0/0xd0 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffffc02e8650>] ? ccp_unregister_rng+0x30/0x30 [ccp]
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kvm-irqfd-clean S ffff986816f79040 0 35293 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kworker/37:147 S ffff98581c324100 0 42233 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmflush S ffff98581fa930c0 0 42250 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: bioset S ffff98581fa92080 0 42261 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmwork-253:0 S ffff9868344ab0c0 0 42262 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmflush S ffff98483c58d140 0 42280 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: bioset S ffff98483c58c100 0 42281 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmwork-253:1 S ffff98583bf7d140 0 42282 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmflush S ffff98583bf7a080 0 42301 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: bioset S ffff98583bf78000 0 42302 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmwork-253:2 S ffff98583bf7b0c0 0 42303 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmflush S ffff985835cbc100 0 42378 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: bioset S ffff98581c2e5140 0 42386 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:23 fir-io1-s1 kernel: kdmwork-253:3 S ffff98581c2e30c0 0 42388 2 0x00000000
Mar 21 10:23:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff98582e3b2080 0 42467 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff98582e3b5140 0 42470 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmwork-253:4 S ffff98582e3b30c0 0 42472 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff98582e3b6180 0 42527 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff98582e3b4100 0 42528 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmwork-253:5 S ffff985837d11040 0 42529 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff98582ce55140 0 42619 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff985836acd140 0 42624 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmwork-253:6 S ffff985836ac8000 0 42626 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff985836ac9040 0 42849 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff984832055140 0 42854 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmwork-253:7 S ffff984832098000 0 42855 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff9848e99db0c0 0 43409 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff985837d130c0 0 43417 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmwork-253:8 S ffff985837d12080 0 43419 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff98582d356180 0 43668 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff98582d354100 0 43675 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmwork-253:9 S ffff98582d355140 0 43676 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: kdmflush S ffff985836afa080 0 43816 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:24 fir-io1-s1 kernel: bioset S ffff985836afb0c0 0 43820 2 0x00000000
Mar 21 10:23:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmwork-253:10 S ffff985836afc100 0 43868 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmflush S ffff985836990000 0 44146 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: bioset S ffff985836995140 0 44151 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmwork-253:11 S ffff98582be29040 0 44152 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmflush S ffff98582d351040 0 44392 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: bioset S ffff9878370c0000 0 44415 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmwork-253:12 S ffff9878370c5140 0 44417 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmflush S ffff987831354100 0 45262 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: bioset S ffff9878313530c0 0 45264 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmwork-253:13 S ffff987831355140 0 45266 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kworker/5:1H S ffff98583a7d1040 0 45269 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmflush S ffff986836d0e180 0 45301 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: bioset S ffff98583a7d0000 0 45302 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmwork-253:14 S ffff98583a7d4100 0 45303 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmflush S ffff986812381040 0 45330 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: bioset S ffff9868123830c0 0 45331 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmwork-253:15 S ffff986812386180 0 45332 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: kdmflush S ffff986812382080 0 45359 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:25 fir-io1-s1 kernel: bioset S ffff9868382f8000 0 45360 2 0x00000000
Mar 21 10:23:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:16 S ffff9868382fc100 0 45361 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmflush S ffff9868382fb0c0 0 45441 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: bioset S ffff9868382f9040 0 45443 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:17 S ffff9868382fa080 0 45444 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmflush S ffff98787fc85780 0 45523 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: bioset S ffff98583bf79040 0 45524 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:18 S ffff98683b398000 0 45527 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmflush S ffff98683b39a080 0 45547 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: bioset S ffff98683b39d140 0 45548 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:19 S ffff9868349f0000 0 45550 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmflush S ffff9868349f5140 0 45613 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: bioset S ffff9868349f6180 0 45614 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:20 S ffff986834bfd140 0 45615 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmflush S ffff9858365e2080 0 45711 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: bioset S ffff986834bfe180 0 45722 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:21 S ffff986834bfa080 0 45723 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmflush S ffff986834bfc100 0 45815 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: bioset S ffff9868348ab0c0 0 45817 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: kdmwork-253:22 S ffff9868348aa080 0 45818 2 0x00000000
Mar 21 10:23:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff98483bcb7080 0 45881 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff98782332b0c0 0 45885 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmwork-253:23 S ffff98683a331040 0 45886 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff98483163e180 0 45951 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff98481e2b2080 0 45953 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmwork-253:24 S ffff98481e2b6180 0 45954 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff9868043e5140 0 45962 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff9868043e4100 0 45963 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmwork-253:25 S ffff9868043e0000 0 45964 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff9878397bd140 0 46000 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff987823a95140 0 46002 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmwork-253:26 S ffff9868043e30c0 0 46003 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff9848387a1040 0 46024 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff9848387a0000 0 46025 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmwork-253:27 S ffff984835a8c100 0 46026 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff987839e6b0c0 0 46033 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff98483effd140 0 46034 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmwork-253:28 S ffff98483251c100 0 46035 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: kdmflush S ffff98483131d140 0 46040 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:27 fir-io1-s1 kernel: bioset S ffff98483131a080 0 46041 2 0x00000000
Mar 21 10:23:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:27 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:29 S ffff98483131e180 0 46042 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmflush S ffff984831318000 0 46046 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: bioset S ffff987823a930c0 0 46047 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:30 S ffff987823a94100 0 46048 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmflush S ffff987823a91040 0 46052 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: bioset S ffff987823a90000 0 46053 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:31 S ffff9868382fd140 0 46054 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmflush S ffff98481e730000 0 46059 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: bioset S ffff98481e7330c0 0 46061 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:32 S ffff98481e734100 0 46062 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmflush S ffff98481e735140 0 46067 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: bioset S ffff98482fa72080 0 46070 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:33 S ffff98482fa74100 0 46071 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmflush S ffff98482fa730c0 0 46085 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: bioset S ffff98482fa71040 0 46087 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:34 S ffff98482fa75140 0 46090 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmflush S ffff98683ab80000 0 46093 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: bioset S ffff98683ab81040 0 46094 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: kdmwork-253:35 S ffff98683ab82080 0 46095 2 0x00000000
Mar 21 10:23:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff98683ab830c0 0 46102 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff98683ab84100 0 46103 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmwork-253:36 S ffff98683ab85140 0 46104 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff9868137c1040 0 46118 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff9868137c4100 0 46119 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmwork-253:37 S ffff9868137c30c0 0 46120 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff9868374b4100 0 46124 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff9868374b1040 0 46125 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmwork-253:38 S ffff9868374b30c0 0 46126 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff9868374b5140 0 46151 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff9868374b6180 0 46155 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmwork-253:39 S ffff9868374b2080 0 46156 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff9878370c2080 0 46176 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff9868e96fb0c0 0 46177 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmwork-253:40 S ffff9868e96fa080 0 46178 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff986803e69040 0 46220 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff98583ba1f6c0 0 46231 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmwork-253:41 S ffff986803e6b0c0 0 46234 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: kdmflush S ffff986803e6c100 0 46265 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:29 fir-io1-s1 kernel: bioset S ffff986803e6d140 0 46281 2 0x00000000
Mar 21 10:23:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:29 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmwork-253:42 S ffff986803e6e180 0 46282 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kworker/1:1H S ffff98582be28000 0 46295 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmflush S ffff98581da9c100 0 46347 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: bioset S ffff98581da9b0c0 0 46358 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmwork-253:43 S ffff98581da98000 0 46376 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmflush S ffff986836d0d140 0 46536 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: bioset S ffff986836d0c100 0 46537 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmwork-253:44 S ffff986836d0b0c0 0 46540 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmflush S ffff9878232c2080 0 47682 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: bioset S ffff987822e18000 0 47687 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmwork-253:45 S ffff987822e1c100 0 47688 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmflush S ffff987822f94100 0 47903 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: bioset S ffff987822f930c0 0 47910 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmwork-253:46 S ffff987822f95140 0 47911 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmflush S ffff987822f91040 0 48171 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: bioset S ffff987822f96180 0 48174 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmwork-253:47 S ffff98582be2a080 0 48175 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: kdmflush S ffff986837096180 0 49180 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: bioset S ffff98680465c100 0 49181 2 0x00000000
Mar 21 10:23:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmwork-253:48 S ffff984834771040 0 49182 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kworker/7:1H S ffff987827634100 0 49467 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmflush S ffff98483bc92bc0 0 51521 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: bioset S ffff9858369930c0 0 51525 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmwork-253:49 S ffff985837d10000 0 51526 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmflush S ffff985837d16180 0 52017 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: bioset S ffff98783edb5140 0 52032 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmwork-253:50 S ffff984832556180 0 52033 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kworker/46:1H S ffff98683a3330c0 0 52920 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmflush S ffff98683a335140 0 52921 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: bioset S ffff98483273a080 0 52960 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmwork-253:51 S ffff984832738000 0 52961 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kworker/29:1H S ffff98582ce56180 0 53076 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmflush S ffff985836ead140 0 53441 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: bioset S ffff985836eaa080 0 53444 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmwork-253:52 S ffff985836ea8000 0 53445 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmflush S ffff9878383a5140 0 53990 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: bioset S ffff9878383a6180 0 53991 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: kdmwork-253:53 S ffff987822e1a080 0 53992 2 0x00000000
Mar 21 10:23:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff984822fe9040 0 54323 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: bioset S ffff984822fee180 0 54328 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmwork-253:54 S ffff987822e1d140 0 54329 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff98683cb030c0 0 54537 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: bioset S ffff98683cb02080 0 54538 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmwork-253:55 S ffff98683cb06180 0 54539 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kworker/6:1H S ffff9868143bc100 0 54820 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff9868143b9040 0 54851 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: bioset S ffff9868143ba080 0 54852 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmwork-253:56 S ffff98582d255140 0 54853 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff98782e238000 0 54965 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: bioset S ffff9868370930c0 0 54969 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmwork-253:57 S ffff986837092080 0 54970 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff985836351040 0 55061 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: bioset S ffff985836352080 0 55072 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmwork-253:58 S ffff98582eee4100 0 55073 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff98582eee6180 0 55244 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: bioset S ffff98583b895dc0 0 55255 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmwork-253:59 S ffff98683a330000 0 55256 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:32 fir-io1-s1 kernel: kdmflush S ffff986801e3c100 0 55376 2 0x00000000
Mar 21 10:23:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff986801e38000 0 55377 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmwork-253:60 S ffff986801e3e180 0 55378 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmflush S ffff98683bbb5140 0 55516 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff98683a336180 0 55518 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmwork-253:61 S ffff985835c72080 0 55519 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmflush S ffff98683ab86180 0 55857 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff98583bf7e180 0 55858 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmwork-253:62 S ffff985835cba080 0 55859 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmflush S ffff985834eee180 0 56015 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff985834eea080 0 56016 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmwork-253:63 S ffff985834eed140 0 56017 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmflush S ffff98581abbc100 0 56277 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff98581abbe180 0 56282 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmwork-253:64 S ffff98581abb9040 0 56283 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmflush S ffff98783edb4100 0 56470 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff98782fae6180 0 56488 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmwork-253:65 S ffff98782fae2080 0 56489 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: kdmflush S ffff984834776180 0 56762 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:33 fir-io1-s1 kernel: bioset S ffff9848347730c0 0 56765 2 0x00000000
Mar 21 10:23:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:66 S ffff984834772080 0 56766 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff98783c22be80 0 57021 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: bioset S ffff9858365e0000 0 57022 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:67 S ffff985835cb9040 0 57024 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff9868175c6180 0 57085 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: bioset S ffff98483c7d0640 0 57088 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:68 S ffff9868175c4100 0 57089 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff98581af630c0 0 57215 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: bioset S ffff98782fae0000 0 57218 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:69 S ffff98782fae1040 0 57219 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff98481e736180 0 57290 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: bioset S ffff98581af66180 0 57299 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:70 S ffff98581af62080 0 57300 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff987827636180 0 57333 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: bioset S ffff9868175c5140 0 57335 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:71 S ffff985837d15140 0 57336 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff986813bee180 0 57421 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: bioset S ffff987827630000 0 57422 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmwork-253:72 S ffff9878276330c0 0 57424 2 0x00000000
Mar 21 10:23:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:34 fir-io1-s1 kernel: kdmflush S ffff98581af65140 0 57471 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff9848327c9040 0 57474 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmwork-253:73 S ffff987823a96180 0 57475 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmflush S ffff987823a92080 0 57497 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff9878370c1040 0 57498 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmwork-253:74 S ffff98783936e180 0 57500 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmflush S ffff98581c2e0000 0 57565 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff98581c2e4100 0 57566 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmwork-253:75 S ffff98581c2e2080 0 57567 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmflush S ffff9878387e8000 0 57597 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff9878387ed140 0 57599 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmwork-253:76 S ffff9878387e9040 0 57600 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmflush S ffff9878387ec100 0 57665 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff98581c2e1040 0 57668 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmwork-253:77 S ffff98581c2e6180 0 57669 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmflush S ffff984832101040 0 57823 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff985836acb0c0 0 57825 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmwork-253:78 S ffff985836acc100 0 57826 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: kdmflush S ffff985836ace180 0 57870 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:35 fir-io1-s1 kernel: bioset S ffff98582ce530c0 0 57872 2 0x00000000
Mar 21 10:23:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmwork-253:79 S ffff98582ce54100 0 57874 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmflush S ffff98582ce52080 0 57911 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: bioset S ffff98582ce50000 0 57913 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmwork-253:80 S ffff98582ce51040 0 57914 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmflush S ffff98582d3530c0 0 57934 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: bioset S ffff98582d350000 0 57936 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmwork-253:81 S ffff98582be2b0c0 0 57937 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmflush S ffff98482fa76180 0 58050 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: bioset S ffff98583829b0c0 0 58051 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmwork-253:82 S ffff985838298000 0 58053 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmflush S ffff98583829a080 0 58066 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: bioset S ffff98583829c100 0 58067 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmwork-253:83 S ffff98782e23c100 0 58069 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmflush S ffff98782e239040 0 58148 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: bioset S ffff98782e23a080 0 58149 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmwork-253:84 S ffff98483251a080 0 58150 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kworker/9:1H S ffff98580be10000 0 58160 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: kdmflush S ffff98580be11040 0 58240 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: bioset S ffff98580be12080 0 58242 2 0x00000000
Mar 21 10:23:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:85 S ffff98580be130c0 0 58243 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff98481e2b1040 0 58274 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: bioset S ffff98481e2b30c0 0 58276 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:86 S ffff98481e2b4100 0 58277 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff98483273c100 0 58311 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: bioset S ffff985837591040 0 58313 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:87 S ffff98582eee5140 0 58314 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff9878370de180 0 58334 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: bioset S ffff9878370dd140 0 58337 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:88 S ffff9878370da080 0 58338 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff9878370db0c0 0 58358 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: bioset S ffff9878370dc100 0 58360 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:89 S ffff985807610000 0 58361 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff985807611040 0 58398 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: bioset S ffff985807612080 0 58401 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:90 S ffff9858076130c0 0 58402 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff987835e56180 0 58431 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: bioset S ffff987835e51040 0 58434 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmwork-253:91 S ffff987835e50000 0 58436 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:37 fir-io1-s1 kernel: kdmflush S ffff985807616180 0 58466 2 0x00000000
Mar 21 10:23:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:37 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff985807614100 0 58473 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmwork-253:92 S ffff98581af60000 0 58474 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmflush S ffff98580bbd8000 0 58490 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff98580bbd9040 0 58495 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmwork-253:93 S ffff98580bbda080 0 58496 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmflush S ffff98580bbdb0c0 0 58518 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff98580bbdd140 0 58524 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmwork-253:94 S ffff98580bbde180 0 58525 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmflush S ffff98580a7ec100 0 58555 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff98580a7ed140 0 58558 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmwork-253:95 S ffff98580a7ee180 0 58559 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmflush S ffff98580a7e8000 0 58586 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff98582be2d140 0 58587 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmwork-253:96 S ffff98580d738000 0 58588 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmflush S ffff987835eb2080 0 58627 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff98683c91c4c0 0 58628 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmwork-253:97 S ffff987835eb1040 0 58630 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: kdmflush S ffff987835eb0000 0 58679 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: bioset S ffff987835eb4100 0 58680 2 0x00000000
Mar 21 10:23:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:98 S ffff985811250000 0 58681 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff986813be8000 0 58706 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: bioset S ffff98580d739040 0 58711 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:99 S ffff98580d73a080 0 58712 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff98581cb60000 0 58735 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: bioset S ffff98581cb66180 0 58736 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:100 S ffff98581cb630c0 0 58737 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff98581cb62080 0 58770 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: bioset S ffff985810e10000 0 58771 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:101 S ffff985810e11040 0 58772 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff985810e12080 0 58790 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: bioset S ffff985810e130c0 0 58791 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:102 S ffff985810e14100 0 58792 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff98580d73c100 0 58833 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: bioset S ffff98580d73d140 0 58835 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:103 S ffff98580d73e180 0 58836 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff985815b38000 0 58854 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: bioset S ffff985815b39040 0 58855 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmwork-253:104 S ffff985815b3a080 0 58856 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:39 fir-io1-s1 kernel: kdmflush S ffff985810e16180 0 58879 2 0x00000000
Mar 21 10:23:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:39 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff98783cace180 0 58880 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmwork-253:105 S ffff9878397ba080 0 58881 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmflush S ffff985836eab0c0 0 58908 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff985836eac100 0 58909 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmwork-253:106 S ffff985816698000 0 58910 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmflush S ffff98581669b0c0 0 59038 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff98581669a080 0 59039 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmwork-253:107 S ffff985816699040 0 59040 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmflush S ffff985815b3e180 0 59127 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff98580d73b0c0 0 59128 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmwork-253:108 S ffff98581da9e180 0 59129 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmflush S ffff98581da99040 0 59274 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff98581da9a080 0 59276 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmwork-253:109 S ffff986803e68000 0 59277 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmflush S ffff985811255140 0 59314 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff98583a7d2080 0 59315 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmwork-253:110 S ffff98583a7d5140 0 59316 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: kdmflush S ffff98583a7d6180 0 59374 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: bioset S ffff985838b66180 0 59375 2 0x00000000
Mar 21 10:23:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:111 S ffff985838b65140 0 59376 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff985838b630c0 0 59502 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: bioset S ffff985838b62080 0 59503 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:112 S ffff98580eb66180 0 59504 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff98580eb60000 0 59896 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: bioset S ffff98580eb64100 0 59897 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:113 S ffff985809b130c0 0 59898 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff985809b11040 0 59958 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: bioset S ffff98680477d140 0 59960 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:114 S ffff98680477c100 0 59961 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff985811f6e180 0 60627 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: bioset S ffff985811f6b0c0 0 60628 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:115 S ffff985811f6c100 0 60629 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff98581030a080 0 61780 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: bioset S ffff98581030d140 0 61781 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:116 S ffff98581030c100 0 61782 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff98583c246180 0 61997 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: bioset S ffff98483b59d780 0 61998 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmwork-253:117 S ffff98583c245140 0 61999 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:41 fir-io1-s1 kernel: kdmflush S ffff98580a7eb0c0 0 62140 2 0x00000000
Mar 21 10:23:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:41 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: bioset S ffff98580df0a080 0 62141 2 0x00000000
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: kdmwork-253:118 S ffff98580df0e180 0 62142 2 0x00000000
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: auditd S ffff985836809040 0 71259 1 0x00000000
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85242154>] ? SyS_write+0xa4/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: auditd S ffff987830a89040 0 71260 1 0x00000000
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffffc08cde52>] ? jbd2_complete_transaction+0x52/0xa0 [jbd2]
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85275ef8>] ? do_fsync+0x78/0xb0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: rpciod S ffff9858376aa080 0 71263 2 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: xprtiod S ffff9858376ae180 0 71264 2 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:42 fir-io1-s1 kernel: sssd S ffff986835eb9040 0 71291 1 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850deb3b>] ? should_numa_migrate_memory+0x5b/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: smartd S ffff986835ebc100 0 71292 1 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: polkitd S ffff985838b64100 0 71293 1 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8502a621>] ? __switch_to+0x151/0x580
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850d300f>] ? ttwu_do_activate+0x6f/0x80
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8528b38e>] ? inotify_free_event+0xe/0x10
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8521beb6>] ? kfree+0x106/0x140
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85394d0d>] ? list_del+0xd/0x30
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8528bb1f>] ? inotify_read+0x2ef/0x420
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85292547>] ? eventfd_ctx_read+0x67/0x1e0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85138da6>] ? __audit_syscall_exit+0x1e6/0x280
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: gmain S ffff9848307b2080 0 71321 1 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff851e444a>] ? __do_fault.isra.59+0x8a/0x100
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8537c942>] ? radix_tree_lookup_slot+0x22/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff851b5cbe>] ? __find_get_page+0x1e/0xa0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff851b8e8e>] ? filemap_fault+0x17e/0x490
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff851e4ae9>] ? do_read_fault.isra.61+0x139/0x1b0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff851e93a4>] ? handle_pte_fault+0x2f4/0xd10
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85292547>] ? eventfd_ctx_read+0x67/0x1e0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85138da6>] ? __audit_syscall_exit+0x1e6/0x280
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: gdbus S ffff98583680e180 0 71327 1 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff856193a6>] ? sock_sendmsg+0xb6/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff856194f5>] ? sock_recvmsg+0xc5/0x100
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8561a269>] ? ___sys_sendmsg+0x3e9/0x400
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85257053>] ? pollwake+0x73/0x90
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85292547>] ? eventfd_ctx_read+0x67/0x1e0
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff8561b955>] ? __sys_sendmsg+0x85/0x90
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85138da6>] ? __audit_syscall_exit+0x1e6/0x280
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:42 fir-io1-s1 kernel: polkitd S ffff98583680b0c0 0 71330 1 0x00000080
Mar 21 10:23:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff851c06a2>] ? get_page_from_freelist+0x412/0xa70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:42 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850db738>] ? __enqueue_entity+0x78/0x80
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851c0e76>] ? __alloc_pages_nodemask+0x176/0x420
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85061dee>] ? physflat_send_IPI_mask+0xe/0x10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d676b>] ? wake_up_q+0x5b/0x80
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cd80>] ? futex_wake+0x90/0x180
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85292547>] ? eventfd_ctx_read+0x67/0x1e0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85138da6>] ? __audit_syscall_exit+0x1e6/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: JS GC Helper S ffff98583680c100 0 71332 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851e93a4>] ? handle_pte_fault+0x2f4/0xd10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: JS Sour~ Thread S ffff9848387a2080 0 71333 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851c5afe>] ? lru_cache_add+0xe/0x10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851f7078>] ? page_add_new_anon_rmap+0xb8/0x170
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cbf8>] ? get_futex_key+0x1c8/0x2c0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8531ac74>] ? yama_task_prctl+0x24/0x110
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8537fbc2>] ? strlcpy+0x42/0x60
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: polkitd S ffff9848387a6180 0 71336 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851c0e76>] ? __alloc_pages_nodemask+0x176/0x420
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85061dee>] ? physflat_send_IPI_mask+0xe/0x10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d676b>] ? wake_up_q+0x5b/0x80
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cd80>] ? futex_wake+0x90/0x180
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85292547>] ? eventfd_ctx_read+0x67/0x1e0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85138da6>] ? __audit_syscall_exit+0x1e6/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: rpcbind S ffff98583680a080 0 71298 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d9f75>] ? local_clock+0x25/0x30
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8519e75c>] ? calc_timer_values+0x1c/0x90
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85102138>] ? ktime_get_mono_fast_ns+0x48/0x90
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851493ca>] ? watchdog_overflow_callback+0x3a/0x140
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851a1297>] ? __perf_event_overflow+0x57/0x100
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851aa904>] ? perf_event_overflow+0x14/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85258a54>] SyS_poll+0x74/0x110
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: irqbalance S ffff98683bbb1040 0 71310 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: gssproxy S ffff984820a72080 0 71312 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850bdf7e>] ? alloc_pid+0x2e/0x4a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850db738>] ? __enqueue_entity+0x78/0x80
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8524b463>] ? alloc_pipe_info+0xe3/0x170
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8528f5d0>] ? SyS_epoll_ctl+0x130/0xc80
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: gssproxy S ffff9867f5bc30c0 0 71322 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851e924c>] ? handle_pte_fault+0x19c/0xd10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: gssproxy S ffff9867f5bc2080 0 71323 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff851e93a4>] ? handle_pte_fault+0x2f4/0xd10
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e53df>] ? idle_balance+0x7f/0x250
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: gssproxy S ffff9867f5bc0000 0 71324 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e53df>] ? idle_balance+0x7f/0x250
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8509e04b>] ? do_exit+0x6bb/0xa40
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: gssproxy S ffff9867f5bc4100 0 71325 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e53df>] ? idle_balance+0x7f/0x250
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8509e04b>] ? do_exit+0x6bb/0xa40
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: gssproxy S ffff9867f5bc5140 0 71326 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850e53df>] ? idle_balance+0x7f/0x250
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8509e04b>] ? do_exit+0x6bb/0xa40
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: dbus-daemon S ffff98683bbb6180 0 71315 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8528eaa9>] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:43 fir-io1-s1 kernel: mdadm S ffff98783238b0c0 0 71319 1 0x00000080
Mar 21 10:23:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:43 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85257c11>] do_select+0x6d1/0x7c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff851d82c8>] ? zone_statistics+0x88/0xa0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff851c0e76>] ? __alloc_pages_nodemask+0x176/0x420
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8525c6aa>] ? __d_lookup+0x7a/0x160
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8521c74c>] ? kmem_cache_alloc_trace+0x3c/0x200
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8531da23>] ? ima_get_action+0x23/0x30
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8531cf3e>] ? process_measurement+0x8e/0x250
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff853812cb>] ? string.isra.7+0x3b/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff853829e1>] ? vsnprintf+0x201/0x6a0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85257eff>] core_sys_select+0x1ff/0x340
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8525f2eb>] ? iput+0x3b/0x190
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85281671>] ? __blkdev_put+0x141/0x1a0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8525810a>] SyS_select+0xca/0x120
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:44 fir-io1-s1 kernel: chronyd S ffff985811254100 0 71329 1 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85257c11>] do_select+0x6d1/0x7c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8510cf45>] ? futex_wait_queue_me+0xd5/0x130
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8523e2aa>] ? __check_object_size+0x1ca/0x250
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85257eff>] core_sys_select+0x1ff/0x340
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85259175>] ? __d_free+0x35/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85259660>] ? d_free+0x60/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85259c28>] ? __dentry_kill+0x128/0x180
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8525810a>] SyS_select+0xca/0x120
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:44 fir-io1-s1 kernel: sssd_be S ffff98580eb61040 0 71340 71291 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:44 fir-io1-s1 kernel: sssd_nss S ffff984820a730c0 0 71356 71291 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:44 fir-io1-s1 kernel: sssd_pam S ffff984820a76180 0 71357 71291 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:44 fir-io1-s1 kernel: systemd-logind S ffff986804779040 0 71372 1 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8528eaa9>] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8528f6ed>] ? SyS_epoll_ctl+0x24d/0xc80
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:44 fir-io1-s1 kernel: mlx4 S ffff9868175c2080 0 71480 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: mlx4_ib S ffff9868175c0000 0 71493 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: mlx4_ib_mcg S ffff986834bc1040 0 71494 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: ipoib_flush S ffff985815b3c100 0 71588 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: mlx5i S ffff985815b3d140 0 71590 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: ipoib_wq S ffff985836f25140 0 71601 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: rdma_cm S ffff9858365e5140 0 71973 2 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:44 fir-io1-s1 kernel: sshd S ffff986801e3a080 0 72454 1 0x00000080
Mar 21 10:23:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256f6f>] ? __pollwait+0x7f/0xf0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85257c11>] do_select+0x6d1/0x7c0
Mar 21 10:23:44 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff856241d1>] ? __alloc_skb+0xa1/0x2d0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85232c22>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85375979>] ? cpumask_any_but+0x39/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8507a718>] ? flush_tlb_page+0x38/0xa0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851c5afe>] ? lru_cache_add+0xe/0x10
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851f7078>] ? page_add_new_anon_rmap+0xb8/0x170
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851e58cb>] ? wp_page_copy.isra.71+0x3ab/0x560
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851b676b>] ? unlock_page+0x2b/0x30
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851e7b3e>] ? do_wp_page+0x19e/0x720
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85257eff>] core_sys_select+0x1ff/0x340
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851ebedd>] ? handle_mm_fault+0x39d/0x9b0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8525810a>] SyS_select+0xca/0x120
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: rsyslogd S ffff987822e1e180 0 72456 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85257c11>] do_select+0x6d1/0x7c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851d82c8>] ? zone_statistics+0x88/0xa0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851d7fb2>] ? __inc_zone_page_state+0x32/0x60
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851f6f7a>] ? do_page_add_anon_rmap+0x9a/0xc0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850db13e>] ? task_scan_min+0x3e/0x60
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850db187>] ? task_scan_max+0x27/0x40
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850df600>] ? task_numa_fault+0x8d0/0xbb0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851e901e>] ? do_numa_page+0x1be/0x250
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851e93c6>] ? handle_pte_fault+0x316/0xd10
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851ca6b2>] ? putback_lru_page+0x52/0xb0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852247a7>] ? migrate_pages+0x2d7/0x790
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850deb3b>] ? should_numa_migrate_memory+0x5b/0x150
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8521201c>] ? mpol_misplaced+0x18c/0x1e0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85257eff>] core_sys_select+0x1ff/0x340
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851ebedd>] ? handle_mm_fault+0x39d/0x9b0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8523e2aa>] ? __check_object_size+0x1ca/0x250
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8525810a>] SyS_select+0xca/0x120
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: in:imjournal S ffff984834770000 0 72464 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8525884d>] do_sys_poll+0x48d/0x590
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852f8e02>] ? security_inode_permission+0x22/0x30
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8524d072>] ? __inode_permission+0x52/0xd0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8524d108>] ? inode_permission+0x18/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85250d51>] ? link_path_walk+0x81/0x8b0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8524ca00>] ? complete_walk+0x50/0xe0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85251702>] ? path_lookupat+0x92/0x8b0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85061dee>] ? physflat_send_IPI_mask+0xe/0x10
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8521bf25>] ? kmem_cache_alloc+0x35/0x1f0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85252d9f>] ? getname_flags+0x4f/0x1a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85252d2d>] ? putname+0x3d/0x60
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85253f42>] ? user_path_at_empty+0x72/0xc0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8523e2aa>] ? __check_object_size+0x1ca/0x250
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85394d0d>] ? list_del+0xd/0x30
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c28f1>] ? remove_wait_queue+0x31/0x40
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8528bb1f>] ? inotify_read+0x2ef/0x420
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85258cc3>] SyS_ppoll+0x1d3/0x1f0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: rs:main Q:Reg S ffff987831351040 0 72465 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851b8b57>] ? generic_file_aio_write+0x77/0xa0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffffc061f322>] ? ext4_file_write+0xd2/0x1e0 [ext4]
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: collectd S ffff986813beb0c0 0 72460 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: writer#0 S ffff984834774100 0 72469 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d2f75>] ? ttwu_do_wakeup+0xb5/0xe0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cbf8>] ? get_futex_key+0x1c8/0x2c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: writer#1 S ffff9867f5bc6180 0 72470 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85061dee>] ? physflat_send_IPI_mask+0xe/0x10
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cbf8>] ? get_futex_key+0x1c8/0x2c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8502a621>] ? __switch_to+0x151/0x580
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: writer#2 S ffff9867f5bc1040 0 72471 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d2f75>] ? ttwu_do_wakeup+0xb5/0xe0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cbf8>] ? get_futex_key+0x1c8/0x2c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: writer#3 S ffff9858376a8000 0 72472 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85061dee>] ? physflat_send_IPI_mask+0xe/0x10
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: writer#4 S ffff985839d42080 0 72473 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d2f75>] ? ttwu_do_wakeup+0xb5/0xe0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cbf8>] ? get_futex_key+0x1c8/0x2c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: reader#0 S ffff987822f90000 0 72474 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf14>] ? futex_wait_queue_me+0xa4/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff851f18f7>] ? do_munmap+0x327/0x480
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:45 fir-io1-s1 kernel: reader#1 S ffff987822f92080 0 72475 1 0x00000080
Mar 21 10:23:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:45 fir-io1-s1 kernel: [<ffffffff8510cf14>] ? futex_wait_queue_me+0xa4/0x130
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff852436e6>] ? __fput+0x186/0x260
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: reader#2 S ffff98782332d140 0 72476 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510cf14>] ? futex_wait_queue_me+0xa4/0x130
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff851f18f7>] ? do_munmap+0x327/0x480
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: reader#3 S ffff98782332c100 0 72477 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510cf14>] ? futex_wait_queue_me+0xa4/0x130
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff851f18f7>] ? do_munmap+0x327/0x480
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: reader#4 S ffff987823329040 0 72479 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510cf36>] futex_wait_queue_me+0xc6/0x130
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510dc1b>] futex_wait+0x17b/0x280
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510f966>] do_futex+0x106/0x5a0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8510fe80>] SyS_futex+0x80/0x190
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: nfsiod S ffff985836ccd140 0 72524 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: nfsv4.1-svc S ffff98580cba4100 0 72566 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc09833bd>] nfs41_callback_svc+0x15d/0x1c0 [nfsv4]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0983260>] ? nfs4_callback_svc+0x60/0x60 [nfsv4]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: crond S ffffffff8576796e 0 72591 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: agetty S ffff987822e19040 0 72655 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850b788e>] ? get_work_pool+0x3e/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ba50b>] ? flush_work+0x13b/0x190
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8547b215>] ? serial8250_start_tx+0xa5/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85459088>] ? set_room+0x68/0xc0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8545acfc>] n_tty_read+0x27c/0x930
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff857696eb>] ? ldsem_down_read+0x3b/0x220
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85456550>] tty_read+0x90/0x100
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8524117f>] vfs_read+0x9f/0x170
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8524203f>] SyS_read+0x7f/0xf0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: agetty S ffff986813be9040 0 72657 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff853f91c3>] ? bit_cursor+0x663/0x6a0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850b788e>] ? get_work_pool+0x3e/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ba50b>] ? flush_work+0x13b/0x190
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85459088>] ? set_room+0x68/0xc0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8545acfc>] n_tty_read+0x27c/0x930
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff857696eb>] ? ldsem_down_read+0x3b/0x220
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85456550>] tty_read+0x90/0x100
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8524117f>] vfs_read+0x9f/0x170
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8524203f>] SyS_read+0x7f/0xf0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: master S ffff9878386f6180 0 72808 1 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c5e92>] ? hrtimer_start+0x12/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: qmgr S ffff9878246e0000 0 72904 72808 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85264314>] ? mntput+0x24/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:23:46 fir-io1-s1 kernel: cfs_rh_00 S ffff98581fa94100 0 91304 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: cfs_rh_01 S ffff98581fa91040 0 91305 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: cfs_rh_02 S ffff98581fa90000 0 91306 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: cfs_rh_03 S ffff98581fa96180 0 91307 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: clio S ffff98583c2430c0 0 91331 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:46 fir-io1-s1 kernel: ptlrpc_hr00_000 S ffff98580a7ea080 0 91336 2 0x00000080
Mar 21 10:23:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:46 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr00_001 S ffff98580a7e9040 0 91337 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr00_002 S ffff98581af61040 0 91338 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr00_003 S ffff98583a7d30c0 0 91339 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr00_004 S ffff985807615140 0 91340 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr00_005 S ffff98581c326180 0 91341 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr01_000 S ffff98581c321040 0 91342 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr01_001 S ffff98581c3230c0 0 91343 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr01_002 S ffff98581c322080 0 91344 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr01_003 S ffff98581c325140 0 91346 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr01_004 S ffff98581c320000 0 91347 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr01_005 S ffff9848e9852080 0 91348 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr02_000 S ffff985837b05140 0 91349 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr02_001 S ffff98583bf7c100 0 91350 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr02_002 S ffff9848e995b0c0 0 91351 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:47 fir-io1-s1 kernel: ptlrpc_hr02_003 S ffff9848e99d8000 0 91352 2 0x00000080
Mar 21 10:23:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:47 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr02_004 S ffff985838b61040 0 91353 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr02_005 S ffff9858376c0000 0 91354 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr03_000 S ffff9858376c2080 0 91355 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr03_001 S ffff9858376c1040 0 91356 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr03_002 S ffff9858376c6180 0 91357 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr03_003 S ffff9848e9fa8000 0 91358 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr03_004 S ffff9848e9fab0c0 0 91359 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: ptlrpc_hr03_005 S ffff98581669c100 0 91360 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3585>] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0de3450>] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_connd S ffff98581669d140 0 91376 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4b93c>] kiblnd_connd+0x60c/0xa00 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4b330>] ? kiblnd_check_conns+0x870/0x870 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_sd_00_00 S ffff985837592080 0 91378 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_sd_00_01 S ffff98580df0b0c0 0 91379 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_sd_00_02 S ffff98580df08000 0 91380 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_sd_00_03 S ffff98580bbdc100 0 91381 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_sd_01_00 S ffff98683cf70000 0 91382 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:48 fir-io1-s1 kernel: kiblnd_sd_01_01 S ffff98683cf730c0 0 91383 2 0x00000080
Mar 21 10:23:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:48 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_01_02 S ffff98683cf74100 0 91384 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_01_03 S ffff98683cf76180 0 91385 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_02_00 S ffff986834bf9040 0 91386 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_02_01 R running task 0 91387 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_02_02 S ffff986834bfb0c0 0 91388 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_02_03 S ffff986835ebe180 0 91389 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_03_00 S ffff986835eba080 0 91390 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_03_01 S ffff986835ebb0c0 0 91391 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_03_02 S ffff986835eb8000 0 91392 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: kiblnd_sd_03_03 S ffff986835ebd140 0 91393 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c4ec>] kiblnd_scheduler+0x32c/0x1180 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0d4c1c0>] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: monitor_thread S ffff98683bbb30c0 0 91394 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c27f6>] ? prepare_to_wait+0x56/0x90
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0ac28f2>] lnet_monitor_thread+0x492/0x560 [lnet]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0ac2460>] ? lnet_recover_peer_nis+0x670/0x670 [lnet]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: lnet_discovery S ffff98683bbb0000 0 91427 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c27f6>] ? prepare_to_wait+0x56/0x90
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0ad5abf>] lnet_peer_discovery+0xdf/0x1150 [lnet]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0ad59e0>] ? lnet_peer_merge_data+0xde0/0xde0 [lnet]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: ptlrpcd_rcv S ffff98683bbb4100 0 91428 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:49 fir-io1-s1 kernel: ptlrpcd_00_00 S ffff9868137c5140 0 91429 2 0x00000080
Mar 21 10:23:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:49 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_01 S ffff9868137c6180 0 91430 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_02 S ffff9868137c2080 0 91431 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_03 S ffff9868137c0000 0 91432 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_04 S ffff986816f7b0c0 0 91433 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_05 S ffff986816f7a080 0 91434 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_06 S ffff985828b48000 0 91435 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_07 S ffff985828b49040 0 91436 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_08 S ffff985828b4a080 0 91437 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_09 S ffff985828b4b0c0 0 91438 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_10 S ffff985828b4c100 0 91439 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_00_11 S ffff985828b4d140 0 91440 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_01_00 S ffff985828b4e180 0 91441 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_01_01 S ffff98582c6c8000 0 91442 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_01_02 S ffff98582c6c9040 0 91443 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: ptlrpcd_01_03 S ffff98582c6ca080 0 91444 2 0x00000080
Mar 21 10:23:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_04 S ffff98582c6cb0c0 0 91445 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_05 S ffff98582c6cc100 0 91446 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_06 S ffff98582c6cd140 0 91447 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_07 S ffff98582c6ce180 0 91448 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_08 S ffff9878362a0000 0 91449 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_09 S ffff9878362a2080 0 91450 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_10 S ffff9878362a1040 0 91451 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_01_11 S ffff9878362a30c0 0 91452 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_00 S ffff9878362a5140 0 91453 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_01 S ffff9878362a4100 0 91454 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_02 S ffff9878383dc100 0 91455 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_03 S ffff9878383dd140 0 91456 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_04 S ffff985820620000 0 91457 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: Lustre: fir-OST0002: Export ffff983851c2e400 already connecting from 10.8.26.6@o2ib6
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_05 S ffff985820621040 0 91458 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_06 S ffff985820622080 0 91459 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:51 fir-io1-s1 kernel: ptlrpcd_02_07 S ffff9858206230c0 0 91460 2 0x00000080
Mar 21 10:23:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:51 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_02_08 S ffff985820624100 0 91461 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_02_09 S ffff985820625140 0 91462 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_02_10 S ffff985820626180 0 91463 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_02_11 S ffff98783c050000 0 91464 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_00 S ffff98783c052080 0 91465 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_01 S ffff98783c056180 0 91466 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_02 S ffff98783c0530c0 0 91467 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_03 S ffff98783c054100 0 91468 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_04 S ffff98783c055140 0 91469 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Lustre: fir-OST0004: Export ffff986b10a41400 already connecting from 10.9.102.21@o2ib4
Mar 21 10:23:52 fir-io1-s1 kernel: Lustre: fir-OST0000: Export ffff98713b7da000 already connecting from 10.9.102.21@o2ib4
Mar 21 10:23:52 fir-io1-s1 kernel: Lustre: Skipped 5 previous similar messages
Mar 21 10:23:52 fir-io1-s1 kernel: Lustre: Skipped 5 previous similar messages
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_05 S ffff9868e96f8000 0 91470 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_06 S ffff9868e96fd140 0 91471 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_07 S ffff9868e96fc100 0 91472 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_08 S ffff9868e96fe180 0 91473 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_09 S ffff987837660000 0 91474 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:52 fir-io1-s1 kernel: ptlrpcd_03_10 S ffff987837665140 0 91475 2 0x00000080
Mar 21 10:23:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:52 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: ptlrpcd_03_11 S ffff987837661040 0 91476 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc0ba1ca4>] ? lu_env_refill+0x24/0x30 [obdclass]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc0df9cbe>] ptlrpcd+0x2ee/0x550 [ptlrpc]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc0df99d0>] ? ptlrpcd_check+0x590/0x590 [ptlrpc]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: raid5wq S ffff98581af3b0c0 0 91755 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff98581af3a080 0 91757 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff98581af3c100 0 91758 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: md0_raid6 D ffff98581af3e180 0 91761 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff985820659040 0 91841 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff98582065d140 0 91842 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: md10_raid6 D ffff98582065b0c0 0 91871 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff9868175c1040 0 92089 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff985815b3b0c0 0 92090 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: md6_raid6 D ffff98581af39040 0 92157 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff985811252080 0 92220 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff985811256180 0 92222 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: md2_raid6 D ffff9858112530c0 0 92247 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:53 fir-io1-s1 kernel: bioset S ffff98483bc00000 0 92353 2 0x00000080
Mar 21 10:23:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: bioset S ffff98483bc02080 0 92355 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: md4_raid6 D ffff98483bc05140 0 92431 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: bioset S ffff9868388b30c0 0 92527 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: bioset S ffff9868388b0000 0 92528 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: md8_raid6 D ffff98483bc01040 0 92616 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: kmmpd-md0 D ffff9857e60ce180 0 94156 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: kmmpd-md10 D ffff9857e60cd140 0 94157 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: kmmpd-md6 D ffff9857e60cc100 0 94158 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: kmmpd-md2 D ffff9857e60cb0c0 0 94159 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:54 fir-io1-s1 kernel: kmmpd-md4 D ffff9857e60ca080 0 94162 2 0x00000080
Mar 21 10:23:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: kmmpd-md8 D ffff9857e60c9040 0 94163 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: jbd2/md10-8 D ffff9857e60c8000 0 94174 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff851581ef>] ? delayacct_end+0x8f/0xb0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08c6f02>] jbd2_journal_commit_transaction+0xe82/0x19b0 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08cce89>] kjournald2+0xc9/0x260 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: jbd2/md0-8 D ffff98581da9d140 0 94175 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08c62bc>] jbd2_journal_commit_transaction+0x23c/0x19b0 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850aa0de>] ? try_to_del_timer_sync+0x5e/0x90
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08cce89>] kjournald2+0xc9/0x260 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: ldiskfs-rsv-con S ffff985836f24100 0 94176 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: ldiskfs-rsv-con S ffff985836f21040 0 94180 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: jbd2/md6-8 D ffff9868388b1040 0 94193 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08c62bc>] jbd2_journal_commit_transaction+0x23c/0x19b0 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850aa0de>] ? try_to_del_timer_sync+0x5e/0x90
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08cce89>] kjournald2+0xc9/0x260 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: jbd2/md2-8 D ffff9868388b4100 0 94194 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff851581ef>] ? delayacct_end+0x8f/0xb0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08c6f02>] jbd2_journal_commit_transaction+0xe82/0x19b0 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08cce89>] kjournald2+0xc9/0x260 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: ldiskfs-rsv-con S ffff9868388b6180 0 94195 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: ldiskfs-rsv-con S ffff9868388b2080 0 94196 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: ldlm_cb00_000 S ffff986813bed140 0 94200 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: lc_watchdogd S ffff986813bea080 0 94201 2 0x00000080
Mar 21 10:23:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc0a270e9>] lcw_dispatch_main+0x749/0x940 [libcfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffffc0a269a0>] ? lc_watchdog_add+0x790/0x790 [libcfs]
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb00_001 S ffff985820658000 0 94202 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb01_000 S ffff98582065c100 0 94203 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb01_001 S ffff98582065a080 0 94204 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb02_000 S ffff985836992080 0 94205 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb02_001 S ffff985834eec100 0 94206 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb03_000 S ffff9858365e1040 0 94207 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cb03_001 S ffff9858365e6180 0 94208 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn00_000 S ffff9858365e4100 0 94210 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn00_001 S ffff985814ed1040 0 94211 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn00_002 S ffff985814ed30c0 0 94212 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn01_000 S ffff9848e9feb0c0 0 94213 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn01_001 S ffff985808f10000 0 94214 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn01_002 S ffff985808f12080 0 94215 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn02_000 S ffff98581669e180 0 94216 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: ldlm_cn02_001 S ffff98582eee1040 0 94217 2 0x00000080
Mar 21 10:23:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_cn02_002 S ffff98582eee2080 0 94218 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_cn03_000 S ffff98582eee30c0 0 94219 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_cn03_001 D ffff98582eee0000 0 94220 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc166bae7>] ofd_lvbo_update+0x577/0xdf0 [ofd]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db0e29>] ldlm_request_cancel+0x3c9/0x740 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db597a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db5c68>] ldlm_cancel_handler+0x158/0x590 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_cn03_002 S ffff98581af38000 0 94221 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_bl_01 S ffff9878370c6180 0 94222 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_bl_02 S ffff9878370c30c0 0 94223 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ldlm_elt S ffff9878370c4100 0 94224 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0dae702>] expired_lock_main+0x1c2/0xc00 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0dae540>] ? ldlm_server_glimpse_ast+0x3f0/0x3f0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ll_cfg_requeue S ffff9878232c5140 0 94225 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc106ac65>] mgc_requeue_thread+0x5f5/0x870 [mgc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc106a670>] ? mgc_process_config+0x13f0/0x13f0 [mgc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ll_ost00_000 S ffff9878232c30c0 0 94235 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ll_ost00_001 S ffff9878232c6180 0 94236 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ll_ost00_002 S ffff9878232c1040 0 94237 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: Lustre: fir-OST0000: Export ffff98546cff2c00 already connecting from 10.9.102.25@o2ib4
Mar 21 10:23:57 fir-io1-s1 kernel: Lustre: Skipped 5 previous similar messages
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: ll_ost01_000 D ffff9878232c0000 0 94238 2 0x00000080
Mar 21 10:23:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:57 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost01_001 S ffff9878232c4100 0 94239 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost01_002 S ffff9848342ad140 0 94240 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost02_000 S ffff9848342a8000 0 94241 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost02_001 S ffff9848342a9040 0 94242 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost02_002 S ffff9848342ac100 0 94243 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost03_000 S ffff984822fec100 0 94244 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost03_001 S ffff984822feb0c0 0 94245 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost03_002 S ffff984822fed140 0 94246 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost_create00 S ffff984822fe8000 0 94247 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: jbd2/md4-8 D ffff984822fea080 0 94248 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff851581ef>] ? delayacct_end+0x8f/0xb0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc08c6f02>] jbd2_journal_commit_transaction+0xe82/0x19b0 [jbd2]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc08cce89>] kjournald2+0xc9/0x260 [jbd2]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: ll_ost_create00 S ffff983969780000 0 94249 2 0x00000080
Mar 21 10:23:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_create01 S ffff9839697830c0 0 94250 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_create01 S ffff9848341e8000 0 94251 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_create02 S ffff9848341eb0c0 0 94252 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_create02 S ffff9848341e9040 0 94253 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_create03 S ffff9848341ed140 0 94254 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_create03 S ffff98481e731040 0 94255 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_io00_000 D ffff98481e732080 0 94256 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d31b6>] ? __cond_resched+0x26/0x30
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_io00_001 D ffff984833dde180 0 94257 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:23:59 fir-io1-s1 kernel: ll_ost_io00_002 D ffff984833dd8000 0 94258 2 0x00000080
Mar 21 10:23:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:23:59 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: ll_ost_io01_000 D ffff984833ddd140 0 94259 2 0x00000080
Mar 21 10:24:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: ll_ost_io01_001 D ffff984833ddb0c0 0 94260 2 0x00000080
Mar 21 10:24:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: ll_ost_io01_002 D ffff984833dd9040 0 94261 2 0x00000080
Mar 21 10:24:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85061dee>] ? physflat_send_IPI_mask+0xe/0x10
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc151a443>] ? osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc151bbaf>] osd_write_commit+0x41f/0x8c0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: ll_ost_io02_000 D ffff984833dda080 0 94262 2 0x00000080
Mar 21 10:24:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: ll_ost_io02_001 D ffff984836ea2080 0 94263 2 0x00000080
Mar 21 10:24:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff851b92be>] ? __find_get_pages+0x11e/0x1c0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc151e59c>] osd_punch+0x28c/0x6b0 [osd_ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: ll_ost_io02_002 D ffff984836ea1040 0 94264 2 0x00000080
Mar 21 10:24:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: ll_ost_io03_000 D ffff984836ea0000 0 94265 2 0x00000080
Mar 21 10:24:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_io03_001 D ffff984836ea4100 0 94266 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_io03_002 D ffff984836ea5140 0 94267 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq00_00 S ffff984836ea30c0 0 94268 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq00_00 S ffff98482071a080 0 94269 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq01_00 S ffff984820718000 0 94270 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq01_00 S ffff984820719040 0 94271 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq02_00 S ffff983969b1e180 0 94272 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq02_00 S ffff983969b1d140 0 94273 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: ll_ost_seq03_00 S ffff98576dc78000 0 94274 2 0x00000080
Mar 21 10:24:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_seq03_00 S ffff98576dc79040 0 94275 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out00_00 S ffff98576dc7a080 0 94276 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out00_00 S ffff98576dc7b0c0 0 94277 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out01_00 S ffff98576dc7c100 0 94278 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out01_00 S ffff98576dc7d140 0 94279 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out02_00 S ffff98576dc7e180 0 94280 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out02_00 S ffff98576dcc8000 0 94281 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out03_00 S ffff98576dcc9040 0 94282 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_ost_out03_00 S ffff98576dcca080 0 94283 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ll_evictor D ffff98576dccb0c0 0 94284 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc14988e3>] ? __es_insert_extent+0xc3/0x260 [ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc14988e3>] ? __es_insert_extent+0xc3/0x260 [ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0e347e9>] tgt_client_del+0x449/0x6b0 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc165530c>] ofd_obd_disconnect+0x1ac/0x220 [ofd]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0b73594>] class_fail_export+0x224/0x520 [obdclass]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0decc78>] ping_evictor_main+0x288/0x700 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc0dec9f0>] ? ptlrpc_del_timeout_client+0x190/0x190 [ptlrpc]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: ldiskfs-rsv-con S ffff98576dccc100 0 94285 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: jbd2/md8-8 D ffff98576dccd140 0 94286 2 0x00000080
Mar 21 10:24:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff851581ef>] ? delayacct_end+0x8f/0xb0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc08c6f02>] jbd2_journal_commit_transaction+0xe82/0x19b0 [jbd2]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc08cce89>] kjournald2+0xc9/0x260 [jbd2]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffffc08ccdc0>] ? commit_timeout+0x10/0x10 [jbd2]
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ll_ost03_003 S ffff98576dcce180 0 94287 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ldiskfs-rsv-con S ffff985769d51040 0 94300 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ll_ost00_003 S ffff985769d52080 0 94314 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ll_ost01_003 S ffff985769d530c0 0 94315 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ll_ost02_003 S ffff985769d54100 0 94316 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: inconsistency_v S ffff985769d55140 0 94317 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc1662a00>] ofd_inconsistency_verification_main+0x960/0xee0 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc16620a0>] ? ofd_cb_soft_sync+0x260/0x260 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: lquota_wb_fir-O S ffff985769e4d140 0 94339 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f0a9e>] ? qsd_job_pending+0x7e/0x1b0 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f1a96>] qsd_upd_thread+0xae6/0xe30 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f0fb0>] ? qsd_upd_add+0xf0/0xf0 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ll_ost01_004 S ffff985769e49040 0 94358 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: ll_ost00_004 S ffff985769e4c100 0 94362 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: inconsistency_v S ffff985769e48000 0 94363 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc1662a00>] ofd_inconsistency_verification_main+0x960/0xee0 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc16620a0>] ? ofd_cb_soft_sync+0x260/0x260 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: lquota_wb_fir-O S ffff985769d2e180 0 94378 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f0a9e>] ? qsd_job_pending+0x7e/0x1b0 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f1a96>] qsd_upd_thread+0xae6/0xe30 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f0fb0>] ? qsd_upd_add+0xf0/0xf0 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: inconsistency_v S ffff985769d2c100 0 94388 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc1662a00>] ofd_inconsistency_verification_main+0x960/0xee0 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc16620a0>] ? ofd_cb_soft_sync+0x260/0x260 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: lquota_wb_fir-O S ffff985769d14100 0 94403 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f0a9e>] ? qsd_job_pending+0x7e/0x1b0 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f1a96>] qsd_upd_thread+0xae6/0xe30 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc11f0fb0>] ? qsd_upd_add+0xf0/0xf0 [lquota]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:04 fir-io1-s1 kernel: inconsistency_v S ffff985769d10000 0 94413 2 0x00000080
Mar 21 10:24:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc1662a00>] ofd_inconsistency_verification_main+0x960/0xee0 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffffc16620a0>] ? ofd_cb_soft_sync+0x260/0x260 [ofd]
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: lquota_wb_fir-O S ffff984835a8e180 0 94428 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f0a9e>] ? qsd_job_pending+0x7e/0x1b0 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f1a96>] qsd_upd_thread+0xae6/0xe30 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f0fb0>] ? qsd_upd_add+0xf0/0xf0 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: inconsistency_v S ffff984835a8d140 0 94443 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc1662a00>] ofd_inconsistency_verification_main+0x960/0xee0 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc16620a0>] ? ofd_cb_soft_sync+0x260/0x260 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: lquota_wb_fir-O S ffff985769f7d140 0 94458 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f0a9e>] ? qsd_job_pending+0x7e/0x1b0 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f1a96>] qsd_upd_thread+0xae6/0xe30 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f0fb0>] ? qsd_upd_add+0xf0/0xf0 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: inconsistency_v S ffff985769f7b0c0 0 94468 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850ac4ab>] ? recalc_sigpending+0x1b/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc1662a00>] ofd_inconsistency_verification_main+0x960/0xee0 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff8502a59e>] ? __switch_to+0xce/0x580
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc16620a0>] ? ofd_cb_soft_sync+0x260/0x260 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: lquota_wb_fir-O S ffff98483209e180 0 94483 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f0a9e>] ? qsd_job_pending+0x7e/0x1b0 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f1a96>] qsd_upd_thread+0xae6/0xe30 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc11f0fb0>] ? qsd_upd_add+0xf0/0xf0 [lquota]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost01_005 S ffff98483209c100 0 94512 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost03_004 S ffff9857694c8000 0 94513 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost02_004 S ffff9857694c9040 0 94514 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost01_006 D ffff9857694ca080 0 94526 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost02_005 S ffff9857694cb0c0 0 94527 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost01_007 S ffff9857694cc100 0 94539 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:05 fir-io1-s1 kernel: ll_ost_io02_003 D ffff9857694cd140 0 94567 2 0x00000080
Mar 21 10:24:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost02_006 S ffff9857694ce180 0 94627 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost02_007 S ffff98581fa95140 0 94628 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost00_005 S ffff98580ef88000 0 94629 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost00_006 S ffff985769e69040 0 94854 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost02_008 S ffff985769e6c100 0 94931 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost_io01_003 D ffff985769e68000 0 96233 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc14f8330>] ? osd_trans_create+0xa0/0x620 [osd_ldiskfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc14ad8b9>] ldiskfs_fiemap+0x109/0x600 [ldiskfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc1519187>] osd_is_mapped+0x157/0x1c0 [osd_ldiskfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc151dc92>] osd_declare_write_commit+0x182/0x530 [osd_ldiskfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc16638b9>] ofd_commitrw_write+0x939/0x1d40 [ofd]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost00_007 S ffff985769e6e180 0 96240 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost00_008 S ffff985769e6b0c0 0 96241 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost01_008 D ffff985769e6d140 0 96242 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost01_009 S ffff985769e6a080 0 96243 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:06 fir-io1-s1 kernel: ll_ost01_010 S ffff985835c76180 0 96244 2 0x00000080
Mar 21 10:24:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:06 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost00_009 S ffff985835c70000 0 96245 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost02_009 S ffff985835c74100 0 96246 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost01_011 S ffff985835c730c0 0 96247 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost02_010 D ffff985756438000 0 96248 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc14603e6>] ? ldiskfs_dx_find_entry+0x186/0x200 [ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff852adb3f>] ? inode_reserved_space+0x1f/0x30
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc1496c38>] __ldiskfs_new_inode+0x808/0x1570 [ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc145cea7>] ldiskfs_create_inode+0x37/0xa0 [ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc14f2eec>] osd_mkfile.isra.80+0x11c/0x230 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc14f30a3>] osd_mkreg+0x33/0x70 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc15083df>] osd_create+0x23f/0xf90 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc151cd9b>] ? osd_write+0x15b/0x5c0 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc165e3bc>] ofd_precreate_objects+0xefc/0x1ab0 [ofd]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc1650794>] ofd_create_hdl+0x474/0x20e0 [ofd]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0dda707>] ? lustre_msg_add_version+0x27/0xa0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost01_012 D ffff985756439040 0 96249 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0ac019c>] ? LNetPut+0x2cc/0xb50 [lnet]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc150ff00>] ? osd_oi_insert+0x4d0/0x520 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc14feedf>] ? osd_destroy+0x1af/0x760 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc14fe23d>] ? osd_ref_del+0x1ad/0x6a0 [osd_ldiskfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc1661455>] ofd_destroy+0x2c5/0x960 [ofd]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost02_011 S ffff98575643d140 0 96250 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost01_013 S ffff98575643a080 0 96251 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:07 fir-io1-s1 kernel: ll_ost00_010 S ffff98575643e180 0 96252 2 0x00000080
Mar 21 10:24:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost02_012 D ffff98575643b0c0 0 96253 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc1468da7>] ? ldiskfs_bread+0x27/0xc0 [ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc14603e6>] ? ldiskfs_dx_find_entry+0x186/0x200 [ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff852adb3f>] ? inode_reserved_space+0x1f/0x30
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc149693b>] __ldiskfs_new_inode+0x50b/0x1570 [ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc145cea7>] ldiskfs_create_inode+0x37/0xa0 [ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc14f2eec>] osd_mkfile.isra.80+0x11c/0x230 [osd_ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc14f30a3>] osd_mkreg+0x33/0x70 [osd_ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc15083df>] osd_create+0x23f/0xf90 [osd_ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc151cd9b>] ? osd_write+0x15b/0x5c0 [osd_ldiskfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc165e3bc>] ofd_precreate_objects+0xefc/0x1ab0 [ofd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc1650794>] ofd_create_hdl+0x474/0x20e0 [ofd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0dda707>] ? lustre_msg_add_version+0x27/0xa0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost01_014 S ffff98575643c100 0 96254 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0b80a51>] ? lprocfs_counter_sub+0xc1/0x130 [obdclass]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0a1dea1>] ? cfs_block_sigsinv+0x71/0xa0 [libcfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0da4860>] ? ldlm_completion_ast_async+0x300/0x300 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0da5031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0d8bf6f>] ? ldlm_lock_enqueue+0x40f/0xa60 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0da3092>] ? ldlm_interval_alloc+0xa2/0x260 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0da5dcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc16596ad>] ofd_destroy_by_fid+0x1dd/0x4a0 [ofd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost02_013 S ffff9848e99aa080 0 96255 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost01_015 S ffff985767ca8000 0 96256 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost01_016 S ffff985767ca9040 0 96257 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost00_011 S ffff985767cad140 0 96258 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: ll_ost00_012 S ffff985767cae180 0 96259 2 0x00000080
Mar 21 10:24:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff851022f2>] ? ktime_get+0x52/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0d435f2>] ? kiblnd_check_sends_locked+0xa72/0xe40 [ko2iblnd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0d439f6>] ? kiblnd_queue_tx+0x36/0x50 [ko2iblnd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0d44987>] ? kiblnd_send+0x357/0xa20 [ko2iblnd]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0ab80e4>] ? lnet_ni_send+0x44/0xd0 [lnet]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0abfd92>] ? lnet_send+0x82/0x1c0 [lnet]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0ac019c>] ? LNetPut+0x2cc/0xb50 [lnet]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85034919>] ? sched_clock+0x9/0x10
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff851656c5>] ? tracing_is_on+0x15/0x30
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff851717bd>] ? probe_sched_switch+0x2d/0xa0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ? ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ? ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] ? kthread+0xd1/0xe0
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ? ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost00_013 S ffff985767caa080 0 96260 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost01_017 S ffff985767cab0c0 0 96261 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost02_014 S ffff985767cac100 0 96262 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost00_014 S ffff987835e0c100 0 96263 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost01_018 S ffff987835e0e180 0 96264 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost00_015 S ffff987835e0b0c0 0 96265 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost03_005 S ffff987835e0d140 0 96266 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost01_019 S ffff9868e9621040 0 96267 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost01_020 S ffff9868e94c0000 0 96268 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost02_015 S ffff9868e94c30c0 0 96269 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost00_016 S ffff9857679b8000 0 96270 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost00_017 S ffff9857679b9040 0 96271 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost02_016 D ffff9857679ba080 0 96272 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:09 fir-io1-s1 kernel: ll_ost00_018 S ffff9857679bb0c0 0 96273 2 0x00000080
Mar 21 10:24:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost01_021 D ffff9857679bc100 0 96274 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff8521a849>] ? ___slab_alloc+0x209/0x4f0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost02_017 R running task 0 96275 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost00_019 S ffff9857679be180 0 96276 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost01_022 S ffff9857627c8000 0 96277 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost02_018 S ffff9857627c9040 0 96278 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost02_019 S ffff9857627ca080 0 96279 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost00_020 S ffff9857627cb0c0 0 96280 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost01_023 D ffff9857627cc100 0 96281 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff851bf48e>] ? free_pcppages_bulk+0x17e/0x3a0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc148e2c9>] ? __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc146d4b7>] ldiskfs_truncate+0x1a7/0x3f0 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc146e42a>] ldiskfs_evict_inode+0x58a/0x630 [ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:10 fir-io1-s1 kernel: ll_ost_create02 S ffff9857627cd140 0 96282 2 0x00000080
Mar 21 10:24:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost_create01 S ffff9857627ce180 0 96283 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost02_020 S ffff985761f50000 0 96284 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost_create00 S ffff985761f51040 0 96285 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost01_024 S ffff985761f52080 0 96286 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0b6da6e>] ? export_handle_addref+0xe/0x10 [obdclass]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost_io00_003 D ffff985761f530c0 0 96287 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost01_025 S ffff985761f54100 0 96288 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost_io03_003 D ffff985761f55140 0 96289 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost00_021 S ffff985761f56180 0 96290 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:11 fir-io1-s1 kernel: ll_ost_io00_004 D ffff985756ed8000 0 96291 2 0x00000080
Mar 21 10:24:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:11 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: ll_ost_io02_004 D ffff985756ed9040 0 96292 2 0x00000080
Mar 21 10:24:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: ll_ost_io00_005 D ffff985756eda080 0 96293 2 0x00000080
Mar 21 10:24:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: ll_ost_io01_004 D ffff985756edb0c0 0 96294 2 0x00000080
Mar 21 10:24:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:12 fir-io1-s1 kernel: ll_ost_io01_005 D ffff985756edc100 0 96295 2 0x00000080
Mar 21 10:24:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: ll_ost_io01_006 D ffff985756edd140 0 96296 2 0x00000080
Mar 21 10:24:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14886a6>] ldiskfs_quota_write+0xc6/0x1e0 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b2a95>] qtree_write_dquot+0xd5/0x180
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b184b>] v2_write_dquot+0x2b/0x30
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852ae36d>] dquot_commit+0xbd/0xd0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: ll_ost_io02_005 D ffff985756ede180 0 96297 2 0x00000080
Mar 21 10:24:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: ll_ost_io03_004 D ffff985756f30000 0 96298 2 0x00000080
Mar 21 10:24:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:13 fir-io1-s1 kernel: ll_ost_io00_006 D ffff985756f31040 0 96299 2 0x00000080
Mar 21 10:24:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: ll_ost_io01_007 D ffff985756f32080 0 96300 2 0x00000080
Mar 21 10:24:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: ll_ost_io00_007 D ffff985756f330c0 0 96301 2 0x00000080
Mar 21 10:24:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: ll_ost01_026 S ffff985756f34100 0 96302 2 0x00000080
Mar 21 10:24:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: ll_ost_io01_008 D ffff985756f35140 0 96303 2 0x00000080
Mar 21 10:24:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:14 fir-io1-s1 kernel: ll_ost_io02_006 D ffff985756f36180 0 96304 2 0x00000080
Mar 21 10:24:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:14 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: ll_ost_io03_005 D ffff985756f78000 0 96305 2 0x00000080
Mar 21 10:24:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8521a849>] ? ___slab_alloc+0x209/0x4f0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: ll_ost_io01_009 D ffff985756f79040 0 96306 2 0x00000080
Mar 21 10:24:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: ll_ost_io00_008 D ffff985756f7a080 0 96307 2 0x00000080
Mar 21 10:24:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: ll_ost_io02_007 D ffff985756f7b0c0 0 96308 2 0x00000080
Mar 21 10:24:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:15 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc151a443>] ? osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc151bbaf>] osd_write_commit+0x41f/0x8c0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: ll_ost_io01_010 D ffff985756f7c100 0 96309 2 0x00000080
Mar 21 10:24:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: ll_ost_io00_009 D ffff985756f7d140 0 96310 2 0x00000080
Mar 21 10:24:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:16 fir-io1-s1 kernel: ll_ost_io01_011 D ffff985756f7e180 0 96311 2 0x00000080
Mar 21 10:24:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: ll_ost_io02_008 D ffff985756fa0000 0 96312 2 0x00000080
Mar 21 10:24:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: ll_ost_io02_009 D ffff985756fa1040 0 96313 2 0x00000080
Mar 21 10:24:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc149924a>] ? ldiskfs_es_lookup_extent+0x2a/0x180 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: ll_ost_io00_010 D ffff985756fa2080 0 96314 2 0x00000080
Mar 21 10:24:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:17 fir-io1-s1 kernel: ll_ost_io01_012 D ffff985756fa30c0 0 96315 2 0x00000080
Mar 21 10:24:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:17 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: ll_ost_io02_010 D ffff985756fa4100 0 96316 2 0x00000080
Mar 21 10:24:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: ll_ost_io00_011 D ffff985756fa5140 0 96317 2 0x00000080
Mar 21 10:24:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: ll_ost_io01_013 D ffff985756fa6180 0 96318 2 0x00000080
Mar 21 10:24:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:18 fir-io1-s1 kernel: ll_ost_io02_011 D ffff9857623a0000 0 96319 2 0x00000080
Mar 21 10:24:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ldlm_cn01_003 S ffff9857623a1040 0 96320 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ldlm_cn00_003 S ffff9857623a2080 0 96321 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ldlm_cn02_003 S ffff9857623a30c0 0 96322 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ldlm_cn02_004 S ffff9857623a4100 0 96323 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ldlm_cn02_005 S ffff9857623a5140 0 96324 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ll_ost_io02_012 D ffff9857623a6180 0 96325 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ll_ost01_027 S ffff9857678c8000 0 96326 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ll_ost02_021 S ffff9857678c9040 0 96327 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: ll_ost02_022 S ffff9857678ca080 0 96328 2 0x00000080
Mar 21 10:24:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost00_022 S ffff9857678cb0c0 0 96329 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost_io02_013 D ffff9857678cc100 0 96330 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost_io01_014 D ffff9857678cd140 0 96331 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff851b9555>] ? mempool_alloc_slab+0x15/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0ab573e>] ? lnet_ptl_attach_md+0x37e/0x530 [lnet]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost00_023 S ffff9857678ce180 0 96332 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost02_023 S ffff985767cf0000 0 96333 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost00_024 S ffff985767cf1040 0 96334 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost00_025 S ffff985767cf2080 0 96335 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:20 fir-io1-s1 kernel: ll_ost_io01_015 D ffff985767cf30c0 0 96336 2 0x00000080
Mar 21 10:24:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:20 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: ll_ost_io02_014 D ffff985767cf4100 0 96337 2 0x00000080
Mar 21 10:24:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: ll_ost_io00_012 D ffff985767cf5140 0 96338 2 0x00000080
Mar 21 10:24:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: ll_ost_io01_016 D ffff985767cf6180 0 96339 2 0x00000080
Mar 21 10:24:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14f8330>] ? osd_trans_create+0xa0/0x620 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14ad8b9>] ldiskfs_fiemap+0x109/0x600 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1519187>] osd_is_mapped+0x157/0x1c0 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc151dc92>] osd_declare_write_commit+0x182/0x530 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc16638b9>] ofd_commitrw_write+0x939/0x1d40 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0a29207>] ? cfs_hash_bd_lookup_intent+0xf7/0x170 [libcfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: ll_ost_io01_017 S ffff9857696a0000 0 96340 2 0x00000080
Mar 21 10:24:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:21 fir-io1-s1 kernel: ll_ost_io00_013 D ffff9857696a1040 0 96341 2 0x00000080
Mar 21 10:24:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:21 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost_io02_015 D ffff9857696a2080 0 96342 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost_io00_014 D ffff9857696a30c0 0 96343 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff852ad85a>] ? dquot_alloc+0x1a/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc11f7181>] ? qsd_op_begin+0xb1/0x4b0 [lquota]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff852ad3ba>] dquot_acquire+0x3a/0x150
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc1485ad6>] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff852aee8d>] __dquot_initialize+0xad/0x1c0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc148e2c9>] ? __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff852aefb3>] dquot_initialize+0x13/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc151e3db>] osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost_io01_018 D ffff9857696a4100 0 96344 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost01_028 S ffff9857696a5140 0 96345 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost01_029 S ffff9857696a6180 0 96346 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost03_006 S ffff985761958000 0 96347 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:22 fir-io1-s1 kernel: ll_ost_io00_015 D ffff985761959040 0 96348 2 0x00000080
Mar 21 10:24:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff851b9555>] ? mempool_alloc_slab+0x15/0x20
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:22 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: ll_ost_io00_016 D ffff98576195a080 0 96349 2 0x00000080
Mar 21 10:24:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: ll_ost_io02_016 D ffff98576195b0c0 0 96350 2 0x00000080
Mar 21 10:24:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: ll_ost_io03_006 D ffff98576195c100 0 96351 2 0x00000080
Mar 21 10:24:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: ll_ost01_030 S ffff98576195d140 0 96352 2 0x00000080
Mar 21 10:24:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:23 fir-io1-s1 kernel: ll_ost01_031 D ffff98576195e180 0 96353 2 0x00000080
Mar 21 10:24:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_032 S ffff9857693d8000 0 96354 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_033 D ffff9857693d9040 0 96355 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_034 S ffff9857693da080 0 96356 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_035 D ffff9857693db0c0 0 96357 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff852b0d91>] dquot_free_inode+0xf1/0x180
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff852aee1a>] ? __dquot_initialize+0x3a/0x1c0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc1495f17>] ldiskfs_free_inode+0xf7/0x610 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146bd38>] ? ldiskfs_mark_iloc_dirty+0x68/0x80 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146e312>] ? ldiskfs_evict_inode+0x472/0x630 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146be5f>] ? ldiskfs_mark_inode_dirty+0x6f/0x210 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146e41d>] ldiskfs_evict_inode+0x57d/0x630 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_036 S ffff9857693dc100 0 96358 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_037 D ffff9857693dd140 0 96359 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_038 S ffff9857693de180 0 96360 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: ll_ost01_039 D ffff985768850000 0 96361 2 0x00000080
Mar 21 10:24:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc14fe22d>] osd_ref_del+0x19d/0x6a0 [osd_ldiskfs]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc1661699>] ofd_destroy+0x509/0x960 [ofd]
Mar 21 10:24:24 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_040 S ffff985768851040 0 96362 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_041 S ffff985768852080 0 96363 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_042 S ffff9857688530c0 0 96364 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_043 D ffff985768854100 0 96365 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff852b0d91>] dquot_free_inode+0xf1/0x180
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff852aee1a>] ? __dquot_initialize+0x3a/0x1c0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc1495f17>] ldiskfs_free_inode+0xf7/0x610 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc146bd38>] ? ldiskfs_mark_iloc_dirty+0x68/0x80 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc146e312>] ? ldiskfs_evict_inode+0x472/0x630 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc146be5f>] ? ldiskfs_mark_inode_dirty+0x6f/0x210 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc146e41d>] ldiskfs_evict_inode+0x57d/0x630 [ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_044 S ffff985768855140 0 96366 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost02_024 S ffff985768856180 0 96367 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_045 S ffff985769ac8000 0 96368 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_046 S ffff985769ac9040 0 96369 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost02_025 S ffff985769aca080 0 96370 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost02_026 S ffff985769acb0c0 0 96371 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:25 fir-io1-s1 kernel: ll_ost01_047 S ffff985769acc100 0 96372 2 0x00000080
Mar 21 10:24:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost01_048 D ffff985769acd140 0 96373 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0d44987>] ? kiblnd_send+0x357/0xa20 [ko2iblnd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0ab80e4>] ? lnet_ni_send+0x44/0xd0 [lnet]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost02_027 S ffff985769ace180 0 96374 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost01_049 S ffff985761f38000 0 96375 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost01_050 S ffff985761f39040 0 96376 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost02_028 S ffff985761f3a080 0 96377 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost01_051 S ffff985761f3b0c0 0 96378 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost03_007 S ffff985761f3c100 0 96379 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost_io00_017 D ffff985761f3d140 0 96380 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0a29207>] ? cfs_hash_bd_lookup_intent+0xf7/0x170 [libcfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:26 fir-io1-s1 kernel: ll_ost_io00_018 D ffff985761f3e180 0 96381 2 0x00000080
Mar 21 10:24:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:26 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: ll_ost_io02_017 D ffff98575c5c8000 0 96382 2 0x00000080
Mar 21 10:24:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: ll_ost_io01_019 D ffff98575c5c9040 0 96383 2 0x00000080
Mar 21 10:24:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: ll_ost_io00_019 D ffff98575c5ca080 0 96384 2 0x00000080
Mar 21 10:24:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85765721>] ? schedule_timeout+0x221/0x2d0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850cec1a>] ? task_rq_unlock+0x1a/0x20
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850d1b8a>] ? __sched_setscheduler+0xa8a/0xab0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: ll_ost03_008 S ffff98575c5cb0c0 0 96385 2 0x00000080
Mar 21 10:24:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:27 fir-io1-s1 kernel: ll_ost_io01_020 D ffff98575c5cc100 0 96386 2 0x00000080
Mar 21 10:24:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:27 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: ll_ost_io00_020 D ffff98575c5cd140 0 96387 2 0x00000080
Mar 21 10:24:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: ll_ost_io03_007 D ffff98575c5ce180 0 96388 2 0x00000080
Mar 21 10:24:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: ll_ost_io01_021 D ffff9857690a8000 0 96389 2 0x00000080
Mar 21 10:24:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:28 fir-io1-s1 kernel: ll_ost_io00_021 D ffff9857690a9040 0 96390 2 0x00000080
Mar 21 10:24:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: ll_ost_io03_008 D ffff9857690aa080 0 96391 2 0x00000080
Mar 21 10:24:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: ll_ost_io02_018 D ffff9857690ab0c0 0 96392 2 0x00000080
Mar 21 10:24:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: ll_ost_io01_022 D ffff9857690ac100 0 96393 2 0x00000080
Mar 21 10:24:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc151e59c>] osd_punch+0x28c/0x6b0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: ll_ost_io03_009 D ffff9857690ad140 0 96394 2 0x00000080
Mar 21 10:24:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:24:29 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: ll_ost_io02_019 D ffff9857690ae180 0 96395 2 0x00000080
Mar 21 10:24:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: ll_ost_io00_022 D ffff98576ed78000 0 96396 2 0x00000080
Mar 21 10:24:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: ll_ost_io00_023 S ffff98576ed79040 0 96397 2 0x00000080
Mar 21 10:24:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: ll_ost_io00_024 D ffff98576ed7a080 0 96398 2 0x00000080
Mar 21 10:24:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: ll_ost01_052 D ffff98576ed7b0c0 0 96399 2 0x00000080
Mar 21 10:24:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:30 fir-io1-s1 kernel: ll_ost_io00_025 D ffff98576ed7c100 0 96400 2 0x00000080
Mar 21 10:24:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:30 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ll_ost_io00_026 D ffff98576ed7d140 0 96401 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ldlm_cn01_004 S ffff98576ed7e180 0 96402 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ldlm_cn00_004 S ffff98575fc20000 0 96403 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ll_ost01_053 S ffff98575fc21040 0 96404 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ll_ost01_054 D ffff98575fc22080 0 96405 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ll_ost01_055 S ffff98575fc230c0 0 96406 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:31 fir-io1-s1 kernel: ll_ost_io01_023 D ffff98575fc24100 0 96407 2 0x00000080
Mar 21 10:24:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: ll_ost_io02_020 D ffff98575fc25140 0 96408 2 0x00000080
Mar 21 10:24:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: ll_ost02_029 S ffff98575fc26180 0 96409 2 0x00000080
Mar 21 10:24:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: ll_ost_io02_021 D ffff98575f670000 0 96410 2 0x00000080
Mar 21 10:24:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: ll_ost_io01_024 D ffff98575f671040 0 96411 2 0x00000080
Mar 21 10:24:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: ll_ost_io01_025 D ffff98575f672080 0 96412 2 0x00000080
Mar 21 10:24:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:32 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: ll_ost01_056 D ffff98575f6730c0 0 96413 2 0x00000080
Mar 21 10:24:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: ll_ost_io00_027 D ffff98575f674100 0 96414 2 0x00000080
Mar 21 10:24:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff8521a9a5>] ? ___slab_alloc+0x365/0x4f0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:33 fir-io1-s1 kernel: ll_ost_io00_028 D ffff98575f675140 0 96415 2 0x00000080
Mar 21 10:24:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: ldlm_bl_03 S ffff98575f676180 0 96416 2 0x00000080
Mar 21 10:24:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: ll_ost_io01_026 D ffff9857697f8000 0 96417 2 0x00000080
Mar 21 10:24:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: ll_ost_io01_027 D ffff9857697f9040 0 96418 2 0x00000080
Mar 21 10:24:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: ll_ost_io02_022 D ffff9857697fa080 0 96419 2 0x00000080
Mar 21 10:24:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:34 fir-io1-s1 kernel: ll_ost_io01_028 D ffff9857697fb0c0 0 96420 2 0x00000080
Mar 21 10:24:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: ll_ost_io02_023 D ffff9857697fc100 0 96421 2 0x00000080
Mar 21 10:24:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: ll_ost_io01_029 D ffff9857697fd140 0 96422 2 0x00000080
Mar 21 10:24:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: ll_ost_io03_010 D ffff9857697fe180 0 96438 2 0x00000080
Mar 21 10:24:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:35 fir-io1-s1 kernel: ll_ost_io01_030 D ffff985761dd0000 0 96440 2 0x00000080
Mar 21 10:24:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: ll_ost_io01_031 D ffff985761dd1040 0 96441 2 0x00000080
Mar 21 10:24:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: ll_ost_io02_024 D ffff985761dd2080 0 96442 2 0x00000080
Mar 21 10:24:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: ll_ost_io02_025 D ffff985761dd30c0 0 96443 2 0x00000080
Mar 21 10:24:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: ll_ost_io00_029 D ffff985761dd4100 0 96444 2 0x00000080
Mar 21 10:24:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: ll_ost_io03_011 D ffff985761dd5140 0 96445 2 0x00000080
Mar 21 10:24:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: ll_ost_io03_012 D ffff985761dd6180 0 96446 2 0x00000080
Mar 21 10:24:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: ll_ost_io01_032 D ffff98575b620000 0 96447 2 0x00000080
Mar 21 10:24:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:37 fir-io1-s1 kernel: ll_ost_io02_026 D ffff98575b621040 0 96448 2 0x00000080
Mar 21 10:24:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: ll_ost_io03_013 D ffff98575b622080 0 96449 2 0x00000080
Mar 21 10:24:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: ll_ost_io00_030 D ffff98575b6230c0 0 96450 2 0x00000080
Mar 21 10:24:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: ll_ost_io01_033 D ffff98575b624100 0 96451 2 0x00000080
Mar 21 10:24:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:38 fir-io1-s1 kernel: ll_ost_io02_027 D ffff98575b625140 0 96452 2 0x00000080
Mar 21 10:24:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:38 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: ll_ost_io02_028 D ffff98575b626180 0 96453 2 0x00000080
Mar 21 10:24:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff851b9555>] ? mempool_alloc_slab+0x15/0x20
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: ll_ost_io01_034 D ffff98575c020000 0 96454 2 0x00000080
Mar 21 10:24:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: ll_ost_io02_029 D ffff98575c021040 0 96455 2 0x00000080
Mar 21 10:24:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: ll_ost_io01_035 D ffff98575c022080 0 96456 2 0x00000080
Mar 21 10:24:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: ll_ost_io01_036 D ffff98575c0230c0 0 96457 2 0x00000080
Mar 21 10:24:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: ll_ost_io03_014 D ffff98575c024100 0 96458 2 0x00000080
Mar 21 10:24:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85769535>] rwsem_down_write_failed+0x225/0x3a0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0d435f2>] ? kiblnd_check_sends_locked+0xa72/0xe40 [ko2iblnd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85386c47>] call_rwsem_down_write_failed+0x17/0x30
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85766f4d>] down_write+0x2d/0x3d
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14685b4>] ldiskfs_map_blocks+0x134/0x700 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:40 fir-io1-s1 kernel: ll_ost_io01_037 D ffff98575c025140 0 96459 2 0x00000080
Mar 21 10:24:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: ll_ost_io00_031 D ffff98575c026180 0 96460 2 0x00000080
Mar 21 10:24:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: ll_ost_io01_038 D ffff9857565b0000 0 96461 2 0x00000080
Mar 21 10:24:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0ab573e>] ? lnet_ptl_attach_md+0x37e/0x530 [lnet]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: ll_ost_io02_030 D ffff9857565b1040 0 96462 2 0x00000080
Mar 21 10:24:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: ll_ost_io02_031 D ffff9857565b2080 0 96463 2 0x00000080
Mar 21 10:24:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff851bf48e>] ? free_pcppages_bulk+0x17e/0x3a0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffffc14886a6>] ldiskfs_quota_write+0xc6/0x1e0 [ldiskfs]
Mar 21 10:24:41 fir-io1-s1 kernel: [<ffffffff852b2a95>] qtree_write_dquot+0xd5/0x180
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852b184b>] v2_write_dquot+0x2b/0x30
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852ae36d>] dquot_commit+0xbd/0xd0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: Lustre: fir-OST0000: Export ffff985794257800 already connecting from 10.8.26.6@o2ib6
Mar 21 10:24:42 fir-io1-s1 kernel: Lustre: Skipped 2 previous similar messages
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8523e2aa>] ? __check_object_size+0x1ca/0x250
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: ll_ost_io03_015 D ffff9857565b30c0 0 96464 2 0x00000080
Mar 21 10:24:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: ll_ost_io01_039 D ffff9857565b4100 0 96465 2 0x00000080
Mar 21 10:24:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: ll_ost_io02_032 D ffff9857565b5140 0 96466 2 0x00000080
Mar 21 10:24:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:24:42 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: ll_ost_io02_033 D ffff9857565b6180 0 96467 2 0x00000080
Mar 21 10:24:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: ll_ost_io02_034 D ffff985756500000 0 96468 2 0x00000080
Mar 21 10:24:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: ll_ost_io02_035 D ffff985756501040 0 96469 2 0x00000080
Mar 21 10:24:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0d90742>] ? ldlm_resource_putref+0x72/0x500 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: ll_ost_io03_016 D ffff985756502080 0 96470 2 0x00000080
Mar 21 10:24:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:43 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: ll_ost_io01_040 D ffff9857565030c0 0 96471 2 0x00000080
Mar 21 10:24:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: ll_ost_io02_036 D ffff985756504100 0 96472 2 0x00000080
Mar 21 10:24:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: ll_ost_io01_041 D ffff985756505140 0 96473 2 0x00000080
Mar 21 10:24:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc151e59c>] osd_punch+0x28c/0x6b0 [osd_ldiskfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:44 fir-io1-s1 kernel: ll_ost_io01_042 D ffff985756506180 0 96474 2 0x00000080
Mar 21 10:24:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:44 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: ll_ost_io01_043 D ffff98575a910000 0 96475 2 0x00000080
Mar 21 10:24:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: ll_ost_io01_044 D ffff98575a911040 0 96476 2 0x00000080
Mar 21 10:24:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: ll_ost_io03_017 D ffff98575a912080 0 96477 2 0x00000080
Mar 21 10:24:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: ll_ost_io01_045 D ffff98575a9130c0 0 96478 2 0x00000080
Mar 21 10:24:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff851cab71>] ? shrink_page_list+0x461/0xc30
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:45 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14886a6>] ldiskfs_quota_write+0xc6/0x1e0 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff852b2a95>] qtree_write_dquot+0xd5/0x180
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff852b184b>] v2_write_dquot+0x2b/0x30
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff852ae36d>] dquot_commit+0xbd/0xd0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850a9aad>] ? internal_add_timer+0x7d/0xc0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: ll_ost01_057 D ffff98575a914100 0 96479 2 0x00000080
Mar 21 10:24:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: ll_ost_io01_046 D ffff98575a915140 0 96480 2 0x00000080
Mar 21 10:24:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: ll_ost03_009 S ffff98575a916180 0 96481 2 0x00000080
Mar 21 10:24:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:46 fir-io1-s1 kernel: ll_ost_io01_047 D ffff985761950000 0 96482 2 0x00000080
Mar 21 10:24:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:46 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: ll_ost_io02_037 D ffff985761951040 0 96483 2 0x00000080
Mar 21 10:24:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850e46ee>] ? load_balance+0x1be/0x9a0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: ll_ost_io03_018 D ffff985761952080 0 96484 2 0x00000080
Mar 21 10:24:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: ll_ost_io01_048 D ffff9857619530c0 0 96485 2 0x00000080
Mar 21 10:24:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: ll_ost_io02_038 D ffff985761954100 0 96486 2 0x00000080
Mar 21 10:24:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:47 fir-io1-s1 kernel: ll_ost_io01_049 D ffff985761955140 0 96487 2 0x00000080
Mar 21 10:24:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:47 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: ll_ost_io01_050 D ffff985761956180 0 96488 2 0x00000080
Mar 21 10:24:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: ll_ost_io02_039 D ffff985768ff8000 0 96489 2 0x00000080
Mar 21 10:24:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0d439f6>] ? kiblnd_queue_tx+0x36/0x50 [ko2iblnd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff851d82c8>] ? zone_statistics+0x88/0xa0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: ll_ost_io03_019 D ffff985768ff9040 0 96490 2 0x00000080
Mar 21 10:24:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: ll_ost01_058 S ffff985768ffa080 0 96491 2 0x00000080
Mar 21 10:24:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:48 fir-io1-s1 kernel: ll_ost_io02_040 D ffff985768ffb0c0 0 96492 2 0x00000080
Mar 21 10:24:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:48 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: ll_ost02_030 D ffff985768ffc100 0 96493 2 0x00000080
Mar 21 10:24:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff852b0d91>] dquot_free_inode+0xf1/0x180
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff852aee1a>] ? __dquot_initialize+0x3a/0x1c0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1495f17>] ldiskfs_free_inode+0xf7/0x610 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc146bd38>] ? ldiskfs_mark_iloc_dirty+0x68/0x80 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc146e312>] ? ldiskfs_evict_inode+0x472/0x630 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc146be5f>] ? ldiskfs_mark_inode_dirty+0x6f/0x210 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc146e41d>] ldiskfs_evict_inode+0x57d/0x630 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: ll_ost03_010 S ffff985768ffd140 0 96494 2 0x00000080
Mar 21 10:24:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: ll_ost_io02_041 D ffff985768ffe180 0 96495 2 0x00000080
Mar 21 10:24:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:49 fir-io1-s1 kernel: ll_ost_io03_020 D ffff9857564d8000 0 96496 2 0x00000080
Mar 21 10:24:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: ll_ost_io02_042 D ffff9857564d9040 0 96497 2 0x00000080
Mar 21 10:24:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: ll_ost_io03_021 D ffff9857564da080 0 96498 2 0x00000080
Mar 21 10:24:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: ll_ost00_026 D ffff9857564db0c0 0 96499 2 0x00000080
Mar 21 10:24:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: ll_ost_io00_032 D ffff9857564dc100 0 96500 2 0x00000080
Mar 21 10:24:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: ll_ost_io00_033 D ffff9857564dd140 0 96501 2 0x00000080
Mar 21 10:24:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: ll_ost_io02_043 D ffff9857564de180 0 96502 2 0x00000080
Mar 21 10:24:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850e46a8>] ? load_balance+0x178/0x9a0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: ll_ost_io03_022 D ffff9857569d8000 0 96503 2 0x00000080
Mar 21 10:24:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: ll_ost03_011 S ffff9857569d9040 0 96504 2 0x00000080
Mar 21 10:24:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: ll_ost03_012 D ffff9857569da080 0 96505 2 0x00000080
Mar 21 10:24:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: ll_ost00_027 S ffff9857569db0c0 0 96506 2 0x00000080
Mar 21 10:24:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: ll_ost02_031 S ffff9857569dc100 0 96507 2 0x00000080
Mar 21 10:24:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: ll_ost_io02_044 D ffff9857569dd140 0 96508 2 0x00000080
Mar 21 10:24:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: ll_ost_io00_034 D ffff9857569de180 0 96509 2 0x00000080
Mar 21 10:24:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: ll_ost_io03_023 D ffff985757db8000 0 96510 2 0x00000080
Mar 21 10:24:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:52 fir-io1-s1 kernel: ldlm_cn00_005 S ffff985757db9040 0 96511 2 0x00000080
Mar 21 10:24:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ldlm_cn00_006 S ffff985757dba080 0 96512 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost00_028 S ffff985757dbb0c0 0 96513 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost02_032 S ffff985757dbc100 0 96514 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost01_059 S ffff985757dbd140 0 96515 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost01_060 S ffff985757dbe180 0 96516 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost_io01_051 D ffff985757d00000 0 96517 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost00_029 S ffff985757d01040 0 96518 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost_io02_045 D ffff985757d02080 0 96519 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:53 fir-io1-s1 kernel: ll_ost_io01_052 D ffff985757d030c0 0 96520 2 0x00000080
Mar 21 10:24:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0d435f2>] ? kiblnd_check_sends_locked+0xa72/0xe40 [ko2iblnd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:53 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: ll_ost_io01_053 D ffff985757d04100 0 96521 2 0x00000080
Mar 21 10:24:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: ll_ost_io00_035 D ffff985757d05140 0 96522 2 0x00000080
Mar 21 10:24:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14f8330>] ? osd_trans_create+0xa0/0x620 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14ad8b9>] ldiskfs_fiemap+0x109/0x600 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1519187>] osd_is_mapped+0x157/0x1c0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc151dc92>] osd_declare_write_commit+0x182/0x530 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc16638b9>] ofd_commitrw_write+0x939/0x1d40 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850e46ee>] ? load_balance+0x1be/0x9a0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0a29207>] ? cfs_hash_bd_lookup_intent+0xf7/0x170 [libcfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: ll_ost01_061 D ffff985757d06180 0 96523 2 0x00000080
Mar 21 10:24:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: ll_ost01_062 S ffff985756d48000 0 96524 2 0x00000080
Mar 21 10:24:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:54 fir-io1-s1 kernel: ll_ost_io03_024 D ffff985756d49040 0 96525 2 0x00000080
Mar 21 10:24:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: ll_ost_io01_054 D ffff985756d4a080 0 96526 2 0x00000080
Mar 21 10:24:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: ll_ost_io02_046 D ffff985756d4b0c0 0 96527 2 0x00000080
Mar 21 10:24:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: ll_ost_io00_036 D ffff985756d4c100 0 96528 2 0x00000080
Mar 21 10:24:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:55 fir-io1-s1 kernel: ll_ost_io01_055 D ffff985756d4d140 0 96529 2 0x00000080
Mar 21 10:24:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:55 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: ll_ost_io00_037 D ffff985756d4e180 0 96530 2 0x00000080
Mar 21 10:24:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: ll_ost_io01_056 D ffff985757590000 0 96531 2 0x00000080
Mar 21 10:24:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: ll_ost_io01_057 D ffff985757591040 0 96532 2 0x00000080
Mar 21 10:24:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0ab573e>] ? lnet_ptl_attach_md+0x37e/0x530 [lnet]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:56 fir-io1-s1 kernel: ll_ost01_063 S ffff985757592080 0 96533 2 0x00000080
Mar 21 10:24:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:56 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: ll_ost_io00_038 D ffff9857575930c0 0 96534 2 0x00000080
Mar 21 10:24:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: ll_ost_io01_058 D ffff985757594100 0 96550 2 0x00000080
Mar 21 10:24:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: ll_ost_io02_047 D ffff985757595140 0 96551 2 0x00000080
Mar 21 10:24:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: ll_ost_io01_059 D ffff985757596180 0 96552 2 0x00000080
Mar 21 10:24:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:57 fir-io1-s1 kernel: ll_ost_io01_060 D ffff985766220000 0 96553 2 0x00000080
Mar 21 10:24:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:57 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: ll_ost_io00_039 D ffff985766221040 0 96554 2 0x00000080
Mar 21 10:24:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: ll_ost_io03_025 D ffff985766222080 0 96555 2 0x00000080
Mar 21 10:24:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff853667ca>] ? blk_throtl_bio+0xda/0x510
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:58 fir-io1-s1 kernel: ll_ost_io01_061 D ffff9857662230c0 0 96556 2 0x00000080
Mar 21 10:24:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0b81204>] ? class_handle2object+0x44/0x1c0 [obdclass]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost_io02_048 D ffff985766224100 0 96557 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost_io02_049 D ffff985766225140 0 96558 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost_io02_050 D ffff985766226180 0 96559 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost02_033 D ffff985761bbc100 0 96560 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost02_034 S ffff985761bba080 0 96561 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost02_035 S ffff985761bbd140 0 96562 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:24:59 fir-io1-s1 kernel: ll_ost_io03_026 D ffff985761bbb0c0 0 96563 2 0x00000080
Mar 21 10:24:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:24:59 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost02_036 D ffff985761bb9040 0 96564 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost00_030 S ffff985761bb8000 0 96565 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost02_037 D ffff985768e1a080 0 96566 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost00_031 S ffff985768e1e180 0 96567 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost02_038 S ffff985768e18000 0 96568 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost00_032 S ffff985768e1c100 0 96569 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost01_064 S ffff985768e19040 0 96570 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost02_039 S ffff985768e1d140 0 96571 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost01_065 S ffff985768e1b0c0 0 96572 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:00 fir-io1-s1 kernel: ll_ost01_066 S ffff985761f2e180 0 96573 2 0x00000080
Mar 21 10:25:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: ll_ost02_040 S ffff985761f2c100 0 96574 2 0x00000080
Mar 21 10:25:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: ll_ost_create00 S ffff985761f28000 0 96575 2 0x00000080
Mar 21 10:25:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: ll_ost_io02_051 D ffff985761f2b0c0 0 96576 2 0x00000080
Mar 21 10:25:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: ll_ost_io01_062 D ffff985761f29040 0 96577 2 0x00000080
Mar 21 10:25:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: ll_ost_io03_027 D ffff985761f2a080 0 96578 2 0x00000080
Mar 21 10:25:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff851b9500>] ? find_get_pages+0x1a0/0x1d0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:01 fir-io1-s1 kernel: ll_ost_io02_052 D ffff985761f2d140 0 96579 2 0x00000080
Mar 21 10:25:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: ll_ost_io01_063 D ffff985759448000 0 96580 2 0x00000080
Mar 21 10:25:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0d439f6>] ? kiblnd_queue_tx+0x36/0x50 [ko2iblnd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: ll_ost_io00_040 D ffff985759449040 0 96581 2 0x00000080
Mar 21 10:25:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: ll_ost_io00_041 D ffff98575944a080 0 96582 2 0x00000080
Mar 21 10:25:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: ll_ost01_067 D ffff98575944b0c0 0 96583 2 0x00000080
Mar 21 10:25:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0b9e80d>] ? htable_lookup+0xbd/0x130 [obdclass]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:02 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: ll_ost_io00_042 D ffff98575944c100 0 96584 2 0x00000080
Mar 21 10:25:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: Lustre: fir-OST0000: Export ffff983851c28400 already connecting from 10.9.102.18@o2ib4
Mar 21 10:25:03 fir-io1-s1 kernel: Lustre: Skipped 18 previous similar messages
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: ll_ost_io02_053 D ffff98575944d140 0 96585 2 0x00000080
Mar 21 10:25:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: ll_ost_io02_054 D ffff98575944e180 0 96586 2 0x00000080
Mar 21 10:25:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff853756d5>] ? cpumask_next_and+0x35/0x50
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc146a4a5>] ? ldiskfs_do_update_inode+0x525/0x810 [ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:03 fir-io1-s1 kernel: ll_ost_io01_064 D ffff9857594b0000 0 96587 2 0x00000080
Mar 21 10:25:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:03 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: ll_ost_io01_065 D ffff9857594b1040 0 96588 2 0x00000080
Mar 21 10:25:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: ll_ost_io03_028 D ffff9857594b2080 0 96589 2 0x00000080
Mar 21 10:25:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14684f1>] ldiskfs_map_blocks+0x71/0x700 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff851e02c7>] ? workingset_forget_node+0x27/0x50
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff851b717c>] ? add_to_page_cache_lru+0x5c/0xb0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc151b66e>] osd_read_prep+0x2de/0x400 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1666fb3>] ofd_preprw+0x803/0x1160 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: ll_ost_io02_055 D ffff9857594b30c0 0 96590 2 0x00000080
Mar 21 10:25:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: ll_ost_io01_066 D ffff9857594b4100 0 96591 2 0x00000080
Mar 21 10:25:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14886a6>] ldiskfs_quota_write+0xc6/0x1e0 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff852b2a95>] qtree_write_dquot+0xd5/0x180
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff852b184b>] v2_write_dquot+0x2b/0x30
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff852ae36d>] dquot_commit+0xbd/0xd0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: ll_ost_io03_029 D ffff9857594b5140 0 96592 2 0x00000080
Mar 21 10:25:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: ll_ost_io00_043 D ffff9857594b6180 0 96593 2 0x00000080
Mar 21 10:25:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff851cbaaa>] ? shrink_inactive_list+0x30a/0x5d0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: ll_ost_io03_030 D ffff985759510000 0 96594 2 0x00000080
Mar 21 10:25:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: ll_ost_io00_044 D ffff985759511040 0 96595 2 0x00000080
Mar 21 10:25:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: ll_ost_io01_067 D ffff985759512080 0 96596 2 0x00000080
Mar 21 10:25:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff851b9500>] ? find_get_pages+0x1a0/0x1d0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: ll_ost_io03_031 D ffff9857595130c0 0 96597 2 0x00000080
Mar 21 10:25:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: ll_ost_io02_056 D ffff985759514100 0 96598 2 0x00000080
Mar 21 10:25:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: ll_ost_io00_045 D ffff985759515140 0 96599 2 0x00000080
Mar 21 10:25:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: ll_ost_io01_068 D ffff985759516180 0 96600 2 0x00000080
Mar 21 10:25:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: ll_ost_io02_057 D ffff985766230000 0 96601 2 0x00000080
Mar 21 10:25:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14684f1>] ldiskfs_map_blocks+0x71/0x700 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff851b7a69>] ? delete_from_page_cache+0x69/0x80
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc151b66e>] osd_read_prep+0x2de/0x400 [osd_ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc1666fb3>] ofd_preprw+0x803/0x1160 [ofd]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:07 fir-io1-s1 kernel: ll_ost_io03_032 D ffff985766231040 0 96602 2 0x00000080
Mar 21 10:25:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: ll_ost_io02_058 D ffff985766232080 0 96603 2 0x00000080
Mar 21 10:25:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850e46a8>] ? load_balance+0x178/0x9a0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: ll_ost_io03_033 D ffff9857662330c0 0 96604 2 0x00000080
Mar 21 10:25:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc149924a>] ? ldiskfs_es_lookup_extent+0x2a/0x180 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: ll_ost00_033 S ffff985766234100 0 96605 2 0x00000080
Mar 21 10:25:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:08 fir-io1-s1 kernel: ll_ost_io03_034 D ffff985766235140 0 96606 2 0x00000080
Mar 21 10:25:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:08 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ll_ost_io00_046 D ffff985766236180 0 96607 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ll_ost_io01_069 D ffff9857594e0000 0 96608 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ll_ost_io02_059 D ffff9857594e1040 0 96609 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ldlm_cn02_006 S ffff9857594e2080 0 96610 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ll_ost01_068 S ffff9857594e30c0 0 96611 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ll_ost02_041 S ffff9857594e4100 0 96612 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:09 fir-io1-s1 kernel: ll_ost_io02_060 D ffff9857594e5140 0 96613 2 0x00000080
Mar 21 10:25:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:09 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: ll_ost02_042 S ffff9857594e6180 0 96614 2 0x00000080
Mar 21 10:25:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: ll_ost01_069 S ffff985759550000 0 96615 2 0x00000080
Mar 21 10:25:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: ll_ost_io00_047 D ffff985759551040 0 96616 2 0x00000080
Mar 21 10:25:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: ll_ost_io03_035 D ffff985759552080 0 96617 2 0x00000080
Mar 21 10:25:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: ll_ost_io01_070 D ffff9857595530c0 0 96618 2 0x00000080
Mar 21 10:25:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff851d90c0>] ? wait_iff_congested+0xb0/0x150
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14886a6>] ldiskfs_quota_write+0xc6/0x1e0 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff852b2a95>] qtree_write_dquot+0xd5/0x180
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff852b184b>] v2_write_dquot+0x2b/0x30
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff852ae36d>] dquot_commit+0xbd/0xd0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:10 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: ll_ost01_070 D ffff985759554100 0 96619 2 0x00000080
Mar 21 10:25:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff851bf48e>] ? free_pcppages_bulk+0x17e/0x3a0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc148e2c9>] ? __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc146d4b7>] ldiskfs_truncate+0x1a7/0x3f0 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc146e42a>] ldiskfs_evict_inode+0x58a/0x630 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: ll_ost01_071 D ffff985759555140 0 96620 2 0x00000080
Mar 21 10:25:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: ll_ost_io00_048 D ffff985759556180 0 96621 2 0x00000080
Mar 21 10:25:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: ll_ost_io01_071 D ffff985759698000 0 96622 2 0x00000080
Mar 21 10:25:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff851b9500>] ? find_get_pages+0x1a0/0x1d0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:11 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: ll_ost_io03_036 D ffff985759699040 0 96623 2 0x00000080
Mar 21 10:25:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: ll_ost_io02_061 D ffff98575969a080 0 96624 2 0x00000080
Mar 21 10:25:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850dc766>] ? select_task_rq_fair+0x5a6/0x760
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc146a4a5>] ? ldiskfs_do_update_inode+0x525/0x810 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: ll_ost_io01_072 D ffff98575969b0c0 0 96625 2 0x00000080
Mar 21 10:25:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: ll_ost_io00_049 D ffff98575969c100 0 96626 2 0x00000080
Mar 21 10:25:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc03ef9cf>] ? begin_wqe+0x3f/0x140 [mlx5_ib]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:12 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc14fd699>] ? osd_attr_set+0x199/0xb90 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc166092b>] ofd_object_punch+0x4cb/0xd30 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: ll_ost_io01_073 D ffff98575969d140 0 96627 2 0x00000080
Mar 21 10:25:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: ll_ost_io02_062 D ffff98575969e180 0 96628 2 0x00000080
Mar 21 10:25:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: ll_ost_io00_050 D ffff985764cd8000 0 96629 2 0x00000080
Mar 21 10:25:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc14684f1>] ldiskfs_map_blocks+0x71/0x700 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff851b7a69>] ? delete_from_page_cache+0x69/0x80
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc151b66e>] osd_read_prep+0x2de/0x400 [osd_ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc1666fb3>] ofd_preprw+0x803/0x1160 [ofd]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e121bd>] ? null_alloc_rs+0x16d/0x340 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: ll_ost_io03_037 D ffff985764cd9040 0 96630 2 0x00000080
Mar 21 10:25:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:13 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: ll_ost_io00_051 D ffff985764cda080 0 96631 2 0x00000080
Mar 21 10:25:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: ll_ost_io02_063 D ffff985764cdb0c0 0 96632 2 0x00000080
Mar 21 10:25:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: ll_ost_io01_074 D ffff985764cdc100 0 96633 2 0x00000080
Mar 21 10:25:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: ll_ost01_072 D ffff985764cdd140 0 96634 2 0x00000080
Mar 21 10:25:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: ll_ost_io01_075 D ffff985764cde180 0 96635 2 0x00000080
Mar 21 10:25:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: ll_ost_io00_052 D ffff985766730000 0 96636 2 0x00000080
Mar 21 10:25:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: ll_ost_io02_064 D ffff985766731040 0 96637 2 0x00000080
Mar 21 10:25:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff851b9500>] ? find_get_pages+0x1a0/0x1d0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:15 fir-io1-s1 kernel: ll_ost_io00_053 D ffff985766732080 0 96638 2 0x00000080
Mar 21 10:25:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: ll_ost_io02_065 D ffff9857667330c0 0 96639 2 0x00000080
Mar 21 10:25:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: ll_ost_io00_054 D ffff985766734100 0 96640 2 0x00000080
Mar 21 10:25:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: ll_ost_io00_055 D ffff985766735140 0 96641 2 0x00000080
Mar 21 10:25:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:16 fir-io1-s1 kernel: ll_ost_io01_076 D ffff985766736180 0 96642 2 0x00000080
Mar 21 10:25:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff851cbaaa>] ? shrink_inactive_list+0x30a/0x5d0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: ll_ost_io02_066 D ffff985759008000 0 96643 2 0x00000080
Mar 21 10:25:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: ll_ost_io02_067 D ffff985759009040 0 96644 2 0x00000080
Mar 21 10:25:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: ll_ost_io01_077 D ffff98575900a080 0 96645 2 0x00000080
Mar 21 10:25:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0d439f6>] ? kiblnd_queue_tx+0x36/0x50 [ko2iblnd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff851d82c8>] ? zone_statistics+0x88/0xa0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:17 fir-io1-s1 kernel: ll_ost_io02_068 D ffff98575900b0c0 0 96646 2 0x00000080
Mar 21 10:25:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:17 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850e1278>] ? check_preempt_wakeup+0x148/0x250
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: ll_ost_io01_078 D ffff98575900c100 0 96647 2 0x00000080
Mar 21 10:25:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: ll_ost_io01_079 D ffff98575900d140 0 96648 2 0x00000080
Mar 21 10:25:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: ll_ost_io02_069 D ffff98575900e180 0 96649 2 0x00000080
Mar 21 10:25:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: ll_ost_io02_070 D ffff985759050000 0 96650 2 0x00000080
Mar 21 10:25:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:18 fir-io1-s1 kernel: ll_ost_io02_071 D ffff985759051040 0 96651 2 0x00000080
Mar 21 10:25:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:18 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: ll_ost_io03_038 D ffff985759052080 0 96652 2 0x00000080
Mar 21 10:25:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: ll_ost_io01_080 D ffff9857590530c0 0 96653 2 0x00000080
Mar 21 10:25:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: ll_ost_io00_056 D ffff985759054100 0 96654 2 0x00000080
Mar 21 10:25:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: ll_ost_io00_057 D ffff985759055140 0 96655 2 0x00000080
Mar 21 10:25:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: ll_ost_io02_072 D ffff985759056180 0 96656 2 0x00000080
Mar 21 10:25:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: ll_ost_io02_073 D ffff985759638000 0 96657 2 0x00000080
Mar 21 10:25:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: ll_ost_io02_074 D ffff985759639040 0 96658 2 0x00000080
Mar 21 10:25:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: ll_ost_io01_081 D ffff98575963a080 0 96659 2 0x00000080
Mar 21 10:25:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: ll_ost_io03_039 D ffff98575963b0c0 0 96660 2 0x00000080
Mar 21 10:25:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: ll_ost_io01_082 D ffff98575963c100 0 96661 2 0x00000080
Mar 21 10:25:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:21 fir-io1-s1 kernel: ll_ost_io01_083 D ffff98575963d140 0 96662 2 0x00000080
Mar 21 10:25:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: ll_ost_io01_084 D ffff98575963e180 0 96663 2 0x00000080
Mar 21 10:25:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: ll_ost_io03_040 D ffff985756560000 0 96664 2 0x00000080
Mar 21 10:25:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc14684f1>] ldiskfs_map_blocks+0x71/0x700 [ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff851b7a69>] ? delete_from_page_cache+0x69/0x80
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc151b66e>] osd_read_prep+0x2de/0x400 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1666fb3>] ofd_preprw+0x803/0x1160 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: ll_ost_io01_085 D ffff985756561040 0 96665 2 0x00000080
Mar 21 10:25:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: ll_ost_io03_041 D ffff985756562080 0 96666 2 0x00000080
Mar 21 10:25:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:22 fir-io1-s1 kernel: ll_ost_io03_042 D ffff9857565630c0 0 96667 2 0x00000080
Mar 21 10:25:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:22 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: ll_ost_io01_086 D ffff985756564100 0 96668 2 0x00000080
Mar 21 10:25:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: ll_ost_io01_087 D ffff985756565140 0 96669 2 0x00000080
Mar 21 10:25:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: ll_ost_io01_088 D ffff985756566180 0 96670 2 0x00000080
Mar 21 10:25:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: ll_ost_io01_089 D ffff985753410000 0 96671 2 0x00000080
Mar 21 10:25:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: ll_ost_io01_090 D ffff985753411040 0 96672 2 0x00000080
Mar 21 10:25:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0ab573e>] ? lnet_ptl_attach_md+0x37e/0x530 [lnet]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: ll_ost_io01_091 D ffff985753412080 0 96673 2 0x00000080
Mar 21 10:25:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: ll_ost_io01_092 D ffff9857534130c0 0 96674 2 0x00000080
Mar 21 10:25:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff851b92be>] ? __find_get_pages+0x11e/0x1c0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc151e59c>] osd_punch+0x28c/0x6b0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: ll_ost_io01_093 D ffff985753414100 0 96675 2 0x00000080
Mar 21 10:25:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:24 fir-io1-s1 kernel: ll_ost_io01_094 D ffff985753415140 0 96676 2 0x00000080
Mar 21 10:25:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:24 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: ll_ost_io01_095 D ffff985810fe2080 0 96677 2 0x00000080
Mar 21 10:25:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14f8330>] ? osd_trans_create+0xa0/0x620 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14ad8b9>] ldiskfs_fiemap+0x109/0x600 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1519187>] osd_is_mapped+0x157/0x1c0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc151dc92>] osd_declare_write_commit+0x182/0x530 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc16638b9>] ofd_commitrw_write+0x939/0x1d40 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: ll_ost_io01_096 D ffff985810fe30c0 0 96678 2 0x00000080
Mar 21 10:25:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: ll_ost_io01_097 D ffff9857697aa080 0 96679 2 0x00000080
Mar 21 10:25:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:25 fir-io1-s1 kernel: ll_ost_io01_098 D ffff9857697a8000 0 96680 2 0x00000080
Mar 21 10:25:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:25 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: ll_ost_io01_099 D ffff9857697ac100 0 96681 2 0x00000080
Mar 21 10:25:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: ll_ost_io01_100 D ffff9857697ae180 0 96682 2 0x00000080
Mar 21 10:25:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: ll_ost_io01_101 D ffff9857697ad140 0 96683 2 0x00000080
Mar 21 10:25:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:26 fir-io1-s1 kernel: ll_ost_io01_102 D ffff9857697a9040 0 96684 2 0x00000080
Mar 21 10:25:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:26 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: ll_ost_io01_103 D ffff9857697ab0c0 0 96685 2 0x00000080
Mar 21 10:25:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: ll_ost_io01_104 D ffff98574f808000 0 96686 2 0x00000080
Mar 21 10:25:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: ll_ost_io01_105 D ffff98574f809040 0 96687 2 0x00000080
Mar 21 10:25:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:27 fir-io1-s1 kernel: ll_ost_io01_106 D ffff98574f80a080 0 96688 2 0x00000080
Mar 21 10:25:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:27 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: ll_ost_io01_107 D ffff98574f80b0c0 0 96689 2 0x00000080
Mar 21 10:25:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: ll_ost_io01_108 D ffff98574f80c100 0 96690 2 0x00000080
Mar 21 10:25:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: ll_ost_io01_109 D ffff98574f80d140 0 96691 2 0x00000080
Mar 21 10:25:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1467703>] ? __ldiskfs_get_inode_loc+0xe3/0x3c0 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852ad3ba>] dquot_acquire+0x3a/0x150
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485ad6>] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852b13c4>] dquot_transfer+0x64/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:28 fir-io1-s1 kernel: ll_ost_io01_110 D ffff98574f80e180 0 96692 2 0x00000080
Mar 21 10:25:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:28 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: ll_ost_io01_111 D ffff98574f648000 0 96693 2 0x00000080
Mar 21 10:25:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: ll_ost_io03_043 D ffff98574f649040 0 96712 2 0x00000080
Mar 21 10:25:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: ll_ost_create02 S ffff98574f64a080 0 96747 2 0x00000080
Mar 21 10:25:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: ll_ost_create00 S ffff98574f64b0c0 0 96748 2 0x00000080
Mar 21 10:25:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: ll_ost02_043 S ffff98574f64c100 0 96749 2 0x00000080
Mar 21 10:25:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost03_013 S ffff98574f64d140 0 96750 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost03_014 S ffff98574f64e180 0 96751 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost02_044 S ffff98575bc48000 0 96752 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost02_045 S ffff98575bc4c100 0 96753 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost00_034 S ffff98575bc49040 0 96754 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost02_046 S ffff98575bc4a080 0 96755 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost03_015 S ffff98575bc4d140 0 96756 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost02_047 D ffff98575bc4b0c0 0 96757 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost02_048 D ffff985836f230c0 0 96758 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost03_016 S ffff985761b830c0 0 96759 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:30 fir-io1-s1 kernel: ll_ost00_035 S ffff985761b86180 0 96760 2 0x00000080
Mar 21 10:25:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: ll_ost00_036 D ffff985761b82080 0 96761 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0d44987>] ? kiblnd_send+0x357/0xa20 [ko2iblnd]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0ab80e4>] ? lnet_ni_send+0x44/0xd0 [lnet]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: ll_ost00_037 S ffff985761b81040 0 96762 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: ll_ost00_038 S ffff985761b85140 0 96763 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task kswapd0:277 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: ll_ost00_039 S
Mar 21 10:25:31 fir-io1-s1 kernel: kswapd0 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98483c4d30c0
Mar 21 10:25:31 fir-io1-s1 kernel: 0 277 2 0x00000000
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1485a2c>] ? ldiskfs_release_dquot+0x5c/0xa0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1485a2c>] ldiskfs_release_dquot+0x5c/0xa0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852ae73d>] dqput+0xbd/0x1f0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852afd85>] __dquot_drop+0x55/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852afdcd>] dquot_drop+0x2d/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc148a352>] ldiskfs_clear_inode+0x22/0x90 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc146df3f>] ldiskfs_evict_inode+0x9f/0x630 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8525ebae>] dispose_list+0x3e/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8525fbbc>] prune_icache_sb+0x17c/0x330
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85243fc3>] prune_super+0x173/0x190
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851c9da5>] shrink_slab+0x175/0x340
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852374c1>] ? vmpressure+0x21/0x90
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851cdba1>] balance_pgdat+0x4b1/0x5e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851cde43>] kswapd+0x173/0x440
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851cdcd0>] ? balance_pgdat+0x5e0/0x5e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task kswapd1:278 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: kswapd1 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98483c4d4100
Mar 21 10:25:31 fir-io1-s1 kernel: 0 278 2 0x00000000
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1485a2c>] ? ldiskfs_release_dquot+0x5c/0xa0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1485a2c>] ldiskfs_release_dquot+0x5c/0xa0 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852ae73d>] dqput+0xbd/0x1f0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852afd85>] __dquot_drop+0x55/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff852afdcd>] dquot_drop+0x2d/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc148a352>] ldiskfs_clear_inode+0x22/0x90 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc146df3f>] ldiskfs_evict_inode+0x9f/0x630 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8525ebae>] dispose_list+0x3e/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8525fbbc>] prune_icache_sb+0x17c/0x330
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85243fc3>] prune_super+0x173/0x190
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851c9da5>] shrink_slab+0x175/0x340
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851dddfb>] ? compaction_suitable+0x5b/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851cdba1>] balance_pgdat+0x4b1/0x5e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851cde43>] kswapd+0x173/0x440
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff851cdcd0>] ? balance_pgdat+0x5e0/0x5e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task md0_raid6:91761 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: md0_raid6 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98581af3e180
Mar 21 10:25:31 fir-io1-s1 kernel: 0 91761 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task md10_raid6:91871 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: md10_raid6 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98582065b0c0
Mar 21 10:25:31 fir-io1-s1 kernel: 0 91871 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task md6_raid6:92157 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: md6_raid6 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98581af39040
Mar 21 10:25:31 fir-io1-s1 kernel: 0 92157 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task md2_raid6:92247 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: md2_raid6 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff9858112530c0
Mar 21 10:25:31 fir-io1-s1 kernel: 0 92247 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task md4_raid6:92431 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: md4_raid6 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98483bc05140
Mar 21 10:25:31 fir-io1-s1 kernel: 0 92431 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task md8_raid6:92616 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: md8_raid6 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff98483bc01040
Mar 21 10:25:31 fir-io1-s1 kernel: 0 92616 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8537a9c5>] percpu_ref_switch_to_atomic_sync+0x65/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558c2b7>] set_in_sync+0x67/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8559403f>] md_check_recovery+0x27f/0x500
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc11c73b6>] raid5d+0x56/0x670 [raid456]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765670>] ? schedule_timeout+0x170/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task kmmpd-md0:94156 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: kmmpd-md0 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff9857e60ce180
Mar 21 10:25:31 fir-io1-s1 kernel: 0 94156 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: INFO: task kmmpd-md10:94157 blocked for more than 120 seconds.
Mar 21 10:25:31 fir-io1-s1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 21 10:25:31 fir-io1-s1 kernel: kmmpd-md10 D
Mar 21 10:25:31 fir-io1-s1 kernel: ffff9857e60cd140
Mar 21 10:25:31 fir-io1-s1 kernel: 0 94157 2 0x00000080
Mar 21 10:25:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff8558d330>] ? md_handle_request+0xd0/0x150
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85278f0a>] __wait_on_buffer+0x2a/0x30
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc149439d>] write_mmp_block+0x11d/0x160 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc14945f8>] kmmpd+0x1a8/0x430 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffffc1494450>] ? __dump_mmp_msg+0x70/0x70 [ldiskfs]
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:32 fir-io1-s1 kernel: Lustre: fir-OST0002: Export ffff983851c2e400 already connecting from 10.8.26.6@o2ib6
Mar 21 10:25:32 fir-io1-s1 kernel: Lustre: Skipped 2 previous similar messages
Mar 21 10:25:32 fir-io1-s1 kernel: ffff985761b80000
Mar 21 10:25:32 fir-io1-s1 kernel: 0 96764 2 0x00000080
Mar 21 10:25:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:32 fir-io1-s1 kernel: ll_ost00_040 S ffff985761b84100 0 96765 2 0x00000080
Mar 21 10:25:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:32 fir-io1-s1 kernel: ll_ost02_049 D ffff9857686f5140 0 96766 2 0x00000080
Mar 21 10:25:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_041 S ffff9857686f0000 0 96767 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_042 D ffff9857686f2080 0 96768 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff852ad3ba>] dquot_acquire+0x3a/0x150
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc1485ad6>] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_043 S ffff9857686f6180 0 96769 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_044 S ffff9857686f1040 0 96770 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_045 D ffff9857686f30c0 0 96771 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_046 S ffff9857686f4100 0 96772 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost03_017 S ffff985761bbe180 0 96773 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: ll_ost00_047 D ffff98574c6b5140 0 96774 2 0x00000080
Mar 21 10:25:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0b9e80d>] ? htable_lookup+0xbd/0x130 [obdclass]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost00_048 S ffff98574c6b6180 0 96775 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost02_050 D ffff98574c6b4100 0 96776 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost03_018 D ffff98574c6b30c0 0 96777 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost01_073 S ffff98574c6b2080 0 96778 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost00_049 S ffff98574c6b1040 0 96779 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost02_051 S ffff98574c6b0000 0 96780 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost01_074 S ffff9857283d0000 0 96781 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost01_075 D ffff9857283d1040 0 96782 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:34 fir-io1-s1 kernel: ll_ost01_076 D ffff9857283d2080 0 96783 2 0x00000080
Mar 21 10:25:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff852b0d91>] dquot_free_inode+0xf1/0x180
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff852aee1a>] ? __dquot_initialize+0x3a/0x1c0
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc1495f17>] ldiskfs_free_inode+0xf7/0x610 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc146bd38>] ? ldiskfs_mark_iloc_dirty+0x68/0x80 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc146e312>] ? ldiskfs_evict_inode+0x472/0x630 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc146be5f>] ? ldiskfs_mark_inode_dirty+0x6f/0x210 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc146e41d>] ldiskfs_evict_inode+0x57d/0x630 [ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost00_050 D ffff9857283d30c0 0 96784 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost00_051 S ffff9857283d4100 0 96785 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost02_052 D ffff9857283d5140 0 96786 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850e1296>] ? check_preempt_wakeup+0x166/0x250
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost01_077 D ffff9857283d6180 0 96787 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost02_053 S ffff985765fd8000 0 96788 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost03_019 S ffff985765fd9040 0 96789 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: ll_ost03_020 D ffff985765fda080 0 96790 2 0x00000080
Mar 21 10:25:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:35 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost_create01 S ffff985765fdc100 0 96854 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost00_052 S ffff985765fdd140 0 96886 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost00_053 S ffff985765fde180 0 96887 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost01_078 S ffff985765fdb0c0 0 96888 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost00_054 D ffff9856fbf6a080 0 96889 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0b9e80d>] ? htable_lookup+0xbd/0x130 [obdclass]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost01_079 S ffff9856fbf6b0c0 0 96890 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost01_080 D ffff9856fbf6d140 0 96891 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost01_081 D ffff9856fbf69040 0 96892 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:36 fir-io1-s1 kernel: ll_ost01_082 D ffff9856fbf68000 0 96893 2 0x00000080
Mar 21 10:25:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost01_083 S ffff9856fbf6c100 0 96894 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost01_084 S ffff9856fbf6e180 0 96895 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost00_055 D ffff98570cde0000 0 96896 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost01_085 D ffff98570cde30c0 0 96897 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc165fd83>] ofd_attr_set+0x473/0xb50 [ofd]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc165271d>] ofd_setattr_hdl+0x31d/0x8f0 [ofd]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost01_086 S ffff98570cde6180 0 96898 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost00_056 S ffff98570cde5140 0 96899 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost01_087 D ffff98570cde4100 0 96900 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:37 fir-io1-s1 kernel: ll_ost_create00 S ffff98570cde2080 0 96901 2 0x00000080
Mar 21 10:25:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost02_054 D ffff98570cde1040 0 96902 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost00_057 D ffff98575e448000 0 96903 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost01_088 D ffff98575e449040 0 96904 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost00_058 S ffff98575e44a080 0 96905 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost01_089 D ffff98575e44b0c0 0 96906 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost01_090 D ffff98575e44c100 0 96907 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost00_059 S ffff98575e44d140 0 96908 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:38 fir-io1-s1 kernel: ll_ost01_091 S ffff98575e44e180 0 96909 2 0x00000080
Mar 21 10:25:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:38 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost00_060 S ffff98575e4b0000 0 96910 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost02_055 D ffff98575e4b1040 0 96911 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost01_092 S ffff98575e4b2080 0 96912 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost01_093 D ffff985753416180 0 96913 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost00_061 D ffff98575e508000 0 96914 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost01_094 S ffff98575e509040 0 96915 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost01_095 D ffff98575e50a080 0 96916 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost00_062 S ffff98575e50b0c0 0 96917 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost01_096 S ffff98575e50c100 0 96918 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:39 fir-io1-s1 kernel: ll_ost00_063 S ffff98569bf45140 0 96919 2 0x00000080
Mar 21 10:25:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ll_ost01_097 D ffff98569bf40000 0 96920 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff8521a849>] ? ___slab_alloc+0x209/0x4f0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ll_ost00_064 D ffff98569bf41040 0 96921 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ll_ost01_098 D ffff98569bf44100 0 96922 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c4934>] ? __jbd2_journal_file_buffer+0xe4/0x220 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc148e2c9>] ? __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc146d4b7>] ldiskfs_truncate+0x1a7/0x3f0 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc146e42a>] ldiskfs_evict_inode+0x58a/0x630 [ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ldlm_cn01_005 S ffff98569bf430c0 0 96923 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ll_ost00_065 S ffff98569bf42080 0 96924 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ll_ost01_099 D ffff98569bf46180 0 96925 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:40 fir-io1-s1 kernel: ll_ost01_100 D ffff985657a40000 0 96926 2 0x00000080
Mar 21 10:25:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:25:40 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost01_101 S ffff98575e4b30c0 0 96927 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost01_102 D ffff98575e4b4100 0 96928 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost01_103 D ffff98575e4b5140 0 96929 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost01_104 S ffff98575e4b6180 0 96930 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost01_105 S ffff9856574f0000 0 96931 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost02_056 S ffff9856574f1040 0 96932 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost02_057 S ffff9856574f2080 0 96933 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost01_106 S ffff9856574f30c0 0 96934 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost02_058 S ffff9856574f4100 0 96935 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:41 fir-io1-s1 kernel: ll_ost02_059 S ffff9856574f5140 0 96936 2 0x00000080
Mar 21 10:25:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0b80a51>] ? lprocfs_counter_sub+0xc1/0x130 [obdclass]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0a1dea1>] ? cfs_block_sigsinv+0x71/0xa0 [libcfs]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da4860>] ? ldlm_completion_ast_async+0x300/0x300 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da5031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0d8bf6f>] ? ldlm_lock_enqueue+0x40f/0xa60 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da3092>] ? ldlm_interval_alloc+0xa2/0x260 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da5dcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc16596ad>] ofd_destroy_by_fid+0x1dd/0x4a0 [ofd]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:41 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: ll_ost02_060 D ffff9856574f6180 0 96937 2 0x00000080
Mar 21 10:25:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: ldlm_cn03_003 S ffff985762dd8000 0 96938 2 0x00000080
Mar 21 10:25:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: ll_ost01_107 D ffff985762dd9040 0 96939 2 0x00000080
Mar 21 10:25:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0ac019c>] ? LNetPut+0x2cc/0xb50 [lnet]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff852aeb2f>] dqget+0x19f/0x450
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: ll_ost01_108 D ffff985762dda080 0 96940 2 0x00000080
Mar 21 10:25:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0b9e80d>] ? htable_lookup+0xbd/0x130 [obdclass]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff8521a849>] ? ___slab_alloc+0x209/0x4f0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e3346a>] ? tgt_new_client_cb_add+0x2a/0x370 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: ll_ost01_109 D ffff985762ddb0c0 0 96941 2 0x00000080
Mar 21 10:25:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:42 fir-io1-s1 kernel: ll_ost01_110 D ffff985762ddc100 0 96942 2 0x00000080
Mar 21 10:25:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff852b0d91>] dquot_free_inode+0xf1/0x180
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff852aee1a>] ? __dquot_initialize+0x3a/0x1c0
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc1495f17>] ldiskfs_free_inode+0xf7/0x610 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc146bd38>] ? ldiskfs_mark_iloc_dirty+0x68/0x80 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc146e312>] ? ldiskfs_evict_inode+0x472/0x630 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc146be5f>] ? ldiskfs_mark_inode_dirty+0x6f/0x210 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc146e41d>] ldiskfs_evict_inode+0x57d/0x630 [ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:25:42 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost01_111 D ffff985762ddd140 0 96943 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff853a0160>] ? __percpu_counter_sum+0x70/0x80
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost02_061 S ffff985762dde180 0 96944 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost02_062 D ffff98575e50d140 0 96945 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff852aeb2f>] dqget+0x19f/0x450
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost02_063 D ffff98575e50e180 0 96946 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost02_064 S ffff985762960000 0 96947 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost02_065 S ffff985762961040 0 96948 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: ll_ost03_021 D ffff985762962080 0 96949 2 0x00000080
Mar 21 10:25:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff8521a849>] ? ___slab_alloc+0x209/0x4f0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_022 S ffff9857629630c0 0 96950 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_023 D ffff985762964100 0 97126 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850e3ce4>] ? find_busiest_group+0x144/0x990
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_024 S ffff985762965140 0 97127 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_025 S ffff985762966180 0 97128 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_026 D ffff98580eb630c0 0 97129 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff853a0160>] ? __percpu_counter_sum+0x70/0x80
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_027 D ffff98580eb65140 0 97130 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_028 S ffff98580eb62080 0 97131 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_029 S ffff9857692b1040 0 97132 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_030 S ffff9857692b2080 0 97133 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:44 fir-io1-s1 kernel: ll_ost03_031 S ffff9857692b4100 0 97134 2 0x00000080
Mar 21 10:25:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ll_ost03_032 S ffff9857692b6180 0 97135 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_bl_04 S ffff98483c64b0c0 0 97745 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn01_006 S ffff98520f786180 0 98392 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn00_007 S ffff985333069040 0 100087 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn03_004 S ffff985657a430c0 0 101264 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_bl_05 S ffff98556452d140 0 103799 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_bl_06 S ffff98556452a080 0 103800 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_bl_07 S ffff98556452b0c0 0 103801 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn01_007 S ffff984a87cea080 0 108513 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn03_005 S ffff984a87ce9040 0 114121 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn01_008 S ffff984a87cee180 0 114630 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn02_007 S ffff98483c58a080 0 116993 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn02_008 S ffff9852612ae180 0 116994 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn01_009 S ffff9852612a8000 0 116995 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:45 fir-io1-s1 kernel: ldlm_cn02_009 D ffff9852612ad140 0 117022 2 0x00000080
Mar 21 10:25:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:25:45 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc166bae7>] ofd_lvbo_update+0x577/0xdf0 [ofd]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0db0e29>] ldlm_request_cancel+0x3c9/0x740 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0db597a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0db5c68>] ldlm_cancel_handler+0x158/0x590 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn02_010 S ffff9852612ab0c0 0 117023 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_010 S ffff9852612a9040 0 117024 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn02_011 S ffff9852612ac100 0 117025 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_011 S ffff9852612aa080 0 117026 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_012 S ffff985724269040 0 117027 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_013 S ffff98572426e180 0 117028 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_014 S ffff98572426b0c0 0 117029 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_015 S ffff98572426c100 0 117030 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_016 S ffff98572426a080 0 117031 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn02_012 S ffff985724268000 0 117032 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn00_008 S ffff98572426d140 0 117033 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: ldlm_cn01_017 S ffff98520f7830c0 0 117034 2 0x00000080
Mar 21 10:25:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn02_013 S ffff98520f781040 0 117035 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn00_009 S ffff98520f782080 0 117036 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn02_014 S ffff98520f780000 0 117037 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_018 S ffff98520f785140 0 117038 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_019 S ffff985564528000 0 117039 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn02_015 S ffff98556452c100 0 117040 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn00_010 S ffff98556452e180 0 117041 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_020 S ffff984a87ceb0c0 0 117067 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_021 S ffff984a87ce8000 0 117068 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_022 S ffff984a87cec100 0 117069 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_023 S ffff9854d6568000 0 117070 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn00_011 S ffff9854d656c100 0 117071 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn00_012 S ffff9854d656e180 0 117072 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn00_013 S ffff9854d656d140 0 117073 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de692b>] ? ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ? ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ? ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] ? kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ? ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: ldlm_cn01_024 S ffff9854d656a080 0 117092 2 0x00000080
Mar 21 10:25:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_025 S ffff9854d6569040 0 117093 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_026 S ffff98533306c100 0 117094 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_027 S ffff98533306d140 0 117095 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_028 S ffff985333068000 0 117096 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn00_014 S ffff98533306a080 0 117133 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn00_015 S ffff98533306e180 0 117134 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn00_016 S ffff98533306b0c0 0 117135 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_029 S ffff9850d153d140 0 117136 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn02_016 S ffff9850d153a080 0 117137 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_030 S ffff9850d153e180 0 117138 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn01_031 S ffff9850d153b0c0 0 117139 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn02_017 S ffff9850d1539040 0 117140 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn02_018 S ffff9850d153c100 0 117141 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn02_019 S ffff9850d1538000 0 117142 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: ldlm_cn02_020 S ffff98396961b0c0 0 117143 2 0x00000080
Mar 21 10:25:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_cn00_017 S ffff9850d1efd140 0 117144 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_cn00_018 S ffff9850d1efb0c0 0 117145 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_cb02_002 S ffff9850d1ff9040 0 122270 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_bl_08 S ffff9850b9649040 0 2745 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_cn03_006 S ffff9850b9529040 0 62893 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_cn03_007 S ffff9850b952e180 0 6146 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: kdmflush S ffff984836b25140 0 16315 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: bioset S ffff984836b20000 0 16318 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850ba32e>] rescuer_thread+0x31e/0x3c0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850ba010>] ? process_one_work+0x440/0x440
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: kdmwork-253:119 S ffff9850b952a080 0 16319 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c2067>] kthread_worker_fn+0xf7/0x180
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1f70>] ? kthread_stop+0xf0/0xf0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: kworker/38:0 S ffff986816c60000 0 81923 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_cn03_008 S ffff9868143bb0c0 0 42674 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_bl_09 S ffff9860f3b58000 0 99090 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: crond S ffff986817fee180 0 12673 72591 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8524a990>] pipe_wait+0x70/0xc0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8524b218>] pipe_read+0x298/0x400
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85240743>] do_sync_read+0x93/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8524117f>] vfs_read+0x9f/0x170
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8524203f>] SyS_read+0x7f/0xf0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:25:49 fir-io1-s1 kernel: raid-check S ffff98783b3cb0c0 0 12675 12673 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8509d516>] do_wait+0x1f6/0x260
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8509e710>] SyS_wait4+0x80/0x110
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff8509c170>] ? task_stopped_code+0x60/0x60
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:25:49 fir-io1-s1 kernel: ll_ost_create02 S ffff987837664100 0 21695 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: ldlm_bl_10 S ffff987815ab2080 0 122452 2 0x00000080
Mar 21 10:25:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: ldlm_cn03_009 S ffff983a6da96180 0 56012 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: ldlm_cb02_003 S ffff98581abbd140 0 5818 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: kworker/11:0 S ffff987838300000 0 62312 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: ll_ost_io00_058 D ffff984772ae5140 0 73053 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: ll_ost_io00_059 D ffff984772ae4100 0 73054 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: ll_ost_io00_060 D ffff984772ae0000 0 73055 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:50 fir-io1-s1 kernel: ll_ost_io00_061 D ffff984772ae2080 0 73056 2 0x00000080
Mar 21 10:25:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff8527e379>] ? bvec_alloc+0x59/0x120
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:50 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0a29207>] ? cfs_hash_bd_lookup_intent+0xf7/0x170 [libcfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: ll_ost_io00_062 D ffff984772ae1040 0 73057 2 0x00000080
Mar 21 10:25:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: ll_ost_io00_063 D ffff984772ae30c0 0 73058 2 0x00000080
Mar 21 10:25:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: ll_ost_io00_064 D ffff983988710000 0 73059 2 0x00000080
Mar 21 10:25:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:51 fir-io1-s1 kernel: ll_ost_io00_065 D ffff98583962d140 0 73060 2 0x00000080
Mar 21 10:25:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:51 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: ll_ost_io00_066 D ffff98483859a080 0 73070 2 0x00000080
Mar 21 10:25:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: ll_ost_io00_067 D ffff98483859e180 0 73071 2 0x00000080
Mar 21 10:25:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: ll_ost_io00_068 D ffff984838599040 0 73072 2 0x00000080
Mar 21 10:25:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:52 fir-io1-s1 kernel: ll_ost_io00_069 D ffff98483859b0c0 0 73073 2 0x00000080
Mar 21 10:25:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: ll_ost_io00_070 D ffff983988712080 0 73074 2 0x00000080
Mar 21 10:25:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: ll_ost_io00_071 D ffff983988714100 0 73075 2 0x00000080
Mar 21 10:25:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: ll_ost_io00_072 D ffff9839887130c0 0 73076 2 0x00000080
Mar 21 10:25:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: ll_ost_io00_073 D ffff983988711040 0 73077 2 0x00000080
Mar 21 10:25:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: ll_ost_io00_074 D ffff983988715140 0 73078 2 0x00000080
Mar 21 10:25:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: ll_ost_io00_075 D ffff98483c58e180 0 73079 2 0x00000080
Mar 21 10:25:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: ll_ost_io00_076 D ffff98483c58b0c0 0 73080 2 0x00000080
Mar 21 10:25:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85769535>] rwsem_down_write_failed+0x225/0x3a0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0d435f2>] ? kiblnd_check_sends_locked+0xa72/0xe40 [ko2iblnd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85386c47>] call_rwsem_down_write_failed+0x17/0x30
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85766f4d>] down_write+0x2d/0x3d
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14685b4>] ldiskfs_map_blocks+0x134/0x700 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:54 fir-io1-s1 kernel: ll_ost_io00_077 D ffff984820a71040 0 73081 2 0x00000080
Mar 21 10:25:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:54 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: ll_ost_io00_078 D ffff98483c5b1040 0 73082 2 0x00000080
Mar 21 10:25:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: ll_ost_io00_079 D ffff98483c5b6180 0 73083 2 0x00000080
Mar 21 10:25:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: ll_ost_io02_075 D ffff98683cb00000 0 73084 2 0x00000080
Mar 21 10:25:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: ll_ost_io02_076 D ffff98683cb01040 0 73085 2 0x00000080
Mar 21 10:25:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: ll_ost_io02_077 D ffff98683cb05140 0 73086 2 0x00000080
Mar 21 10:25:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: ll_ost_io02_078 D ffff983f056a5140 0 73087 2 0x00000080
Mar 21 10:25:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8521a849>] ? ___slab_alloc+0x209/0x4f0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: ll_ost_io00_080 D ffff983f056a4100 0 73091 2 0x00000080
Mar 21 10:25:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: ll_ost_io00_081 D ffff983f056a6180 0 73113 2 0x00000080
Mar 21 10:25:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: ll_ost_io00_082 D ffff983f056a1040 0 73114 2 0x00000080
Mar 21 10:25:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: ll_ost_io00_083 D ffff983f056a0000 0 73115 2 0x00000080
Mar 21 10:25:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: ll_ost_io02_079 D ffff983f056a2080 0 73116 2 0x00000080
Mar 21 10:25:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: ll_ost_io02_080 D ffff987839fae180 0 73117 2 0x00000080
Mar 21 10:25:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:57 fir-io1-s1 kernel: ll_ost_io02_081 D ffff983a6da92080 0 73118 2 0x00000080
Mar 21 10:25:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:57 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8576778f>] ? __schedule+0x3ff/0x890
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: ll_ost_io02_082 D ffff983a6da95140 0 73119 2 0x00000080
Mar 21 10:25:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: ll_ost_io02_083 D ffff983a6da94100 0 73120 2 0x00000080
Mar 21 10:25:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e121bd>] ? null_alloc_rs+0x16d/0x340 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: ll_ost_io02_084 D ffff983f056a30c0 0 73121 2 0x00000080
Mar 21 10:25:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850dc766>] ? select_task_rq_fair+0x5a6/0x760
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc146a4a5>] ? ldiskfs_do_update_inode+0x525/0x810 [ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: ll_ost_io02_085 D ffff9868143b8000 0 73122 2 0x00000080
Mar 21 10:25:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc03ef9cf>] ? begin_wqe+0x3f/0x140 [mlx5_ib]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff855df0ea>] ? iova_rcache_get+0xba/0x140
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85061d00>] ? default_inquire_remote_apic+0x10/0x20
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85269218>] ? generic_setxattr+0x68/0x80
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc166092b>] ofd_object_punch+0x4cb/0xd30 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: ll_ost_io02_086 D ffff986834bc5140 0 73123 2 0x00000080
Mar 21 10:25:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765721>] ? schedule_timeout+0x221/0x2d0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850cec1a>] ? task_rq_unlock+0x1a/0x20
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850d1b8a>] ? __sched_setscheduler+0xa8a/0xab0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: ll_ost_io02_087 D ffff986834bc2080 0 73124 2 0x00000080
Mar 21 10:25:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:25:59 fir-io1-s1 kernel: ll_ost_io02_088 D ffff986834bc30c0 0 73125 2 0x00000080
Mar 21 10:25:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:25:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: ll_ost_io02_089 D ffff9841f3316180 0 73126 2 0x00000080
Mar 21 10:26:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: ll_ost_io02_090 D ffff9841f3314100 0 73132 2 0x00000080
Mar 21 10:26:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: ll_ost_io02_091 D ffff9868043e2080 0 73144 2 0x00000080
Mar 21 10:26:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: ll_ost_io02_092 D ffff9868043e6180 0 73145 2 0x00000080
Mar 21 10:26:00 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:00 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: ll_ost_io02_093 D ffff986816f7d140 0 73146 2 0x00000080
Mar 21 10:26:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1666c40>] ofd_preprw+0x490/0x1160 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e437cb>] tgt_brw_read+0x9db/0x1e50 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dd15d6>] ? ptl_send_buf+0x146/0x530 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e121d6>] ? null_alloc_rs+0x186/0x340 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ddabff>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ddad81>] ? lustre_pack_reply+0x11/0x20 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: ll_ost_io02_094 D ffff986836d0a080 0 73147 2 0x00000080
Mar 21 10:26:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: ll_ost_io02_095 D ffff9858ba2430c0 0 73148 2 0x00000080
Mar 21 10:26:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85269218>] ? generic_setxattr+0x68/0x80
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc166092b>] ofd_object_punch+0x4cb/0xd30 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:01 fir-io1-s1 kernel: ll_ost_io02_096 D ffff9858ba242080 0 73149 2 0x00000080
Mar 21 10:26:01 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:01 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: ll_ost_io02_097 D ffff9858ba244100 0 73150 2 0x00000080
Mar 21 10:26:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: ll_ost_io02_098 D ffff9841f3311040 0 73151 2 0x00000080
Mar 21 10:26:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: ll_ost_io02_099 D ffff986816c66180 0 73152 2 0x00000080
Mar 21 10:26:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: ll_ost_io00_084 D ffff9868181f0000 0 73277 2 0x00000080
Mar 21 10:26:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:02 fir-io1-s1 kernel: ll_ost_io00_085 D ffff9868181f30c0 0 73278 2 0x00000080
Mar 21 10:26:02 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85278b1a>] ? bh_lru_install+0x18a/0x1e0
Mar 21 10:26:02 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc151e3db>] ? osd_punch+0xcb/0x6b0 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1660d68>] ofd_object_punch+0x908/0xd30 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: ll_ost_io00_086 D ffff9868181f6180 0 73279 2 0x00000080
Mar 21 10:26:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: ll_ost_io00_087 D ffff9868181f4100 0 73280 2 0x00000080
Mar 21 10:26:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: ll_ost_io00_088 D ffff9868181f5140 0 73281 2 0x00000080
Mar 21 10:26:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:03 fir-io1-s1 kernel: ll_ost_io00_089 D ffff9868181f1040 0 73282 2 0x00000080
Mar 21 10:26:03 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:03 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: ll_ost_io00_090 D ffff986816c61040 0 73283 2 0x00000080
Mar 21 10:26:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: ll_ost_io00_091 D ffff986812384100 0 73284 2 0x00000080
Mar 21 10:26:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: ll_ost_io00_092 D ffff986812380000 0 73285 2 0x00000080
Mar 21 10:26:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: ll_ost_io00_093 D ffff986812385140 0 73286 2 0x00000080
Mar 21 10:26:04 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc149924a>] ? ldiskfs_es_lookup_extent+0x2a/0x180 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:04 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: ll_ost_io00_094 D ffff986801e3d140 0 73287 2 0x00000080
Mar 21 10:26:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: ll_ost_io00_095 D ffff9858e95db0c0 0 73288 2 0x00000080
Mar 21 10:26:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff851d82c8>] ? zone_statistics+0x88/0xa0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: ll_ost_io03_044 D ffff984831212080 0 73470 2 0x00000080
Mar 21 10:26:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:05 fir-io1-s1 kernel: ll_ost_io03_045 D ffff984831210000 0 73471 2 0x00000080
Mar 21 10:26:05 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:05 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0a29207>] ? cfs_hash_bd_lookup_intent+0xf7/0x170 [libcfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: ll_ost_io03_046 D ffff984831215140 0 73472 2 0x00000080
Mar 21 10:26:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: ll_ost_io03_047 D ffff984831214100 0 73473 2 0x00000080
Mar 21 10:26:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: ll_ost_io03_048 D ffff986816c62080 0 73474 2 0x00000080
Mar 21 10:26:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: ll_ost_io00_096 D ffff986816c65140 0 73475 2 0x00000080
Mar 21 10:26:06 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:06 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn00_019 S ffff983ab1bf0000 0 78468 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn02_021 S ffff983ab1bf4100 0 78532 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn02_022 S ffff98481e376180 0 78533 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn02_023 S ffff98481e3730c0 0 78534 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn02_024 S ffff98481e371040 0 78535 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn00_020 S ffff986817fea080 0 81397 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn00_021 S ffff986817fed140 0 81398 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn03_010 S ffff986817fe9040 0 83275 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn00_022 S ffff986804778000 0 84119 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn00_023 S ffff98680477e180 0 84120 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cn03_011 S ffff98680477a080 0 92329 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: ldlm_cb02_004 S ffff98683b39e180 0 35278 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: lst_s_00 S ffff985769f7c100 0 48558 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: lst_t_00_00 S ffff985769f78000 0 48559 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: lst_t_00_01 S ffff985769f7a080 0 48560 2 0x00000080
Mar 21 10:26:07 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:07 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_02 S ffff985769f7e180 0 48561 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_03 S ffff985c0fa16180 0 48563 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_04 S ffff985c0fa15140 0 48564 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_05 S ffff985c0fa14100 0 48565 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_06 S ffff985c0fa130c0 0 48566 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_07 S ffff985c0fa12080 0 48567 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_08 S ffff9863254f0000 0 48568 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_09 S ffff9863254f4100 0 48569 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_00_10 S ffff9863254f5140 0 48570 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_00 S ffff9863254f1040 0 48571 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_01 S ffff9863254f30c0 0 48572 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_02 S ffff9863254f2080 0 48574 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_03 S ffff9863254f6180 0 48575 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_04 S ffff98783cacb0c0 0 48576 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_05 S ffff98783cac9040 0 48577 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:08 fir-io1-s1 kernel: lst_t_01_06 S ffff98783caca080 0 48578 2 0x00000080
Mar 21 10:26:08 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:08 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_01_07 S ffff98783cac8000 0 48579 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_01_08 S ffff984831216180 0 48580 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_01_09 S ffff984831211040 0 48581 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_01_10 S ffff9848312130c0 0 48582 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_00 S ffff985810e15140 0 48583 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_01 S ffff98581abbb0c0 0 48584 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_02 S ffff98581abb8000 0 48585 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_03 S ffff984a87ced140 0 48586 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_04 S ffff98520f784100 0 48587 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_05 S ffff98583829d140 0 48588 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_06 S ffff98583c242080 0 48589 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_07 S ffff986620368000 0 48590 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_08 S ffff986620369040 0 48591 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f356>] ? srpc_handle_rpc+0x3c6/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_09 S ffff98662036a080 0 48592 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f1b3>] ? srpc_handle_rpc+0x223/0x500 [lnet_selftest]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:09 fir-io1-s1 kernel: lst_t_02_10 S ffff98662036b0c0 0 48593 2 0x00000080
Mar 21 10:26:09 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:09 fir-io1-s1 kernel: [<ffffffffc175f322>] ? srpc_handle_rpc+0x392/0x500 [lnet_selftest]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_00 S ffff98662036c100 0 48594 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff8575bfcb>] ? queued_spin_lock_slowpath+0xb/0xf
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_01 S ffff98662036d140 0 48595 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_02 S ffff98662036e180 0 48596 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_03 S ffff986056ca8000 0 48597 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_04 S ffff986056ca9040 0 48598 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Lustre: fir-OST0006: Export ffff98480c648800 already connecting from 10.9.105.11@o2ib4
Mar 21 10:26:10 fir-io1-s1 kernel: Lustre: Skipped 42 previous similar messages
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_05 S ffff986056caa080 0 48600 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_06 S ffff986056cab0c0 0 48601 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_07 S ffff986056cac100 0 48602 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_08 S ffff986056cad140 0 48603 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff8575bfcb>] ? queued_spin_lock_slowpath+0xb/0xf
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_09 S ffff986056cae180 0 48604 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: lst_t_03_10 S ffff986013aa8000 0 48605 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2ebec>] cfs_wi_scheduler+0x30c/0x460 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0a2e8e0>] ? cfs_wi_sched_create+0x680/0x680 [libcfs]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: st_timer D ffff986013aa9040 0 48613 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85765668>] schedule_timeout+0x168/0x2d0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850a98e0>] ? __internal_add_timer+0x130/0x130
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c27f6>] ? prepare_to_wait+0x56/0x90
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc1759b68>] stt_timer_main+0x168/0x220 [lnet_selftest]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc1759a00>] ? sfw_startup+0x580/0x580 [lnet_selftest]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: ll_ost02_066 S ffff984830acc100 0 82098 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: ll_ost02_067 S ffff983969742080 0 82099 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: ll_ost02_068 S ffff984831319040 0 82278 2 0x00000080
Mar 21 10:26:10 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:10 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create02 S ffff9847cee38000 0 79223 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create02 D ffff9847cee3e180 0 79393 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create01 D ffff9868e95830c0 0 23595 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create01 S ffff9878397bb0c0 0 23634 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create01 S ffff98460702b0c0 0 26058 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create02 S ffff98783b19c100 0 86851 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create02 S ffff98783b19d140 0 87236 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create02 S ffff98783b19e180 0 89765 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create01 S ffff9858e945a080 0 10970 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create01 S ffff9858e9458000 0 12450 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ll_ost_create01 S ffff98683cb04100 0 15436 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ldlm_cn03_012 S ffff985769d29040 0 91498 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:11 fir-io1-s1 kernel: ldlm_cn03_013 S ffff985769d2b0c0 0 91499 2 0x00000080
Mar 21 10:26:11 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:11 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_014 S ffff9868e965b0c0 0 91500 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_015 S ffff98783b725140 0 91501 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_016 S ffff98783b722080 0 91502 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_017 S ffff98783b7230c0 0 91503 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_018 S ffff98783b726180 0 91504 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_019 S ffff98782332e180 0 91505 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_020 S ffff98782332a080 0 91506 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_021 S ffff987823328000 0 91507 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn00_024 S ffff98783bf14100 0 91508 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn00_025 S ffff98782fae5140 0 91509 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: ldlm_cn03_022 D ffff9878383a4100 0 91510 2 0x00000080
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:26:12 fir-io1-s1 kernel: LNet: Service thread pid 96395 was inactive for 200.23s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Mar 21 10:26:12 fir-io1-s1 kernel: LNet: Skipped 2 previous similar messages
Mar 21 10:26:12 fir-io1-s1 kernel: Pid: 96395, comm: ll_ost_io02_019 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018
Mar 21 10:26:12 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:12 fir-io1-s1 kernel: [<ffffffffffffffff>] 0xffffffffffffffff
Mar 21 10:26:12 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189172.96395
Mar 21 10:26:13 fir-io1-s1 kernel: Pid: 96337, comm: ll_ost_io02_014 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffffffffff>] 0xffffffffffffffff
Mar 21 10:26:13 fir-io1-s1 kernel: Pid: 96490, comm: ll_ost_io03_019 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffffffffff>] 0xffffffffffffffff
Mar 21 10:26:13 fir-io1-s1 kernel: Pid: 73074, comm: ll_ost_io00_070 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffffffffff>] 0xffffffffffffffff
Mar 21 10:26:13 fir-io1-s1 kernel: Pid: 96484, comm: ll_ost_io03_018 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffffffffff>] 0xffffffffffffffff
Mar 21 10:26:13 fir-io1-s1 kernel: LNet: Service thread pid 96675 was inactive for 200.41s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:13 fir-io1-s1 kernel: LNet: Skipped 13 previous similar messages
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc166bae7>] ofd_lvbo_update+0x577/0xdf0 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:13 fir-io1-s1 kernel: LNet: Service thread pid 94264 was inactive for 200.39s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:13 fir-io1-s1 kernel: LNet: Skipped 2 previous similar messages
Mar 21 10:26:13 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189173.94264
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0db0e29>] ldlm_request_cancel+0x3c9/0x740 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0db597a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0db5c68>] ldlm_cancel_handler+0x158/0x590 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn03_023 S ffff9878383a0000 0 91511 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn03_024 S ffff9878383a1040 0 91512 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn03_025 S ffff987831350000 0 91513 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn03_026 S ffff987831356180 0 91514 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn00_026 S ffff9868e9552080 0 91515 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn00_027 D ffff98782e23b0c0 0 91516 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0d43ae2>] ? kiblnd_launch_tx+0xd2/0xc20 [ko2iblnd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc166bae7>] ofd_lvbo_update+0x577/0xdf0 [ofd]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0db0e29>] ldlm_request_cancel+0x3c9/0x740 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0db597a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0db5c68>] ldlm_cancel_handler+0x158/0x590 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:13 fir-io1-s1 kernel: ldlm_cn00_028 S ffff98782e23e180 0 91517 2 0x00000080
Mar 21 10:26:13 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:13 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn03_027 S ffff98782e23d140 0 91518 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn00_029 S ffff983a6da90000 0 91519 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn00_030 S ffff984832100000 0 115844 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn00_031 S ffff9840d6d38000 0 115845 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn02_025 S ffff9840d6d3d140 0 116386 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: LNet: Service thread pid 96648 was inactive for 200.50s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:14 fir-io1-s1 kernel: LNet: Skipped 12 previous similar messages
Mar 21 10:26:14 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189174.96648
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn02_026 S ffff9840d6d3b0c0 0 116387 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn02_027 D ffff9840d6d3a080 0 116388 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc166bae7>] ofd_lvbo_update+0x577/0xdf0 [ofd]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0db0e29>] ldlm_request_cancel+0x3c9/0x740 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0db597a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0db5c68>] ldlm_cancel_handler+0x158/0x590 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn02_028 S ffff9840d6d39040 0 116454 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: ldlm_cn02_029 D ffff9848343b6180 0 116455 2 0x00000080
Mar 21 10:26:14 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff8525dc40>] __wait_on_freeing_inode+0xb0/0xf0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff8525de41>] find_inode_fast+0x71/0xb0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff8525ed69>] iget_locked+0x79/0x1a0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc14692f2>] ldiskfs_iget+0x42/0xc50 [ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc14fbb16>] osd_iget+0x26/0x2d0 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc1522760>] osd_obj_map_lookup+0x260/0x510 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc1500a18>] ? osd_fld_lookup+0x48/0xd0 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc150f989>] osd_oi_lookup+0x139/0x1e0 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc150aea5>] osd_fid_lookup+0x4a5/0x1c70 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc150c6d1>] osd_object_init+0x61/0x110 [osd_ldiskfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0ba0fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0ba12e6>] lu_object_find_at+0x76/0x280 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0ba1506>] lu_object_find+0x16/0x20 [obdclass]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc165d185>] ofd_object_find+0x35/0x100 [ofd]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc166bae7>] ofd_lvbo_update+0x577/0xdf0 [ofd]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0db0e29>] ldlm_request_cancel+0x3c9/0x740 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0db597a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0db5c68>] ldlm_cancel_handler+0x158/0x590 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:14 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ldlm_cn02_030 S ffff9848343b2080 0 116456 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: kworker/19:2 S ffff987835de4100 0 112888 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: kworker/26:2 S ffff98630b7e4100 0 1801 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: kworker/38:2H S ffff986013aac100 0 15487 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_066 S ffff987835eb6180 0 49816 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_067 D ffff987835eb5140 0 49817 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189175.96475
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_068 S ffff986c6f38d140 0 49818 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_069 S ffff986c6f388000 0 49819 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_070 S ffff986c6f38e180 0 49820 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_071 S ffff986c6f38c100 0 49821 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_072 D ffff986c6f38b0c0 0 49822 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:15 fir-io1-s1 kernel: ll_ost00_073 D ffff986c6f389040 0 49823 2 0x00000080
Mar 21 10:26:15 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:15 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_074 S ffff987260116180 0 49824 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_075 S ffff9872601130c0 0 49825 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_076 S ffff987260111040 0 49826 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_077 D ffff987260115140 0 49827 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:16 fir-io1-s1 kernel: LNet: Service thread pid 96339 was inactive for 200.31s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:16 fir-io1-s1 kernel: LNet: Skipped 60 previous similar messages
Mar 21 10:26:16 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189176.96339
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_078 S ffff987260114100 0 49828 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_079 S ffff987260112080 0 49829 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_080 S ffff98730402e180 0 49830 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_081 D ffff98730402b0c0 0 49831 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_082 S ffff987304028000 0 49832 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: ll_ost00_083 S ffff98730402a080 0 49833 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:16 fir-io1-s1 kernel: kworker/42:2 S ffff986c1aea0000 0 93281 2 0x00000080
Mar 21 10:26:16 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:16 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ll_ost03_033 S ffff98483bc04100 0 130123 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_11 S ffff98783edb6180 0 43082 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_12 S ffff98783edb30c0 0 43083 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_13 S ffff98783edb0000 0 43084 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_14 S ffff98783edb2080 0 43085 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_15 S ffff9849912b4100 0 43086 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189177.96296
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_16 S ffff9849912b5140 0 43087 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_17 S ffff9878386f2080 0 43088 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_18 S ffff9878386f1040 0 43089 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_19 S ffff9878386f0000 0 43090 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_20 S ffff9878386f5140 0 43091 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_21 S ffff9850b952b0c0 0 43172 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: ldlm_bl_22 S ffff9850b952c100 0 43173 2 0x00000080
Mar 21 10:26:17 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:17 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: kworker/39:0 S ffff98783029e180 0 84640 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: kworker/18:0 S ffff9863997cc100 0 92725 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_23 S ffff986834b6a080 0 51510 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_24 S ffff986834b6d140 0 51511 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_25 S ffff986834b68000 0 51512 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_26 S ffff986834b6c100 0 51513 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_27 S ffff985811f69040 0 51514 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189178.96291
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_28 S ffff985811f6a080 0 51515 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_29 S ffff985811f6d140 0 51516 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_30 S ffff985811f68000 0 51517 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_31 S ffff9868043e1040 0 51518 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_32 S ffff9858ba246180 0 51519 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_33 S ffff9858ba245140 0 51520 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: ldlm_bl_34 S ffff9858ba241040 0 51522 2 0x00000080
Mar 21 10:26:18 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:18 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ldlm_bl_35 S ffff9858ba240000 0 51523 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ldlm_bl_36 S ffff986557ab2080 0 51524 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85153c9d>] ? call_rcu_sched+0x1d/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0b6de51>] ? obd_stale_export_get+0x31/0x190 [obdclass]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0db69fd>] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0db65d0>] ? ldlm_handle_bl_callback+0x530/0x530 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_034 S ffff98581cb65140 0 937 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_035 S ffff985836355140 0 938 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_036 D ffff9850d1efe180 0 946 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189179.96508
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_037 S ffff9850d1efa080 0 959 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_038 S ffff9850d1efc100 0 1015 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_039 S ffff9848e98d30c0 0 1163 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_040 S ffff9872eabab0c0 0 2370 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_041 S ffff985a574e4100 0 2371 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost03_042 S ffff9866d3bca080 0 35807 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: ll_ost02_069 D ffff9866d3bc8000 0 36689 2 0x00000080
Mar 21 10:26:19 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:19 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost02_070 S ffff9866d3bcc100 0 36979 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost02_071 D ffff9858e3a62080 0 36980 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc150ff00>] ? osd_oi_insert+0x4d0/0x520 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14feedf>] ? osd_destroy+0x1af/0x760 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14fe23d>] ? osd_ref_del+0x1ad/0x6a0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc1661455>] ofd_destroy+0x2c5/0x960 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost02_072 S ffff9858e3a61040 0 36981 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost02_073 S ffff9858e3a65140 0 36982 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: LNet: Service thread pid 73083 was inactive for 200.43s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:20 fir-io1-s1 kernel: LNet: Skipped 72 previous similar messages
Mar 21 10:26:20 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189180.73083
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost02_074 S ffff9858e3a64100 0 36983 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost_io03_049 D ffff9861baf74100 0 81511 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:20 fir-io1-s1 kernel: ll_ost_io03_050 D ffff9861baf730c0 0 81512 2 0x00000080
Mar 21 10:26:20 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:20 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: kworker/45:2 S ffff98575bc4e180 0 127544 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: kworker/23:0 S ffff9878246e30c0 0 73330 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ldlm_cn02_031 S ffff9863997c9040 0 93903 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost02_075 S ffff987836104100 0 63944 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost03_043 S ffff986817feb0c0 0 74692 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost03_044 S ffff986817fe8000 0 74693 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost03_045 S ffff98481e2cd140 0 74694 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189181.96447
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost03_046 S ffff984836b230c0 0 74705 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost02_076 S ffff987815ab30c0 0 74736 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost02_077 D ffff987815ab6180 0 74737 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost02_078 S ffff987815ab1040 0 74743 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:21 fir-io1-s1 kernel: ll_ost02_079 D ffff987815ab0000 0 74745 2 0x00000080
Mar 21 10:26:21 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc165df17>] ofd_precreate_objects+0xa57/0x1ab0 [ofd]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc1650794>] ofd_create_hdl+0x474/0x20e0 [ofd]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0dda707>] ? lustre_msg_add_version+0x27/0xa0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0ddaa5f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:21 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:22 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189182.96449
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: ll_ost02_080 D ffff987815ab4100 0 74746 2 0x00000080
Mar 21 10:26:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc150ff00>] ? osd_oi_insert+0x4d0/0x520 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14feedf>] ? osd_destroy+0x1af/0x760 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14fe23d>] ? osd_ref_del+0x1ad/0x6a0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc1661455>] ofd_destroy+0x2c5/0x960 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: ll_ost02_081 S ffff987815ab5140 0 74747 2 0x00000080
Mar 21 10:26:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: ll_ost02_082 D ffff98783936c100 0 74748 2 0x00000080
Mar 21 10:26:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: ll_ost02_083 D ffff987839368000 0 74749 2 0x00000080
Mar 21 10:26:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: ll_ost02_084 S ffff987839369040 0 74750 2 0x00000080
Mar 21 10:26:22 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:22 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_085 D ffff98783936d140 0 74751 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff853a0160>] ? __percpu_counter_sum+0x70/0x80
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189183.96418
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_086 D ffff98783936a080 0 74752 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_087 S ffff986c6f38a080 0 74763 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_088 D ffff9872eaba9040 0 74776 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_089 S ffff9872eabad140 0 74799 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_090 S ffff9872eabac100 0 74817 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost02_091 D ffff9872eaba8000 0 74818 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0d44987>] ? kiblnd_send+0x357/0xa20 [ko2iblnd]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0ab80e4>] ? lnet_ni_send+0x44/0xd0 [lnet]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: ll_ost03_047 D ffff9872eabae180 0 74991 2 0x00000080
Mar 21 10:26:23 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:23 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost02_092 D ffff987836102080 0 75602 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189184.96303
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost02_093 S ffff987836105140 0 75603 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost02_094 D ffff9878361030c0 0 75765 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost03_048 S ffff9868e94c2080 0 76197 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost02_095 S ffff9841f3312080 0 77316 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost02_096 D ffff985657a41040 0 77317 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost02_097 D ffff985657a46180 0 77323 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: kworker/10:2 S ffff985a405a8000 0 784 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost03_049 S ffff985839d430c0 0 110267 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost03_050 S ffff98742eea4100 0 113338 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:24 fir-io1-s1 kernel: ll_ost03_051 S ffff986a05dab0c0 0 113339 2 0x00000080
Mar 21 10:26:24 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:24 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_052 S ffff9878246e6180 0 113340 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189185.96600
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_053 S ffff9878246e2080 0 114702 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_054 S ffff9878246e5140 0 114817 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_055 S ffff986b964f2080 0 114818 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_056 S ffff9850d1ffc100 0 129901 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_057 D ffff9850d1ffa080 0 129902 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850e3ce4>] ? find_busiest_group+0x144/0x990
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_058 D ffff984832782080 0 129913 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_059 S ffff984832786180 0 129914 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: ll_ost03_060 D ffff987832389040 0 129953 2 0x00000080
Mar 21 10:26:25 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:25 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_061 D ffff98783238e180 0 2629 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189186.96633
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_062 S ffff9878383da080 0 109956 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_063 D ffff9878383db0c0 0 109957 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_064 D ffff9860f3b5b0c0 0 109958 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0a22ab4>] ? cfs_tage_alloc+0x94/0xb0 [libcfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_065 S ffff9860f3b5e180 0 109959 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_066 S ffff9860f3b5a080 0 109960 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_067 S ffff9860f3b5c100 0 109961 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_068 S ffff9878386f30c0 0 109968 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:26 fir-io1-s1 kernel: ll_ost03_069 D ffff9878386f4100 0 109969 2 0x00000080
Mar 21 10:26:26 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:26 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_070 S ffff98697b5c9040 0 109970 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189187.96625
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_071 D ffff98697b5ca080 0 109971 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_072 S ffff98697b5ce180 0 109972 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_073 S ffff98742eea1040 0 109973 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_074 S ffff98742eea2080 0 109984 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_075 S ffff98680477b0c0 0 109985 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_076 S ffff98683b399040 0 109986 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_077 S ffff9878397b9040 0 109987 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_078 S ffff98783238a080 0 109998 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: ll_ost03_079 S ffff987832388000 0 109999 2 0x00000080
Mar 21 10:26:27 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:27 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost03_080 S ffff98742eea6180 0 110000 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_084 D ffff98742eea30c0 0 110009 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189188.96553
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_085 S ffff98697b5cc100 0 110032 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_086 S ffff98697b5cd140 0 110033 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_087 S ffff98697b5cb0c0 0 110034 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_088 D ffff987835de1040 0 110035 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_089 S ffff987835de0000 0 110036 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_090 S ffff9868e95eb0c0 0 110037 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_091 S ffff986b964f4100 0 110570 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: LNet: Service thread pid 73118 was inactive for 200.43s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:28 fir-io1-s1 kernel: LNet: Skipped 73 previous similar messages
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_092 S ffff986b964f30c0 0 110571 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_093 S ffff986b964f6180 0 110572 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:28 fir-io1-s1 kernel: ll_ost00_094 D ffff986b964f0000 0 110573 2 0x00000080
Mar 21 10:26:28 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0ac019c>] ? LNetPut+0x2cc/0xb50 [lnet]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff852aeb2f>] dqget+0x19f/0x450
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:28 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost00_095 S ffff986b964f5140 0 110574 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_081 S ffff987838302080 0 110596 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_082 S ffff984772ae6180 0 110597 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189189.96596
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_083 S ffff983ab1bf6180 0 110598 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_084 S ffff983ab1bf30c0 0 110599 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_085 D ffff983ab1bf5140 0 110600 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_086 S ffff98396953a080 0 110601 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_087 S ffff9840d6d3c100 0 110602 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_088 S ffff9840d6d3e180 0 110603 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_089 S ffff98581af3d140 0 110604 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_090 S ffff985809b14100 0 110605 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_091 S ffff985809b16180 0 110606 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:29 fir-io1-s1 kernel: ll_ost03_092 D ffff985809b10000 0 110607 2 0x00000080
Mar 21 10:26:29 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:29 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost03_093 S ffff985809b15140 0 110608 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost03_094 S ffff985809b12080 0 110609 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189190.96452
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost03_095 S ffff9872b2038000 0 110610 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost03_096 S ffff9872b2039040 0 110611 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost00_096 S ffff9872b203a080 0 110615 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost00_097 D ffff9872b203b0c0 0 110616 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost00_098 D ffff9872b203c100 0 110617 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost00_099 D ffff9872b203d140 0 110618 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff853a0160>] ? __percpu_counter_sum+0x70/0x80
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost00_100 S ffff9872b203e180 0 110619 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:30 fir-io1-s1 kernel: ll_ost00_101 D ffff98758ac50000 0 110620 2 0x00000080
Mar 21 10:26:30 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:30 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost00_102 S ffff98758ac51040 0 110621 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost02_098 D ffff98758ac52080 0 110632 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:31 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189191.96464
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost02_099 D ffff98758ac530c0 0 110633 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost02_100 D ffff98758ac54100 0 110634 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff852ad3ba>] dquot_acquire+0x3a/0x150
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc1485ad6>] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff852aee8d>] __dquot_initialize+0xad/0x1c0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff8526fa4a>] ? __inode_wait_for_writeback+0x7a/0xf0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff852aefb3>] dquot_initialize+0x13/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc146dfa9>] ldiskfs_evict_inode+0x109/0x630 [ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff8525eaa4>] evict+0xb4/0x180
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff8525f3ac>] iput+0xfc/0x190
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc14f4e3a>] osd_object_delete+0x1ea/0x340 [osd_ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0b9e008>] lu_object_free.isra.30+0x68/0x170 [obdclass]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0a29378>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0ba15d5>] lu_object_put+0xc5/0x3d0 [obdclass]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc16596ea>] ofd_destroy_by_fid+0x21a/0x4a0 [ofd]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost02_101 D ffff98758ac55140 0 110635 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc151d740>] ? osd_declare_write+0x330/0x470 [osd_ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc1661760>] ofd_destroy+0x5d0/0x960 [ofd]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc16596c4>] ofd_destroy_by_fid+0x1f4/0x4a0 [ofd]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0daa830>] ? ldlm_blocking_ast_nocheck+0x310/0x310 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0da4a80>] ? ldlm_expired_completion_wait+0x220/0x220 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc164e4f7>] ofd_destroy_hdl+0x267/0x970 [ofd]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost02_102 S ffff98758ac56180 0 110636 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:31 fir-io1-s1 kernel: ll_ost02_103 D ffff9847cee3b0c0 0 110637 2 0x00000080
Mar 21 10:26:31 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:31 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost02_104 S ffff9847cee3c100 0 110638 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff8576a175>] ? _raw_spin_unlock_irqrestore+0x15/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost02_105 D ffff9848387a4100 0 110639 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0d44987>] ? kiblnd_send+0x357/0xa20 [ko2iblnd]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0ab80e4>] ? lnet_ni_send+0x44/0xd0 [lnet]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189192.73285
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost02_106 S ffff9848387a30c0 0 110640 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost02_107 S ffff9848387a5140 0 110641 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost03_097 S ffff9876cb3e8000 0 110655 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost00_103 S ffff9876cb3e9040 0 110656 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost00_104 S ffff9876cb3ea080 0 110657 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost00_105 S ffff9876cb3eb0c0 0 110658 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:32 fir-io1-s1 kernel: ll_ost00_106 D ffff9876cb3ec100 0 110659 2 0x00000080
Mar 21 10:26:32 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:32 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost00_107 S ffff9876cb3ed140 0 110660 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost00_108 S ffff9876cb3ee180 0 110661 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost00_109 D ffff986ad4c08000 0 110662 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:33 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189193.96457
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost02_108 S ffff986ad4c09040 0 110699 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost02_109 S ffff986ad4c0a080 0 110700 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost02_110 D ffff986ad4c0b0c0 0 110701 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d9ed5>] ? sched_clock_cpu+0x85/0xc0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost02_111 S ffff986ad4c0c100 0 110702 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost03_098 D ffff985a405ae180 0 111261 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:33 fir-io1-s1 kernel: ll_ost03_099 D ffff985a405ac100 0 111262 2 0x00000080
Mar 21 10:26:33 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff850e3ce4>] ? find_busiest_group+0x144/0x990
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ? ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc1485ac3>] ldiskfs_acquire_dquot+0x53/0xb0 [ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffff852afb54>] dquot_get_dqblk+0x14/0x1f0
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc152ff55>] osd_acct_index_lookup+0x235/0x480 [osd_ldiskfs]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc11de80d>] lquotactl_slv+0x27d/0x9d0 [lquota]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc1649a3c>] ofd_quotactl+0x13c/0x380 [ofd]
Mar 21 10:26:33 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_100 S ffff985a405ab0c0 0 111263 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_101 D ffff987836101040 0 111280 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189194.96306
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850e060c>] ? dequeue_entity+0x11c/0x5e0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850e0eee>] ? dequeue_task_fair+0x41e/0x660
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_102 D ffff987836106180 0 111281 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e33b59>] tgt_client_data_update+0x3a9/0x5e0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_103 S ffff986557ab6180 0 111282 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_104 S ffff986557ab4100 0 111283 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_105 D ffff986557ab5140 0 111284 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0db47a4>] ldlm_handle_enqueue0+0x944/0x15a0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0ddc7f0>] ? lustre_swab_ldlm_lock_desc+0x30/0x30 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e3b302>] tgt_enqueue+0x62/0x210 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:34 fir-io1-s1 kernel: ll_ost03_106 S ffff985769f79040 0 111285 2 0x00000080
Mar 21 10:26:34 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:34 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost03_107 S ffff986ad4c0d140 0 111286 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost03_108 D ffff986ad4c0e180 0 111287 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0e33ab3>] tgt_client_data_update+0x303/0x5e0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0e341ab>] tgt_client_new+0x41b/0x610 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc16587d3>] ofd_obd_connect+0x3a3/0x4c0 [ofd]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0d9a7ce>] target_handle_connect+0x109e/0x2950 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0e41d7a>] tgt_request_handle+0x50a/0x1580 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff851025cf>] ? __getnstimeofday64+0x3f/0xd0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost03_109 S ffff98783b3c8000 0 111288 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189195.73145
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost03_110 S ffff9872eabaa080 0 111289 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost00_110 S ffff98483131b0c0 0 111317 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost00_111 S ffff9839696630c0 0 111318 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: kworker/6:2 S ffff9868351ee180 0 105816 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: kworker/21:0 S ffff98582065e180 0 46688 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ll_ost03_111 S ffff9866d3bcd140 0 14040 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ldlm_cn03_028 S ffff986557ab0000 0 98942 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ldlm_cn03_029 S ffff986557ab1040 0 98943 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ldlm_cn03_030 S ffff9861baf76180 0 98944 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:35 fir-io1-s1 kernel: ldlm_cn03_031 S ffff9861baf70000 0 98945 2 0x00000080
Mar 21 10:26:35 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:35 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: md6_resync D ffff983867009040 0 14512 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc11c8a97>] raid5_sync_request+0x417/0x430 [raid456]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff8558f9f3>] md_do_sync+0xb03/0x11b0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: kworker/17:1 S ffff985657a44100 0 57912 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: kworker/29:1 S ffff985836356180 0 52327 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: kworker/34:1 S ffff985e0f6ed140 0 50680 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: kworker/41:1 S ffff9858376c5140 0 29081 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: kworker/25:1 S ffff98583962b0c0 0 76731 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:36 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189196.96550
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: kworker/3:0 S ffff986a2dffd140 0 130112 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: ll_ost_io03_051 D ffff9858e9530000 0 101160 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:36 fir-io1-s1 kernel: ll_ost_io03_052 D ffff9871574ea080 0 101161 2 0x00000080
Mar 21 10:26:36 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:36 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: ll_ost_io03_053 S ffff9871574e8000 0 101174 2 0x00000080
Mar 21 10:26:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: ll_ost_io03_054 D ffff9878246e1040 0 109255 2 0x00000080
Mar 21 10:26:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: ll_ost_io03_055 D ffff9871574ee180 0 117103 2 0x00000080
Mar 21 10:26:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189197.96394
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: ll_ost_io03_056 D ffff9871574ec100 0 117104 2 0x00000080
Mar 21 10:26:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14684f1>] ldiskfs_map_blocks+0x71/0x700 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: ll_ost_io03_057 S ffff98783029b0c0 0 18565 2 0x00000080
Mar 21 10:26:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: ll_ost_io03_058 D ffff9858e3a66180 0 64797 2 0x00000080
Mar 21 10:26:37 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:37 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/42:0 S ffff9860f3b59040 0 93129 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/26:0 S ffff986366e45140 0 100992 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/u264:0 S ffff985d3ccfd140 0 64565 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0305158>] ? ib_cq_poll_work+0x48/0x70 [ib_core]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/2:0 R running task 0 117231 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/25:0 S ffff984f77414100 0 124007 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189198.73071
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/43:0 S ffff987830299040 0 65175 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/7:1 S ffff987835e08000 0 99189 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: python S ffff98385681b0c0 0 73761 1 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/27:1 S ffff98783029c100 0 47172 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/8:2 S ffff98483273d140 0 119070 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: kworker/1:1 S ffff985810fe1040 0 92339 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:38 fir-io1-s1 kernel: ll_ost_io00_097 D ffff9850b9528000 0 36887 2 0x00000080
Mar 21 10:26:38 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8521b581>] ? __slab_free+0x81/0x2f0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:38 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: ll_ost_io00_098 D ffff987835de6180 0 36888 2 0x00000080
Mar 21 10:26:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff8521a88e>] ? ___slab_alloc+0x24e/0x4f0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff8512e139>] ? map_id_up+0x9/0x80
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0b80929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:39 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189199.96690
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: ll_ost_io00_099 D ffff9871574ed140 0 36889 2 0x00000080
Mar 21 10:26:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: ll_ost_io00_100 D ffff9871574e9040 0 36890 2 0x00000080
Mar 21 10:26:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:39 fir-io1-s1 kernel: ll_ost_io00_101 D ffff98783b3c9040 0 36891 2 0x00000080
Mar 21 10:26:39 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:39 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: ll_ost_io00_102 D ffff98783b3cd140 0 36892 2 0x00000080
Mar 21 10:26:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: ll_ost_io00_103 D ffff986ebedbd140 0 36893 2 0x00000080
Mar 21 10:26:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:40 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189200.96672
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: ll_ost_io00_104 D ffff986ebedba080 0 36894 2 0x00000080
Mar 21 10:26:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff8537c8b4>] ? __radix_tree_lookup+0x84/0xf0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc151a443>] ? osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc151bbaf>] osd_write_commit+0x41f/0x8c0 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: kworker/14:2 S ffff986557ab30c0 0 107313 2 0x00000080
Mar 21 10:26:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:40 fir-io1-s1 kernel: kworker/30:2 S ffff9868349f1040 0 73242 2 0x00000080
Mar 21 10:26:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:40 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: ll_ost_io03_059 D ffff98761d19a080 0 119038 2 0x00000080
Mar 21 10:26:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: ll_ost_io03_060 D ffff98761d19d140 0 120699 2 0x00000080
Mar 21 10:26:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:41 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189201.73080
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: ll_ost_io03_061 D ffff98761d19c100 0 122240 2 0x00000080
Mar 21 10:26:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: ll_ost_io03_062 D ffff98382cbc2080 0 27989 2 0x00000080
Mar 21 10:26:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dd82e0>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:41 fir-io1-s1 kernel: ll_ost_io03_063 D ffff98382cbc1040 0 27990 2 0x00000080
Mar 21 10:26:41 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:41 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: ll_ost_io03_064 D ffff9858e73bc100 0 31716 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff852790fc>] ? __find_get_block+0xbc/0x120
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8576927d>] rwsem_down_read_failed+0x10d/0x1a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85386c18>] call_rwsem_down_read_failed+0x18/0x30
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc14f8330>] ? osd_trans_create+0xa0/0x620 [osd_ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85766f00>] down_read+0x20/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc14ad8b9>] ldiskfs_fiemap+0x109/0x600 [ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc1519187>] osd_is_mapped+0x157/0x1c0 [osd_ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc151dc92>] osd_declare_write_commit+0x182/0x530 [osd_ldiskfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc16638b9>] ofd_commitrw_write+0x939/0x1d40 [ofd]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/15:0 S ffff98783b19a080 0 84813 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189202.96299
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/2:1 S ffff985e0f6e9040 0 130792 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/4:0 S ffff983852b16180 0 56923 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/9:2 S ffff985810309040 0 117827 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/0:2 S ffff9848327830c0 0 91206 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/28:0 S ffff98383b161040 0 121650 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: kworker/12:0 S ffff98483c64d140 0 116742 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:42 fir-io1-s1 kernel: crond S ffff9858e73bb0c0 0 122986 72591 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8524a990>] pipe_wait+0x70/0xc0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8524b218>] pipe_read+0x298/0x400
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85240743>] do_sync_read+0x93/0xe0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8524117f>] vfs_read+0x9f/0x170
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8524203f>] SyS_read+0x7f/0xf0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:42 fir-io1-s1 kernel: raid-check S ffff985c0fa10000 0 122988 122986 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8509d516>] do_wait+0x1f6/0x260
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8509e710>] SyS_wait4+0x80/0x110
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8509c170>] ? task_stopped_code+0x60/0x60
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:42 fir-io1-s1 kernel: md8_resync D ffff983852b11040 0 123037 2 0x00000080
Mar 21 10:26:42 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc11c8a97>] raid5_sync_request+0x417/0x430 [raid456]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffffc11c868a>] ? raid5_sync_request+0xa/0x430 [raid456]
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8558f9f3>] md_do_sync+0xb03/0x11b0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:26:42 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189203.96442
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: md2_resync D ffff983852b15140 0 123149 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c8a97>] raid5_sync_request+0x417/0x430 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558f9f3>] md_do_sync+0xb03/0x11b0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: md10_resync D ffff9868e9580000 0 123234 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c8a97>] raid5_sync_request+0x417/0x430 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c868a>] ? raid5_sync_request+0xa/0x430 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558f9f3>] md_do_sync+0xb03/0x11b0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: md0_resync D ffff98742eea5140 0 123288 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc11c8a97>] raid5_sync_request+0x417/0x430 [raid456]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558f9f3>] md_do_sync+0xb03/0x11b0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558b7fd>] md_thread+0x16d/0x1e0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8558b690>] ? find_pers+0x80/0x80
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: kworker/u264:2 S ffff985e0f6eb0c0 0 83818 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850b9f06>] ? process_one_work+0x336/0x440
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: kworker/17:2 S ffff985769e4e180 0 87960 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: ll_ost_io03_065 D ffff986366e430c0 0 48391 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: ll_ost_io03_066 D ffff986366e46180 0 48392 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:43 fir-io1-s1 kernel: ll_ost_io03_067 D ffff986c1aea1040 0 48418 2 0x00000080
Mar 21 10:26:43 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:43 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/16:2 S ffff984835a8b0c0 0 87686 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/14:1 S ffff9863997c8000 0 32343 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/45:1 S ffff98581030b0c0 0 127149 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/34:0 S ffff9868344ad140 0 12051 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/39:2 S ffff98697b5c8000 0 100351 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/5:2 S ffff985838b60000 0 94703 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/31:1 S ffff9878383d9040 0 23937 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189204.96613
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/40:1 S ffff98483be8b0c0 0 30742 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/46:0 S ffff985a574e30c0 0 104134 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/37:1 S ffff9850b952d140 0 112136 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/1:0 S ffff9848e9890000 0 116928 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/15:1 S ffff986c1aea4100 0 114347 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/24:2 S ffff9848345d2080 0 119489 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/44:2 S ffff983852b12080 0 57245 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850d0884>] ? finish_task_switch+0x54/0x1c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: kworker/28:2 S ffff984832056180 0 76158 2 0x00000080
Mar 21 10:26:44 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:44 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/11:2 S ffff986ebedb8000 0 32436 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/3:2 S ffff9878383de180 0 47526 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/31:2 S ffff986c1aea30c0 0 55572 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/5:0 S ffff984082608000 0 105523 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/20:0 S ffff984830acd140 0 63423 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/24:1 S ffff9839695b0000 0 55648 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/38:1 S ffff9863997cb0c0 0 56814 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/10:0 S ffff986837090000 0 63506 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/4:1 S ffff98383b160000 0 86671 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/47:0 S ffff986b8467c100 0 101150 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/32:1 S ffff98483be8c100 0 12563 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: LNet: Service thread pid 94266 was inactive for 200.73s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:26:45 fir-io1-s1 kernel: LNet: Skipped 109 previous similar messages
Mar 21 10:26:45 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189205.94266
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/21:1 S ffff9856be111040 0 46978 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/36:1 S ffff984082609040 0 56145 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/23:2 S ffff98783238c100 0 106477 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/6:0 S ffff9858e9642080 0 2383 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/36:0 S ffff98408260c100 0 78368 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/22:0 S ffff9858e9676180 0 82340 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b7467>] ? start_worker+0x27/0x30
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850baba9>] ? manage_workers.isra.25+0x189/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: kworker/u258:2 S ffff985837595140 0 85196 2 0x00000080
Mar 21 10:26:45 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b5e3e>] ? __call_usermodehelper+0x4e/0x90
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:45 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/35:2 S ffff9870736e9040 0 115626 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/12:1 S ffff98483a3ad140 0 128645 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189206.96598
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/13:2 S ffff9856be1130c0 0 13024 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/33:0 S ffff9856be114100 0 21025 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/22:1 S ffff9858e3a60000 0 28666 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/0:1 S ffff984832054100 0 34115 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/16:0 S ffff983851ac1040 0 42733 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/44:1 S ffff983bc589a080 0 50190 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/40:0 S ffff98408260d140 0 57152 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/46:2 S ffff98683a332080 0 59861 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/u260:1 S ffff98783b724100 0 86562 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850b5e3e>] ? __call_usermodehelper+0x4e/0x90
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/u259:1 S ffff9860f3b5d140 0 88586 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: pickup S ffff987830a8b0c0 0 92701 72808 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85766e02>] schedule_hrtimeout_range_clock+0xb2/0x150
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85766df6>] ? schedule_hrtimeout_range_clock+0xa6/0x150
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff8528ed3e>] ep_poll+0x23e/0x360
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff8529020d>] SyS_epoll_wait+0xed/0x120
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/20:2 S ffff983bc589d140 0 103395 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/8:1 S ffff983851ac4100 0 122918 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/32:2 S ffff983851ac6180 0 123342 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/u257:0 S ffff983856819040 0 800 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: kworker/18:2 S ffff9858e95a9040 0 1248 2 0x00000080
Mar 21 10:26:46 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:46 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/7:0 S ffff9870736ee180 0 3059 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/u259:2 S ffff9858e95ab0c0 0 3142 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b5e3e>] ? __call_usermodehelper+0x4e/0x90
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189207.96410
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/u257:1 S ffff98483a3ac100 0 3540 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b5e3e>] ? __call_usermodehelper+0x4e/0x90
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/u258:0 S ffff9858376c30c0 0 9744 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/u260:2 S ffff986a05da8000 0 16352 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/u256:1 S ffff986a05daa080 0 18131 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/19:1 S ffff98697e9cd140 0 21973 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: kworker/u256:0 S ffff98697e9c9040 0 29095 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: sshd S ffff9861baf72080 0 31084 72454 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85766e7d>] schedule_hrtimeout_range_clock+0x12d/0x150
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c273c>] ? add_wait_queue+0x3c/0x50
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8545c6e0>] ? tty_write_room+0x20/0x30
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8545aa67>] ? n_tty_poll+0x1b7/0x1d0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85766eb3>] schedule_hrtimeout_range+0x13/0x20
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff852570c5>] poll_schedule_timeout+0x55/0xb0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85257c11>] do_select+0x6d1/0x7c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff856884e4>] ? ip_finish_output+0x284/0x7b0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85256fe0>] ? __pollwait+0xf0/0xf0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850e1278>] ? check_preempt_wakeup+0x148/0x250
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff851656c5>] ? tracing_is_on+0x15/0x30
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8517192b>] ? probe_sched_wakeup+0x2b/0xa0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff851656c5>] ? tracing_is_on+0x15/0x30
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff851691bd>] ? tracing_record_cmdline+0x1d/0x120
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8517192b>] ? probe_sched_wakeup+0x2b/0xa0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850d2f75>] ? ttwu_do_wakeup+0xb5/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850d64f0>] ? try_to_wake_up+0x190/0x390
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85257eff>] core_sys_select+0x1ff/0x340
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85457051>] ? tty_write_unlock+0x31/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8545e1d9>] ? tty_ldisc_deref+0x19/0x20
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8545729b>] ? tty_write+0x1eb/0x2c0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85459970>] ? n_tty_ioctl+0xe0/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8525810a>] SyS_select+0xca/0x120
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:47 fir-io1-s1 kernel: bash R running task 0 31086 31084 0x00000088
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850d5d88>] sched_show_task+0xa8/0x110
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850d5e72>] show_state_filter+0x82/0xd0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85461ef0>] sysrq_handle_showstate+0x10/0x20
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8546268d>] __handle_sysrq+0x10d/0x170
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85462af8>] write_sysrq_trigger+0x28/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff852b81a0>] proc_reg_write+0x40/0x80
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85241310>] vfs_write+0xc0/0x1f0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8524212f>] SyS_write+0x7f/0xf0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:47 fir-io1-s1 kernel: ll_ost_io03_068 D ffff985b91e5d140 0 31645 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:47 fir-io1-s1 kernel: ll_ost_io03_069 D ffff985b91e5a080 0 31738 2 0x00000080
Mar 21 10:26:47 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:47 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: ll_ost_io03_070 D ffff985b91e5c100 0 31777 2 0x00000080
Mar 21 10:26:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff853756d5>] ? cpumask_next_and+0x35/0x50
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc146a4a5>] ? ldiskfs_do_update_inode+0x525/0x810 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff851c0e76>] ? __alloc_pages_nodemask+0x176/0x420
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852195fe>] ? kmalloc_order_trace+0x2e/0xa0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: ll_ost_io03_071 D ffff985b91e59040 0 31778 2 0x00000080
Mar 21 10:26:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189208.64797
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: ll_ost_io03_072 D ffff985b91e58000 0 31832 2 0x00000080
Mar 21 10:26:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:48 fir-io1-s1 kernel: ll_ost_io03_073 D ffff986366e44100 0 31833 2 0x00000080
Mar 21 10:26:48 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:48 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852195fe>] ? kmalloc_order_trace+0x2e/0xa0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: ll_ost_io03_074 D ffff986366e42080 0 31834 2 0x00000080
Mar 21 10:26:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: ll_ost_io03_075 D ffff986366e40000 0 31835 2 0x00000080
Mar 21 10:26:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: ll_ost_io03_076 D ffff987835e54100 0 31900 2 0x00000080
Mar 21 10:26:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:49 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189209.96655
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852ad3ba>] dquot_acquire+0x3a/0x150
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1485ad6>] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852aee8d>] __dquot_initialize+0xad/0x1c0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff852aefb3>] dquot_initialize+0x13/0x20
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc151b87c>] osd_write_commit+0xec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:49 fir-io1-s1 kernel: ll_ost_io00_105 D ffff987835e52080 0 31901 2 0x00000080
Mar 21 10:26:49 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:26:49 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: ll_ost_io00_106 D ffff987835e530c0 0 31902 2 0x00000080
Mar 21 10:26:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: ll_ost_io00_107 D ffff987835e55140 0 31903 2 0x00000080
Mar 21 10:26:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff851cab71>] ? shrink_page_list+0x461/0xc30
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1468c26>] ? ldiskfs_getblk+0xa6/0x200 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc151c909>] osd_ldiskfs_write_record+0xd9/0x410 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc151cd80>] osd_write+0x140/0x5c0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0ba2116>] dt_record_write+0x36/0x120 [obdclass]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e30387>] tgt_client_data_write.isra.18+0x167/0x180 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e32e06>] tgt_last_rcvd_update+0x656/0xc90 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e37c3d>] tgt_txn_stop_cb+0x19d/0x490 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85269218>] ? generic_setxattr+0x68/0x80
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0ba33b1>] dt_txn_hook_stop+0x81/0xd0 [obdclass]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc150367d>] osd_trans_stop+0x18d/0x8e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc166092b>] ofd_object_punch+0x4cb/0xd30 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: ll_ost_io02_100 D ffff98697e9cc100 0 31917 2 0x00000080
Mar 21 10:26:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189210.73073
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:50 fir-io1-s1 kernel: ll_ost_io00_108 D ffff98697e9ca080 0 31918 2 0x00000080
Mar 21 10:26:50 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:50 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: ll_ost_io00_109 D ffff98697e9c8000 0 31919 2 0x00000080
Mar 21 10:26:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85765721>] ? schedule_timeout+0x221/0x2d0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850cec1a>] ? task_rq_unlock+0x1a/0x20
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850d1b8a>] ? __sched_setscheduler+0xa8a/0xab0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189211.94267
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: ll_ost_io00_110 D ffff98697e9ce180 0 31920 2 0x00000080
Mar 21 10:26:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: ll_ost_io00_111 D ffff98697e9cb0c0 0 31926 2 0x00000080
Mar 21 10:26:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850e0000>] ? update_curr+0x30/0x1e0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:51 fir-io1-s1 kernel: ll_ost_io02_101 D ffff986a05dad140 0 31927 2 0x00000080
Mar 21 10:26:51 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:51 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: ll_ost_io03_077 D ffff986a05dae180 0 31940 2 0x00000080
Mar 21 10:26:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff851dde43>] ? compaction_suitable+0xa3/0xb0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: ll_ost_io03_078 D ffff986a05dac100 0 31941 2 0x00000080
Mar 21 10:26:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e39982>] req_can_reconstruct+0x42/0x100 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e4262a>] tgt_request_handle+0xdba/0x1580 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: ll_ost_io02_102 D ffff986a05da9040 0 31947 2 0x00000080
Mar 21 10:26:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765897>] __wait_on_bit+0x67/0x90
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765a01>] out_of_line_wait_on_bit+0x81/0xb0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc08c4cf5>] do_get_write_access+0x285/0x4d0 [jbd2]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc151e59c>] osd_punch+0x28c/0x6b0 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: ll_ost_io02_103 D ffff986ebedbb0c0 0 31948 2 0x00000080
Mar 21 10:26:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:52 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189212.73283
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765721>] ? schedule_timeout+0x221/0x2d0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850cec1a>] ? task_rq_unlock+0x1a/0x20
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850d1b8a>] ? __sched_setscheduler+0xa8a/0xab0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:52 fir-io1-s1 kernel: ll_ost_io03_079 D ffff986ebedbc100 0 31949 2 0x00000080
Mar 21 10:26:52 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:52 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: ll_ost_io03_080 D ffff986ebedbe180 0 31957 2 0x00000080
Mar 21 10:26:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: ll_ost_io02_104 S ffff986ebedb9040 0 31969 2 0x00000080
Mar 21 10:26:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: ll_ost_io02_105 D ffff9870736e8000 0 31970 2 0x00000080
Mar 21 10:26:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8521cc79>] ? kmem_cache_alloc_node+0x109/0x200
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151ad40>] osd_do_bio.isra.35+0x4f0/0xb40 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1468700>] ? ldiskfs_map_blocks+0x280/0x700 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: ll_ost_io02_106 D ffff9870736ea080 0 31986 2 0x00000080
Mar 21 10:26:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc03f1b30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:53 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189213.73284
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff851b92be>] ? __find_get_pages+0x11e/0x1c0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc145cfc9>] ldiskfs_orphan_add+0xb9/0x240 [ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc151e59c>] osd_punch+0x28c/0x6b0 [osd_ldiskfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc1660c4b>] ofd_object_punch+0x7eb/0xd30 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:53 fir-io1-s1 kernel: ll_ost_io02_107 D ffff9870736ed140 0 31987 2 0x00000080
Mar 21 10:26:53 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:53 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: ll_ost_io02_108 D ffff9870736ec100 0 32019 2 0x00000080
Mar 21 10:26:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:54 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189214.96624
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: ll_ost_io02_109 D ffff987304029040 0 32020 2 0x00000080
Mar 21 10:26:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765721>] schedule_timeout+0x221/0x2d0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850cec64>] ? __wake_up+0x44/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85101052>] ? ktime_get_ts64+0x52/0xf0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff857672ed>] io_schedule_timeout+0xad/0x130
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85767388>] io_schedule+0x18/0x20
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765d71>] bit_wait_io+0x11/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765921>] __wait_on_bit_lock+0x61/0xc0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765d60>] ? bit_wait+0x50/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765b71>] out_of_line_wait_on_bit_lock+0x81/0xb0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c2dc0>] ? wake_bit_function+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85278f42>] __lock_buffer+0x32/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc08c4ea2>] do_get_write_access+0x432/0x4d0 [jbd2]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff8527918d>] ? __getblk+0x2d/0x300
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc08c4f67>] jbd2_journal_get_write_access+0x27/0x40 [jbd2]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc148e51b>] __ldiskfs_journal_get_write_access+0x3b/0x80 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc146bdc0>] ldiskfs_reserve_inode_write+0x70/0xa0 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ? ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc146be43>] ldiskfs_mark_inode_dirty+0x53/0x210 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc146f8b0>] ldiskfs_dirty_inode+0x40/0x60 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd8f1>] osd_attr_set+0x3f1/0xb90 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1664208>] ofd_commitrw_write+0x1288/0x1d40 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85767c49>] ? schedule+0x29/0x70
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765721>] ? schedule_timeout+0x221/0x2d0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850cec1a>] ? task_rq_unlock+0x1a/0x20
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850d1b8a>] ? __sched_setscheduler+0xa8a/0xab0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de7c4d>] ? ptlrpc_start_thread+0x27d/0xbf0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:54 fir-io1-s1 kernel: ll_ost_io02_110 D ffff98730402d140 0 32039 2 0x00000080
Mar 21 10:26:54 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff853756d5>] ? cpumask_next_and+0x35/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc146a4a5>] ? ldiskfs_do_update_inode+0x525/0x810 [ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:54 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: ll_ost_io02_111 D ffff98730402c100 0 32040 2 0x00000080
Mar 21 10:26:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: ll_ost_io03_081 D ffff984832780000 0 32066 2 0x00000080
Mar 21 10:26:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: ll_ost_io03_082 D ffff985b91e5b0c0 0 32098 2 0x00000080
Mar 21 10:26:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:55 fir-io1-s1 kernel: ll_ost_io03_083 D ffff985b91e5e180 0 32118 2 0x00000080
Mar 21 10:26:55 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc11c3829>] raid5_get_active_stripe+0x4b9/0x6e0 [raid456]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff853756d5>] ? cpumask_next_and+0x35/0x50
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc11c3bf5>] raid5_make_request+0x1a5/0xc70 [raid456]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff8558d330>] md_handle_request+0xd0/0x150
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff8534311f>] ? generic_make_request_checks+0x27f/0x390
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff8558d499>] md_make_request+0x79/0x190
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85344ef7>] generic_make_request+0x147/0x380
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85587a86>] ? md_mergeable_bvec+0x46/0x50
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff853451a0>] submit_bio+0x70/0x150
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0b79777>] ? lprocfs_oh_tally+0x17/0x40 [obdclass]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1518bdc>] osd_submit_bio+0x1c/0x60 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc151b295>] osd_do_bio.isra.35+0xa45/0xb40 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc148e82b>] ? __ldiskfs_handle_dirty_metadata+0x8b/0x220 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc08cf635>] ? jbd2_journal_add_journal_head+0x65/0x150 [jbd2]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff8527882d>] ? __brelse+0x3d/0x50
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc146a4a5>] ? ldiskfs_do_update_inode+0x525/0x810 [ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc151bb7c>] osd_write_commit+0x3ec/0x8c0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:55 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: ll_ost_io03_084 D ffff98384a3f0000 0 32236 2 0x00000080
Mar 21 10:26:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: ll_ost_io03_085 D ffff98384a3f1040 0 32522 2 0x00000080
Mar 21 10:26:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff8521a07e>] ? get_partial_node.isra.49+0xfe/0x230
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14a7545>] ? __read_extent_tree_block+0x55/0x1e0 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14a85e4>] ? ldiskfs_ext_find_extent+0x134/0x340 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: ll_ost_io03_086 D ffff98384a3f2080 0 32740 2 0x00000080
Mar 21 10:26:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1503755>] osd_trans_stop+0x265/0x8e0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc146f8c4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc165ce65>] ofd_trans_stop+0x25/0x60 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1663954>] ofd_commitrw_write+0x9d4/0x1d40 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: ll_ost_io03_087 D ffff9838659fa080 0 32836 2 0x00000080
Mar 21 10:26:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc15313d0>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1663e9e>] ofd_commitrw_write+0xf1e/0x1d40 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189216.31778
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:56 fir-io1-s1 kernel: ll_ost_io03_088 D ffff9838659fc100 0 33046 2 0x00000080
Mar 21 10:26:56 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:56 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0dd82f7>] ? lustre_msg_buf+0x17/0x60 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0dffd9f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0b81279>] ? class_handle2object+0xb9/0x1c0 [obdclass]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850e011c>] ? update_curr+0x14c/0x1e0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850dca7e>] ? account_entity_dequeue+0xae/0xd0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: LustreError: 94224:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 168s: evicting client at 10.8.2.24@o2ib6 ns: filter-fir-OST0004_UUID lock: ffff9849ea191f80/0x49e1862f8f7328aa lrc: 3/0,0 mode: PW/PW res: [0x8c0000401:0x4e4a1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->8392703) flags: 0x60000400000020 nid: 10.8.2.24@o2ib6 remote: 0xa77554878cca2f7a expref: 26 pid: 96356 timeout: 3536900 lvb_type: 0
Mar 21 10:26:57 fir-io1-s1 kernel: LustreError: 94224:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 5 previous similar messages
Mar 21 10:26:57 fir-io1-s1 kernel: LustreError: 43173:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff98382566f500 x1625508962351680/t0(0) o105->fir-OST0004@10.8.2.24@o2ib6:15/16 lens 360/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
Mar 21 10:26:57 fir-io1-s1 kernel: LustreError: 43173:0:(client.c:1175:ptlrpc_import_delay_req()) Skipped 24 previous similar messages
Mar 21 10:26:57 fir-io1-s1 kernel: ll_ost_io03_089 D ffff9838659fd140 0 33141 2 0x00000080
Mar 21 10:26:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852b162f>] __dquot_alloc_space+0x1ef/0x250
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff853a01c1>] ? __percpu_counter_add+0x51/0x70
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14a0941>] ldiskfs_mb_new_blocks+0xe1/0xb20 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc149903b>] ? ldiskfs_es_insert_extent+0xdb/0x1c0 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1498800>] ? __es_tree_search+0x60/0x80 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189217.31832
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff8521d61b>] ? __kmalloc+0x1eb/0x230
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14a8742>] ? ldiskfs_ext_find_extent+0x292/0x340 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14a6cd3>] ? ldiskfs_ext_put_gap_in_cache+0x83/0x90 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14aca26>] ldiskfs_ext_map_blocks+0x4a6/0xf60 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14685d5>] ldiskfs_map_blocks+0x155/0x700 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc151a443>] osd_ldiskfs_map_inode_pages+0x143/0x420 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc151bb32>] osd_write_commit+0x3a2/0x8c0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1663f3e>] ofd_commitrw_write+0xfbe/0x1d40 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: ll_ost_io03_090 D ffff983807810000 0 33496 2 0x00000080
Mar 21 10:26:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: ll_ost_io03_091 D ffff983807811040 0 33577 2 0x00000080
Mar 21 10:26:57 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1467703>] ? __ldiskfs_get_inode_loc+0xe3/0x3c0 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852ad3ba>] dquot_acquire+0x3a/0x150
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1485ad6>] ldiskfs_acquire_dquot+0x66/0xb0 [ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852aed8a>] dqget+0x3fa/0x450
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff852b13c4>] dquot_transfer+0x64/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:57 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: ll_ost_io03_092 D ffff983807812080 0 33627 2 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: sleep S ffff9838078130c0 0 33632 122988 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:58 fir-io1-s1 kernel: ll_ost_io03_093 D ffff983807814100 0 33664 2 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: ll_ost_io03_094 D ffff983807815140 0 33683 2 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1660baa>] ofd_object_punch+0x74a/0xd30 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc164dcf3>] ofd_punch_hdl+0x493/0xa30 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: ll_ost_io03_095 D ffff983801262080 0 33776 2 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc147137d>] ? ldiskfs_xattr_get+0x7d/0x2f0 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852195fe>] ? kmalloc_order_trace+0x2e/0xa0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189218.73059
Mar 21 10:26:58 fir-io1-s1 kernel: kworker/u256:2 S ffff983801264100 0 33831 2 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850b9dea>] ? process_one_work+0x21a/0x440
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850bae99>] worker_thread+0x1d9/0x3c0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:58 fir-io1-s1 kernel: ll_ost_io03_096 D ffff983801265140 0 33849 2 0x00000080
Mar 21 10:26:58 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85768b69>] schedule_preempt_disabled+0x29/0x70
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85766ab7>] __mutex_lock_slowpath+0xc7/0x1d0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff85765e9f>] mutex_lock+0x1f/0x2f
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852ae2d9>] dquot_commit+0x29/0xd0
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1485b8c>] ldiskfs_write_dquot+0x6c/0x90 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffffc1485bef>] ldiskfs_mark_dquot_dirty+0x3f/0x60 [ldiskfs]
Mar 21 10:26:58 fir-io1-s1 kernel: [<ffffffff852b106a>] __dquot_transfer+0x24a/0x540
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85765e92>] ? mutex_lock+0x12/0x2f
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85760000>] ? load_elf_interp.constprop.11+0xd1/0x426
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff852a0000>] ? locks_remove_file+0xe0/0x210
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff852b13dc>] dquot_transfer+0x7c/0xe0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14f048d>] osd_quota_transfer+0xdd/0x210 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc08c3a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14fd61f>] osd_attr_set+0x11f/0xb90 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14fd255>] ? osd_trans_start+0x235/0x4e0 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc1664342>] ofd_commitrw_write+0x13c2/0x1d40 [ofd]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:59 fir-io1-s1 kernel: sleep S ffff98491a89a080 0 33962 12675 0x00000080
Mar 21 10:26:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c5cad>] ? hrtimer_start_range_ns+0x1ed/0x3c0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85766c46>] do_nanosleep+0x86/0xf0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c6a6b>] hrtimer_nanosleep+0xbb/0x180
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c57e0>] ? hrtimer_get_res+0x50/0x50
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85766c32>] ? do_nanosleep+0x72/0xf0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c6bc6>] SyS_nanosleep+0x96/0xb0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85774ddb>] system_call_fastpath+0x22/0x27
Mar 21 10:26:59 fir-io1-s1 kernel: ll_ost_io03_097 S ffff983823c06180 0 34169 2 0x00000080
Mar 21 10:26:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de3a55>] ptlrpc_wait_event+0x345/0x360 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850d67b0>] ? wake_up_state+0x20/0x20
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de9fb3>] ptlrpc_main+0x853/0x1fc0 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:59 fir-io1-s1 kernel: ll_ost_io03_098 D ffff983809ed9040 0 34249 2 0x00000080
Mar 21 10:26:59 fir-io1-s1 kernel: Call Trace:
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85767c49>] schedule+0x29/0x70
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc08c3085>] wait_transaction_locked+0x85/0xd0 [jbd2]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c2d00>] ? wake_up_atomic_t+0x30/0x30
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc08c3368>] add_transaction_credits+0x268/0x2f0 [jbd2]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc08c35e1>] start_this_handle+0x1a1/0x430 [jbd2]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14f58b1>] ? osd_declare_xattr_set+0xf1/0x3a0 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff8521c0b2>] ? kmem_cache_alloc+0x1c2/0x1f0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc08c3a93>] jbd2__journal_start+0xf3/0x1f0 [jbd2]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] ? osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc148e2c9>] __ldiskfs_journal_start_sb+0x69/0xe0 [ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc14fd22e>] osd_trans_start+0x20e/0x4e0 [osd_ldiskfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc165cdc5>] ofd_trans_start+0x75/0xf0 [ofd]
Mar 21 10:26:59 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189219.96401
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc16639b1>] ofd_commitrw_write+0xa31/0x1d40 [ofd]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc1667dc2>] ofd_commitrw+0x4b2/0xa10 [ofd]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e3be2c>] obd_commitrw+0x9c/0x370 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e3ea9d>] tgt_brw_write+0x100d/0x1a90 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0d93a30>] ? target_send_reply_msg+0x170/0x170 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e4235a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de692b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1c31>] kthread+0xd1/0xe0
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff85774c24>] ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:26:59 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:26:59 fir-io1-s1 kernel: Sched Debug Version: v0.11, 3.10.0-957.1.3.el7_lustre.x86_64 #1
Mar 21 10:26:59 fir-io1-s1 kernel: ktime : 3536970340.279825
Mar 21 10:26:59 fir-io1-s1 kernel: sched_clk : 3537107786.116267
Mar 21 10:26:59 fir-io1-s1 kernel: cpu_clk : 3537107786.116297
Mar 21 10:26:59 fir-io1-s1 kernel: jiffies : 7831637664
Mar 21 10:26:59 fir-io1-s1 kernel: sched_clock_stable() : 1
Mar 21 10:26:59 fir-io1-s1 kernel:
Mar 21 10:26:59 fir-io1-s1 kernel: sysctl_sched
Mar 21 10:26:59 fir-io1-s1 kernel: .sysctl_sched_latency : 24.000000
Mar 21 10:26:59 fir-io1-s1 kernel: .sysctl_sched_min_granularity : 10.000000
Mar 21 10:26:59 fir-io1-s1 kernel: .sysctl_sched_wakeup_granularity : 4.000000
Mar 21 10:26:59 fir-io1-s1 kernel: .sysctl_sched_child_runs_first : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .sysctl_sched_features : 56955
Mar 21 10:26:59 fir-io1-s1 kernel: .sysctl_sched_tunable_scaling : 1 (logaritmic)
Mar 21 10:26:59 fir-io1-s1 kernel:
Mar 21 10:26:59 fir-io1-s1 kernel: cpu#0, 1996.172 MHz
Mar 21 10:26:59 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .load : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .nr_switches : 18528101419
Mar 21 10:26:59 fir-io1-s1 kernel: .nr_load_updates : 2059517551
Mar 21 10:26:59 fir-io1-s1 kernel: .nr_uninterruptible : 2316650
Mar 21 10:26:59 fir-io1-s1 kernel: .next_balance : 7831.637751
Mar 21 10:26:59 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .clock : 3537107907.848553
Mar 21 10:26:59 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:26:59 fir-io1-s1 kernel: .avg_idle : 4141888
Mar 21 10:26:59 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:26:59 fir-io1-s1 kernel:
Mar 21 10:27:00 fir-io1-s1 kernel: cfs_rq[0]:/
Mar 21 10:27:00 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:00 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:00 fir-io1-s1 kernel: .min_vruntime : 117885064.768810
Mar 21 10:27:00 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:00 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:00 fir-io1-s1 kernel: .spread0 : 0.000000
Mar 21 10:27:00 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:00 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .avg->runnable_avg_sum : 79
Mar 21 10:27:00 fir-io1-s1 kernel: .avg->runnable_avg_period : 46403
Mar 21 10:27:00 fir-io1-s1 kernel:
Mar 21 10:27:00 fir-io1-s1 kernel: rt_rq[0]:/
Mar 21 10:27:00 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:00 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:00 fir-io1-s1 kernel:
Mar 21 10:27:00 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:00 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:00 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:00 fir-io1-s1 kernel: ksoftirqd/0 3 117885021.554212 134019270 120 0.000000 2223220.269097 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kworker/0:0H 5 6475.712673 8 100 0.000000 0.025237 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: migration/0 8 0.000000 33177 0 0.000000 37145.495681 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: rcu_bh 9 513.644335 2 120 0.000000 0.001773 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: rcu_sched 10 117885064.875713 959357098 120 0.000000 12353283.275085 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: lru-add-drain 11 517.646437 2 100 0.000000 0.002515 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: watchdog/0 12 0.000000 884246 0 0.000000 10897.415366 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: irq/26-AMD-Vi 269 0.000000 4 49 0.000000 10.884903 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kswapd0 277 117883975.352967 2035147 120 0.000000 4321511.856589 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kworker/0:1H 7860 117885052.768855 400915075 100 0.000000 2628304.974415 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kdmwork-253:23 45886 117885026.420510 297045280 120 0.000000 5029360.763293 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kdmflush 45951 32444.031629 2 100 0.000000 0.013086 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 46025 32537.955683 2 100 0.000000 0.013606 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 46041 32579.169915 2 100 0.000000 0.013525 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kdmflush 46046 32609.295506 2 100 0.000000 0.013596 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 46047 32617.306827 2 100 0.000000 0.012384 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kdmwork-253:34 46090 117885047.875673 290171994 120 0.000000 5029331.754514 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 53991 35892.567255 2 100 0.000000 0.013646 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 54538 36332.692783 2 100 0.000000 0.012424 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 56765 37200.034788 2 100 0.000000 0.013847 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kdmwork-253:78 57826 117885047.885011 291977939 120 0.000000 4475169.148345 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kdmwork-253:92 58474 117885029.611130 204154391 120 0.000000 3919969.280465 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: auditd 71260 117882558.691615 28267 116 0.000000 706.620506 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: irqbalance 71310 117885057.609995 609795 120 0.000000 2932660.218455 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpc_hr00_000 91336 50578.538894 3 120 0.000000 0.025057 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpc_hr00_002 91338 50578.545637 3 120 0.000000 0.017634 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpc_hr00_003 91339 50578.553662 3 120 0.000000 0.018506 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpc_hr00_004 91340 50578.561888 3 120 0.000000 0.018646 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpc_hr00_005 91341 50578.572488 3 120 0.000000 0.020720 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpcd_00_01 91430 14742158.463784 8 120 0.000000 0.139286 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpcd_00_04 91433 14742158.464685 8 120 0.000000 0.114119 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpcd_00_06 91435 14742471.457281 9 120 0.000000 0.151409 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpcd_00_08 91437 14742471.428676 7 120 0.000000 0.104311 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ptlrpcd_00_10 91439 14724461.999051 5 120 0.000000 0.087166 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: md10_raid6 91871 117882910.102126 561258851 120 0.000000 181568207.358624 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: bioset 92220 50808.395150 2 100 0.000000 0.013576 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kmmpd-md10 94157 117882915.551832 11263845 120 0.000000 76909.053569 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_cb00_001 94202 14727023.007141 13 120 0.000000 0.321174 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_000 94256 117884014.456041 29049444 120 0.000000 1968191.443494 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_seq00_00 94268 51971.662089 3 120 0.000000 0.048823 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_seq00_00 94269 51971.676838 3 120 0.000000 0.024257 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_out00_00 94276 51971.714530 3 120 0.000000 0.047792 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_out00_00 94277 51971.732344 3 120 0.000000 0.026421 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: jbd2/md8-8 94286 117883983.537043 9363211 120 0.000000 722747.417598 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_014 96263 117884986.217631 289958494 120 0.000000 9073089.069048 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_005 96293 117883976.553526 31204653 120 0.000000 2310078.780089 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_023 96332 117885018.010688 389624224 120 0.000000 11631573.824249 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_017 96380 117882966.911589 19625659 120 0.000000 1401979.396982 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_032 96500 117882936.558385 31790035 120 0.000000 2913812.699881 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_034 96509 117884078.572462 17690243 120 0.000000 2169387.085284 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_cn00_005 96511 117884075.485764 63907523 120 0.000000 1711062.139614 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_028 96513 113104439.551842 351950607 120 0.000000 10549855.686707 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_037 96762 117856468.729231 392626229 120 0.000000 11678702.954711 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_050 96784 117884871.310006 352994874 120 0.000000 10714771.064634 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_051 96785 117856336.777934 356250115 120 0.000000 10464914.742012 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_053 96887 117885059.749954 327401661 120 0.000000 10003931.080420 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_054 96889 117884858.653828 350886761 120 0.000000 10641404.792976 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_058 96905 113104511.666122 354747516 120 0.000000 10749932.103104 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_064 96921 117884866.693024 371990696 120 0.000000 11084494.214474 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_cn00_011 117071 114987603.134768 40970733 120 0.000000 1146483.728891 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_bl_08 2745 117884837.959178 2513035 120 0.000000 26638.185128 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_068 73072 117883984.479392 15422126 120 0.000000 1933488.426203 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_070 73074 117882916.967367 20881865 120 0.000000 2033883.367123 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost_io00_086 73279 117884076.192285 33054004 120 0.000000 4111870.475809 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_cn00_020 81397 114987603.134908 39510318 120 0.000000 1093751.209421 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_cn00_021 81398 117885052.799490 54697142 120 0.000000 1485999.651059 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_072 49822 117884975.625401 364362955 120 0.000000 10878021.572146 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_076 49826 117885037.321336 318716230 120 0.000000 9696076.187160 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_bl_21 43172 117884162.164730 1312151 120 0.000000 17856.060739 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ldlm_bl_25 51512 117884974.439949 1223485 120 0.000000 14002.458037 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: ll_ost00_085 110032 113104439.551311 84411138 120 0.000000 2876435.294502 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kworker/0:2 91206 117885052.817082 878191 120 0.000000 17552.396576 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kworker/0:1 34115 117547835.494990 2 120 0.000000 0.010900 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel: kworker/u257:1 3540 117885052.826700 9623 120 0.000000 338.858943 0.000000 0 /
Mar 21 10:27:00 fir-io1-s1 kernel:
Mar 21 10:27:00 fir-io1-s1 kernel: cpu#1, 1996.172 MHz
Mar 21 10:27:00 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .nr_switches : 23837553692
Mar 21 10:27:00 fir-io1-s1 kernel: .nr_load_updates : 2143609097
Mar 21 10:27:00 fir-io1-s1 kernel: .nr_uninterruptible : -236763
Mar 21 10:27:00 fir-io1-s1 kernel: .next_balance : 7831.638829
Mar 21 10:27:00 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .clock : 3537108986.888786
Mar 21 10:27:00 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:00 fir-io1-s1 kernel: .cpu_load[1] : 4
Mar 21 10:27:00 fir-io1-s1 kernel: .cpu_load[2] : 153
Mar 21 10:27:00 fir-io1-s1 kernel: .cpu_load[3] : 63
Mar 21 10:27:00 fir-io1-s1 kernel: .cpu_load[4] : 42
Mar 21 10:27:00 fir-io1-s1 kernel: .avg_idle : 669566
Mar 21 10:27:00 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:00 fir-io1-s1 kernel:
Mar 21 10:27:01 fir-io1-s1 kernel: cfs_rq[1]:/
Mar 21 10:27:01 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:01 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:01 fir-io1-s1 kernel: .min_vruntime : 154231003.755322
Mar 21 10:27:01 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:01 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:01 fir-io1-s1 kernel: .spread0 : 36345937.735564
Mar 21 10:27:01 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:01 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .avg->runnable_avg_sum : 168
Mar 21 10:27:01 fir-io1-s1 kernel: .avg->runnable_avg_period : 46760
Mar 21 10:27:01 fir-io1-s1 kernel:
Mar 21 10:27:01 fir-io1-s1 kernel: rt_rq[1]:/
Mar 21 10:27:01 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:01 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:01 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:01 fir-io1-s1 kernel:
Mar 21 10:27:01 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:01 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:01 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:01 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189220.31835
Mar 21 10:27:01 fir-io1-s1 kernel: watchdog/1 13 -2.961897 884245 0 0.000000 11349.270457 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: migration/1 14 0.000000 67783 0 0.000000 24316.574252 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ksoftirqd/1 15 154230916.200594 219563202 120 0.000000 4608560.083657 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kworker/1:0H 17 12140.419586 9 100 0.000000 0.048822 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kblockd 263 12140.416888 4 100 0.000000 0.023364 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kworker/u263:0 7387 2151.264528 4 100 0.000000 0.016662 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ccp-4-q0 34109 7652.928397 2 120 0.000000 0.008465 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ccp-4-q1 34110 7660.935619 2 120 0.000000 0.007224 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ccp-4-q2 34111 7668.941428 2 120 0.000000 0.005811 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ccp-4-q3 34112 7676.947428 2 120 0.000000 0.006002 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ccp-4-q4 34113 7684.955081 2 120 0.000000 0.007655 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: bioset 43675 10790.358773 2 100 0.000000 0.011672 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kdmwork-253:9 43676 28924.131497 125 120 0.000000 1.673586 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: bioset 45953 11857.012182 2 100 0.000000 0.012595 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kdmflush 45962 11870.405256 2 100 0.000000 0.011012 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: bioset 46231 12094.789780 2 100 0.000000 0.011984 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kworker/1:1H 46295 154230947.345654 468177409 100 0.000000 3673298.740481 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kdmwork-253:56 54853 154230924.115960 295281114 120 0.000000 5151335.896485 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kdmwork-253:86 58277 154230688.229089 228049965 120 0.000000 4081555.133117 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: bioset 58680 19137.035703 2 100 0.000000 0.012644 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kdmflush 58770 19336.774058 2 100 0.000000 0.011011 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kdmwork-253:110 59316 154230688.213589 226317279 120 0.000000 4345599.940467 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: gdbus 71327 154230839.329934 737956 120 0.000000 44320.691757 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: in:imjournal 72464 154231003.755322 4105037 120 0.000000 134117.243300 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpc_hr01_000 91342 28935.219570 3 120 0.000000 0.019247 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpc_hr01_001 91343 28935.226624 3 120 0.000000 0.017293 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpc_hr01_002 91344 28935.233307 3 120 0.000000 0.016462 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpc_hr01_003 91346 28935.239429 3 120 0.000000 0.015711 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpc_hr01_004 91347 28935.245521 3 120 0.000000 0.016563 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpc_hr01_005 91348 28935.253165 3 120 0.000000 0.017453 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_01 91442 4961774.625807 5 120 0.000000 0.096725 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_02 91443 8630946.229687 5 120 0.000000 0.073220 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_04 91445 9161475.086309 5 120 0.000000 0.097395 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_06 91447 21866253.343939 5 120 0.000000 0.080254 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_08 91449 28935.791515 3 120 0.000000 0.021210 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_09 91450 28935.801935 3 120 0.000000 0.020058 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_10 91451 28935.811774 3 120 0.000000 0.019477 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ptlrpcd_01_11 91452 28935.823527 3 120 0.000000 0.021311 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_cb01_000 94203 34891.300432 3 120 0.000000 0.048773 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_cb01_001 94204 34891.313978 3 120 0.000000 0.022944 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_seq01_00 94270 34892.741219 3 120 0.000000 0.047962 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_seq01_00 94271 34892.754805 3 120 0.000000 0.022954 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_out01_00 94278 34892.791866 3 120 0.000000 0.046288 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_out01_00 94279 34892.805161 3 120 0.000000 0.022151 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_005 94512 154230661.697683 366112299 120 0.000000 11596921.806568 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_009 96243 154230611.933075 425978365 120 0.000000 13284705.359148 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_014 96254 154230417.265207 359402618 120 0.000000 11411866.476497 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_017 96261 154230863.431717 399739984 120 0.000000 12574848.173939 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_007 96300 154230013.190088 10382472 120 0.000000 673664.344356 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_030 96352 154230710.512459 440678964 120 0.000000 13647276.817145 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_032 96354 154230906.502418 471881480 120 0.000000 14578673.532247 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_022 96393 154230330.554481 28804106 120 0.000000 3090826.964244 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_cn01_004 96402 154230718.800638 72474407 120 0.000000 1945688.992395 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_053 96404 148739440.036578 394943472 120 0.000000 12649648.563499 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_055 96406 154230573.517389 400163684 120 0.000000 12234956.649138 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_025 96412 154230046.870642 50894630 120 0.000000 4801545.060924 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_056 96413 154230079.081229 356402115 120 0.000000 11453380.308433 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_028 96420 154230027.089653 35388668 120 0.000000 3862931.303766 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_035 96456 154230032.463119 70840966 120 0.000000 6460820.920839 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_048 96485 154230036.550780 45919726 120 0.000000 3798893.552541 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_049 96487 154230014.666917 18805581 120 0.000000 1129989.440728 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_058 96491 154230992.971612 419350141 120 0.000000 13151228.104454 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_051 96517 154230010.670904 15696556 120 0.000000 1729655.855658 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_062 96524 154230922.338330 340545515 120 0.000000 11208783.652235 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_060 96553 154230176.235446 6662289 120 0.000000 500528.654362 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_067 96596 154230181.865544 27535116 120 0.000000 2905279.547455 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_071 96620 154230669.716219 440443625 120 0.000000 13646289.960291 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_074 96633 154230157.172915 43327365 120 0.000000 4352688.594117 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_099 96681 154230029.666681 20032896 120 0.000000 1244367.195084 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_104 96686 154230200.660640 22318335 120 0.000000 2748501.354390 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_105 96687 154230044.893329 27845562 120 0.000000 1802843.132305 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost_io01_109 96691 154230117.376534 23904064 120 0.000000 1979186.210487 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_080 96891 154230672.006268 377594873 120 0.000000 12078953.141893 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_087 96900 154230147.584698 324709573 120 0.000000 10650197.092150 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_cn01_005 96923 154161869.364521 70015184 120 0.000000 1898717.524800 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_099 96925 154230336.022209 452919817 120 0.000000 13730607.218588 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ll_ost01_109 96941 154230722.237226 374925310 120 0.000000 11735755.146418 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_cn01_012 117027 154230991.769820 68157832 120 0.000000 1853998.060238 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: lst_t_01_01 48572 5437053.268163 20956 120 0.000000 669.948048 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: lst_t_01_03 48575 5437053.712198 20935 120 0.000000 671.440388 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: lst_t_01_05 48577 5437055.927145 20937 120 0.000000 657.828206 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: lst_t_01_06 48578 5437053.942813 20936 120 0.000000 664.983704 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: lst_t_01_09 48581 5437054.403161 20943 120 0.000000 662.649245 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_bl_17 43088 154230991.769590 1315747 120 0.000000 15532.171089 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: ldlm_bl_34 51522 154230920.531100 1220771 120 0.000000 13381.550850 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kworker/1:1 92339 154230991.761975 1629767 120 0.000000 28544.104401 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kworker/1:0 116928 150246435.529578 2 120 0.000000 0.010851 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel: kworker/u256:0 29095 154230889.086174 1375 120 0.000000 15.197335 0.000000 1 /
Mar 21 10:27:01 fir-io1-s1 kernel:
Mar 21 10:27:01 fir-io1-s1 kernel: cpu#2, 1996.172 MHz
Mar 21 10:27:01 fir-io1-s1 kernel: .nr_running : 6
Mar 21 10:27:01 fir-io1-s1 kernel: .load : 91833
Mar 21 10:27:01 fir-io1-s1 kernel: .nr_switches : 18345399668
Mar 21 10:27:01 fir-io1-s1 kernel: .nr_load_updates : 1879280576
Mar 21 10:27:01 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189221.31902
Mar 21 10:27:01 fir-io1-s1 kernel: .nr_uninterruptible : -280297
Mar 21 10:27:01 fir-io1-s1 kernel: .next_balance : 7831.640169
Mar 21 10:27:01 fir-io1-s1 kernel: .curr->pid : 31086
Mar 21 10:27:01 fir-io1-s1 kernel: .clock : 3536860168.916232
Mar 21 10:27:01 fir-io1-s1 kernel: .cpu_load[0] : 91833
Mar 21 10:27:01 fir-io1-s1 kernel: .cpu_load[1] : 91833
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[2] : 91833
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[3] : 91833
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[4] : 91833
Mar 21 10:27:02 fir-io1-s1 kernel: .avg_idle : 172922
Mar 21 10:27:02 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:02 fir-io1-s1 kernel:
Mar 21 10:27:02 fir-io1-s1 kernel: cfs_rq[2]:/
Mar 21 10:27:02 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:02 fir-io1-s1 kernel: .MIN_vruntime : 144776817.172004
Mar 21 10:27:02 fir-io1-s1 kernel: .min_vruntime : 144776829.172004
Mar 21 10:27:02 fir-io1-s1 kernel: .max_vruntime : 144776817.172004
Mar 21 10:27:02 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:02 fir-io1-s1 kernel: .spread0 : 26891761.647319
Mar 21 10:27:02 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .nr_running : 4
Mar 21 10:27:02 fir-io1-s1 kernel: .load : 91833
Mar 21 10:27:02 fir-io1-s1 kernel: .runnable_load_avg : 179
Mar 21 10:27:02 fir-io1-s1 kernel: .blocked_load_avg : 1
Mar 21 10:27:02 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:02 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .avg->runnable_avg_sum : 10354
Mar 21 10:27:02 fir-io1-s1 kernel: .avg->runnable_avg_period : 47087
Mar 21 10:27:02 fir-io1-s1 kernel:
Mar 21 10:27:02 fir-io1-s1 kernel: rt_rq[2]:/
Mar 21 10:27:02 fir-io1-s1 kernel: .rt_nr_running : 1
Mar 21 10:27:02 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:02 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:02 fir-io1-s1 kernel:
Mar 21 10:27:02 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:02 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:02 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:02 fir-io1-s1 kernel: watchdog/2 19 -5.960614 884183 0 0.000000 10543.668702 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: migration/2 20 0.000000 47573 0 0.000000 22365.388741 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: ksoftirqd/2 21 144776817.172004 177266608 120 0.000000 3709585.516166 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kworker/2:0H 23 6141.798666 9 100 0.000000 0.034686 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: irq/28-AMD-Vi 271 0.000000 3 49 0.000000 0.031631 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kworker/2:1H 30077 144776817.172004 371766659 100 0.000000 2784022.835496 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kdmwork-253:36 46104 33245.566423 111 120 0.000000 1.706491 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: bioset 51525 13767.570668 2 100 0.000000 0.013245 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kdmwork-253:63 56017 33245.559900 122 120 0.000000 1.680182 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kdmwork-253:77 57669 33245.572796 113 120 0.000000 1.942879 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: bioset 57913 16859.143815 2 100 0.000000 0.013746 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: bioset 58401 17854.055763 2 100 0.000000 0.020670 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kdmwork-253:97 58630 33245.564167 130 120 0.000000 1.857928 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: bioset 58711 18471.675504 2 100 0.000000 0.023105 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: bioset 59960 19771.797841 2 100 0.000000 0.014236 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kdmwork-253:118 62142 33245.579588 114 120 0.000000 0.931026 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: cfs_rh_02 91306 144742350.961037 23645 120 0.000000 11601.051308 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: ldlm_cn02_012 117032 143749548.291020 44507982 120 0.000000 1327645.219269 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: ll_ost_create02 21695 137134294.140407 2036873 120 0.000000 40919.889207 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kworker/2:0 117231 144776817.172004 1943203 120 0.000000 38142.380266 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: kworker/2:1 130792 133610012.915437 3 120 0.000000 0.015089 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel: R bash 31086 144776826.713697 61 120 0.000000 24.522804 0.000000 2 /
Mar 21 10:27:02 fir-io1-s1 kernel:
Mar 21 10:27:02 fir-io1-s1 kernel: cpu#3, 1996.172 MHz
Mar 21 10:27:02 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .nr_switches : 13024202888
Mar 21 10:27:02 fir-io1-s1 kernel: .nr_load_updates : 1799866145
Mar 21 10:27:02 fir-io1-s1 kernel: .nr_uninterruptible : -96393
Mar 21 10:27:02 fir-io1-s1 kernel: .next_balance : 7831.640574
Mar 21 10:27:02 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189222.31918
Mar 21 10:27:02 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .clock : 3537110738.952756
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:02 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:02 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:02 fir-io1-s1 kernel:
Mar 21 10:27:03 fir-io1-s1 kernel: cfs_rq[3]:/
Mar 21 10:27:03 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:03 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:03 fir-io1-s1 kernel: .min_vruntime : 96794600.623004
Mar 21 10:27:03 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:03 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:03 fir-io1-s1 kernel: .spread0 : -21090467.551558
Mar 21 10:27:03 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:03 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .avg->runnable_avg_sum : 79
Mar 21 10:27:03 fir-io1-s1 kernel: .avg->runnable_avg_period : 47153
Mar 21 10:27:03 fir-io1-s1 kernel:
Mar 21 10:27:03 fir-io1-s1 kernel: rt_rq[3]:/
Mar 21 10:27:03 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:03 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:03 fir-io1-s1 kernel:
Mar 21 10:27:03 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:03 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:03 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:03 fir-io1-s1 kernel: watchdog/3 25 -5.969131 884246 0 0.000000 8065.619534 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: migration/3 26 0.000000 21376 0 0.000000 26768.552101 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ksoftirqd/3 27 96794583.173867 128577850 120 0.000000 2548066.564847 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kworker/3:0H 29 6067.139865 9 100 0.000000 0.040528 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: irq/29-AMD-Vi 272 0.000000 3 49 0.000000 0.035016 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kauditd 383 96794588.687800 464169 120 0.000000 4529.679907 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kworker/u265:0 7389 1767.771085 3 100 0.000000 0.012454 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kworker/3:1H 27272 96794583.163247 296140587 100 0.000000 2006111.350658 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ccp-3-q2 33994 8110.247499 2 120 0.000000 0.012053 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kdmwork-253:41 46234 29973.213282 130 120 0.000000 2.053630 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kdmflush 46536 12699.406230 2 100 0.000000 0.030578 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kdmflush 52921 14840.418552 2 100 0.000000 0.013225 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kdmwork-253:58 55073 29973.212071 115 120 0.000000 1.776907 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kdmwork-253:76 57600 29973.216580 123 120 0.000000 1.912372 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kdmflush 57911 17415.788893 2 100 0.000000 0.014178 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: gmain 71321 28757.178535 2 120 0.000000 0.078871 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: sssd_pam 71357 96794588.334452 707250 120 0.000000 18348.406860 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpc_hr03_000 91355 29984.838926 3 120 0.000000 0.031721 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpc_hr03_001 91356 29984.847241 3 120 0.000000 0.025438 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpc_hr03_002 91357 29984.853924 3 120 0.000000 0.016461 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpc_hr03_003 91358 29984.860817 3 120 0.000000 0.017453 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpc_hr03_004 91359 29984.867850 3 120 0.000000 0.017213 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpc_hr03_005 91360 29984.877439 3 120 0.000000 0.019968 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ptlrpcd_03_06 91471 13852107.566144 12 120 0.000000 0.227183 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ldlm_cb03_000 94207 39196.593147 3 120 0.000000 0.051369 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ldlm_cb03_001 94208 39196.607935 3 120 0.000000 0.024637 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ldlm_cn03_000 94219 96794495.750166 25209688 120 0.000000 671922.151882 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_001 94245 83985307.199481 262007934 120 0.000000 7507840.488284 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_create03 94254 95019485.015065 20 120 0.000000 0.103277 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_000 94265 96794389.082389 37354045 120 0.000000 3471371.375952 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_002 94267 96794405.372717 18724025 120 0.000000 2227535.061681 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_seq03_00 94274 39196.975224 3 120 0.000000 0.044394 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_seq03_00 94275 39196.989141 3 120 0.000000 0.022724 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_out03_00 94282 39197.025971 3 120 0.000000 0.046068 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_out03_00 94283 39197.039477 3 120 0.000000 0.022403 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: lquota_wb_fir-O 94428 96794567.443841 58924 120 0.000000 418.151049 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_006 96347 83985307.200563 227752415 120 0.000000 6688319.070607 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_007 96388 96794302.812199 15900914 120 0.000000 1635963.007693 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_008 96391 96794298.787427 24585815 120 0.000000 2594590.000664 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_010 96438 96794347.602223 27449550 120 0.000000 2412387.000238 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_013 96449 96794276.681041 29371894 120 0.000000 2489323.537771 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_019 96490 96794236.030597 23205850 120 0.000000 2066378.743765 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_028 96589 96794251.584761 24533191 120 0.000000 2307154.797268 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_033 96604 96794289.942157 16143347 120 0.000000 1623415.101366 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_038 96652 96794400.511735 37269699 120 0.000000 3669642.375543 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_030 97133 96794597.175712 204910290 120 0.000000 6079064.206817 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_032 97135 96794589.204123 273024980 120 0.000000 7806210.987428 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ldlm_bl_10 122452 96794464.789335 2249206 120 0.000000 23846.817168 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_045 73471 96794319.012234 33539871 120 0.000000 2834091.411010 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_046 73472 96794243.261040 38486402 120 0.000000 3171438.915478 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_048 73474 96794375.289083 8256228 120 0.000000 581767.613337 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: lst_t_03_02 48596 3379017.289621 15 120 0.000000 0.105582 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: lst_t_03_03 48597 3379377.023275 15 120 0.000000 0.101944 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: lst_t_03_05 48600 3379377.026000 15 120 0.000000 0.137884 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: lst_t_03_09 48604 3379017.298938 15 120 0.000000 0.339279 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ldlm_cn03_019 91505 96794600.623004 35418591 120 0.000000 927290.519539 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ldlm_bl_19 43090 96794572.012829 1316257 120 0.000000 18780.543109 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_038 1015 91620877.004762 187846107 120 0.000000 5631477.199632 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_048 76197 83985307.200373 200890835 120 0.000000 5722986.450681 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_051 113339 83985187.407345 97446974 120 0.000000 2771332.630531 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_058 129913 96794457.592725 153255670 120 0.000000 4129376.676902 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_060 129953 96794500.650486 105333101 120 0.000000 2848735.146796 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_067 109961 83985307.199752 49902188 120 0.000000 1418725.887945 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_068 109968 88418425.146892 108565401 120 0.000000 2997979.430006 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_077 109987 83985307.199511 66424218 120 0.000000 1922997.462350 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_090 110605 88418425.397272 81205208 120 0.000000 2307677.452558 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_100 111263 83985307.199782 43219427 120 0.000000 1283403.522278 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost03_104 111283 83985307.199792 49179634 120 0.000000 1456363.258604 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kworker/3:0 130112 96794588.633775 1415848 120 0.000000 30236.436931 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_052 101161 96794360.817601 8254273 120 0.000000 576144.910732 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_058 64797 96794394.928693 12687821 120 0.000000 877489.516838 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189223.31900
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_063 27990 96794328.072628 526882 120 0.000000 43760.205004 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_065 48391 96794242.739209 4953908 120 0.000000 262507.811404 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: kworker/3:2 47526 95347340.207033 2 120 0.000000 0.010250 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_068 31645 96794400.169914 131 120 0.000000 11.412311 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_069 31738 96794403.968590 19 120 0.000000 3.465903 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_070 31777 96794408.153931 11 120 0.000000 2.794920 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_071 31778 96794412.481432 33 120 0.000000 4.338782 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_072 31832 96794416.573564 12 120 0.000000 4.105868 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_073 31833 96794419.857258 9 120 0.000000 3.295416 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_074 31834 96794422.920632 13 120 0.000000 3.073664 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_075 31835 96794425.460102 18 120 0.000000 2.550189 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_076 31900 96794428.812689 18 120 0.000000 3.365942 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_077 31940 96794432.628081 16 120 0.000000 3.687667 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_078 31941 96794432.546786 11 120 0.000000 1.170691 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_079 31949 96794436.434710 29 120 0.000000 3.807587 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_080 31957 96794440.046180 32 120 0.000000 5.646788 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_081 32066 96794444.064837 19 120 0.000000 4.030980 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_082 32098 96794446.269616 10 120 0.000000 2.217784 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_083 32118 96794450.713420 35 120 0.000000 4.455737 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_084 32236 96794459.440009 23 120 0.000000 3.308796 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_085 32522 96794478.221507 38 120 0.000000 5.054547 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_086 32740 96794495.047034 24 120 0.000000 5.110542 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_087 32836 96794500.890806 30 120 0.000000 4.103133 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_088 33046 96794528.128788 95 120 0.000000 27.251197 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_089 33141 96794532.174636 43 120 0.000000 4.505162 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_090 33496 96794547.482727 25 120 0.000000 4.422114 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_091 33577 96794552.068220 12 120 0.000000 3.328368 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_092 33627 96794556.090049 10 120 0.000000 2.229636 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_093 33664 96794559.989055 12 120 0.000000 2.948635 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_094 33683 96794569.594966 34 120 0.000000 7.675639 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_095 33776 96794569.676554 9 120 0.000000 2.556974 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel: ll_ost_io03_096 33849 96794576.783157 30 120 0.000000 4.805601 0.000000 3 /
Mar 21 10:27:03 fir-io1-s1 kernel:
Mar 21 10:27:03 fir-io1-s1 kernel: cpu#4, 1996.172 MHz
Mar 21 10:27:03 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .nr_switches : 21286038103
Mar 21 10:27:03 fir-io1-s1 kernel: .nr_load_updates : 2143508741
Mar 21 10:27:03 fir-io1-s1 kernel: .nr_uninterruptible : 2309657
Mar 21 10:27:03 fir-io1-s1 kernel: .next_balance : 7831.641995
Mar 21 10:27:03 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .clock : 3537112154.007491
Mar 21 10:27:03 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:03 fir-io1-s1 kernel: .avg_idle : 1893849
Mar 21 10:27:03 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:04 fir-io1-s1 kernel:
Mar 21 10:27:04 fir-io1-s1 kernel: cfs_rq[4]:/
Mar 21 10:27:04 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:04 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:04 fir-io1-s1 kernel: .min_vruntime : 135260748.509816
Mar 21 10:27:04 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:04 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:04 fir-io1-s1 kernel: .spread0 : 17375680.245523
Mar 21 10:27:04 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:04 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189224.31927
Mar 21 10:27:04 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:04 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .avg->runnable_avg_sum : 44
Mar 21 10:27:04 fir-io1-s1 kernel: .avg->runnable_avg_period : 47482
Mar 21 10:27:04 fir-io1-s1 kernel:
Mar 21 10:27:04 fir-io1-s1 kernel: rt_rq[4]:/
Mar 21 10:27:04 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:04 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:04 fir-io1-s1 kernel:
Mar 21 10:27:04 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:04 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:04 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:04 fir-io1-s1 kernel: watchdog/4 31 -8.963751 884246 0 0.000000 9506.262822 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: migration/4 32 0.000000 42270 0 0.000000 29036.116699 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ksoftirqd/4 33 135260076.158111 126657191 120 0.000000 2024365.957016 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kworker/4:0H 35 2639.597831 9 100 0.000000 0.031731 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ib-comp-wq 7446 1881.046125 2 100 0.000000 0.011102 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kworker/4:1H 14462 135260654.414857 401482706 100 0.000000 2591416.807073 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ccp-2-q1 33904 7463.845709 2 120 0.000000 0.026261 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kdmflush 42378 10317.753475 2 100 0.000000 0.013777 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kdmwork-253:11 44152 135260220.711762 302928629 120 0.000000 5267483.803614 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: bioset 47687 12269.405389 2 100 0.000000 0.015179 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kdmwork-253:61 55519 27508.274844 129 120 0.000000 2.084786 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kdmwork-253:82 58053 135260414.653251 203439669 120 0.000000 3655822.443429 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kdmwork-253:90 58402 135260647.839745 295525498 120 0.000000 4537755.845190 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kdmwork-253:102 58792 27508.117863 119 120 0.000000 1.198162 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_001 94236 135222645.011619 295435870 120 0.000000 9167936.060270 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_002 94237 135260360.981885 296626385 120 0.000000 9251893.753677 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_evictor 94284 135260067.050045 13845 120 0.000000 59000.657566 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_007 96240 135260737.200039 300042038 120 0.000000 9314248.365471 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_009 96245 130538504.474937 293418538 120 0.000000 9178979.265091 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_012 96259 135260240.242074 430368745 120 0.000000 12522474.996247 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_021 96290 130538504.475468 302962214 120 0.000000 9437843.602179 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_010 96314 135260101.833547 8113790 120 0.000000 566071.604253 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_024 96334 130538508.665655 287860191 120 0.000000 9064992.849554 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_013 96341 135259545.991804 56117879 120 0.000000 6104294.715589 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_022 96396 135259809.592206 6832481 120 0.000000 1126354.278060 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_033 96501 135259562.593209 21810738 120 0.000000 2059942.335661 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_041 96582 135260013.295501 39055816 120 0.000000 4367110.828550 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_056 96654 135259881.225936 28065845 120 0.000000 2315455.589773 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_045 96771 135259812.636983 284929200 120 0.000000 8710226.842581 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_046 96772 130538510.165116 250878068 120 0.000000 7975146.916331 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_059 73054 135259543.189166 19041400 120 0.000000 1413872.716330 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_069 73073 135260076.219688 15081046 120 0.000000 1312195.285721 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_077 73081 135260067.458028 35201011 120 0.000000 4033728.829405 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: lst_t_00_01 48560 4419182.023203 10489 120 0.000000 436.044723 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: lst_t_00_02 48561 4419182.129037 10486 120 0.000000 428.562908 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: lst_t_00_08 48568 4419182.160235 10481 120 0.000000 430.474478 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: lst_t_00_09 48569 4419182.125970 10484 120 0.000000 449.696766 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ldlm_cn00_025 91509 134560743.514236 41610886 120 0.000000 1154397.673145 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_077 49827 135260111.977545 334954497 120 0.000000 10246046.926201 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_087 110034 128825338.536646 196341580 120 0.000000 5621372.308279 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_089 110036 130538504.475087 126660445 120 0.000000 3910523.949995 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_095 110574 135222644.532635 124536228 120 0.000000 3809423.257969 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_100 110619 130538504.474686 117465237 120 0.000000 3800882.760825 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_110 111317 128825338.235359 106006371 120 0.000000 3356756.454472 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost00_111 111318 135260737.852704 197178045 120 0.000000 5597742.128185 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_097 36887 135260052.121599 13593577 120 0.000000 998380.324325 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kworker/4:0 56923 135260736.517862 957994 120 0.000000 18264.400948 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: kworker/4:1 86671 133903410.789442 2 120 0.000000 0.008487 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_105 31901 135260112.354967 11 120 0.000000 2.358462 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel: ll_ost_io00_111 31926 135260111.556676 9 120 0.000000 2.049442 0.000000 0 /
Mar 21 10:27:04 fir-io1-s1 kernel:
Mar 21 10:27:04 fir-io1-s1 kernel: cpu#5, 1996.172 MHz
Mar 21 10:27:04 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .nr_switches : 22829745546
Mar 21 10:27:04 fir-io1-s1 kernel: .nr_load_updates : 2160112886
Mar 21 10:27:04 fir-io1-s1 kernel: .nr_uninterruptible : -295928
Mar 21 10:27:04 fir-io1-s1 kernel: .next_balance : 7831.642809
Mar 21 10:27:04 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .clock : 3537112968.043266
Mar 21 10:27:04 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:04 fir-io1-s1 kernel: .cpu_load[2] : 2
Mar 21 10:27:04 fir-io1-s1 kernel: .cpu_load[3] : 7
Mar 21 10:27:04 fir-io1-s1 kernel: .cpu_load[4] : 9
Mar 21 10:27:04 fir-io1-s1 kernel: .avg_idle : 108843
Mar 21 10:27:04 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:05 fir-io1-s1 kernel:
Mar 21 10:27:05 fir-io1-s1 kernel: cfs_rq[5]:/
Mar 21 10:27:05 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:05 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:05 fir-io1-s1 kernel: .min_vruntime : 146027779.300082
Mar 21 10:27:05 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:05 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:05 fir-io1-s1 kernel: .spread0 : 28142711.035789
Mar 21 10:27:05 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .blocked_load_avg : 5
Mar 21 10:27:05 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:05 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .avg->runnable_avg_sum : 259
Mar 21 10:27:05 fir-io1-s1 kernel: .avg->runnable_avg_period : 46590
Mar 21 10:27:05 fir-io1-s1 kernel:
Mar 21 10:27:05 fir-io1-s1 kernel: rt_rq[5]:/
Mar 21 10:27:05 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:05 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:05 fir-io1-s1 kernel:
Mar 21 10:27:05 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:05 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:05 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:05 fir-io1-s1 kernel: watchdog/5 36 -8.960975 884246 0 0.000000 11261.649607 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: migration/5 37 0.000000 59881 0 0.000000 29923.303905 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ksoftirqd/5 38 146027450.935761 221300293 120 0.000000 4651714.008490 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kworker/5:0H 40 9711.789731 11 100 0.000000 0.036961 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: systemd-udevd 14605 21026083.521792 4002 120 0.000000 10872.890867 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 44779 0.000000 947 0 0.000000 75.784110 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 44929 0.000000 958 0 0.000000 72.662341 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 44941 0.000000 960 0 0.000000 75.971137 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 45365 0.000000 954 0 0.000000 71.210006 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 45889 0.000000 954 0 0.000000 73.155369 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189225.73123
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 45957 0.000000 941 0 0.000000 71.349137 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 46036 0.000000 978 0 0.000000 75.211920 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 46043 0.000000 1008 0 0.000000 79.418937 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 46098 0.000000 940 0 0.000000 86.560775 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 46123 0.000000 1038 0 0.000000 80.176284 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 46162 0.000000 965 0 0.000000 76.810182 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 54003 0.000000 982 0 0.000000 76.806229 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 54976 0.000000 983 0 0.000000 82.795360 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 55101 0.000000 999 0 0.000000 88.893023 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 55520 0.000000 947 0 0.000000 74.421714 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 56305 0.000000 982 0 0.000000 74.395278 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 57027 0.000000 937 0 0.000000 77.313470 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 57885 0.000000 1005 0 0.000000 79.876958 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 57951 0.000000 980 0 0.000000 78.686553 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 58071 0.000000 883 0 0.000000 72.129207 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 58560 0.000000 978 0 0.000000 80.773446 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 59317 0.000000 909 0 0.000000 76.807957 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 62000 0.000000 993 0 0.000000 81.204338 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: multipathd 16320 0.000000 912 0 0.000000 73.947684 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 42281 9129.965079 2 100 0.000000 0.012755 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 42301 9133.448326 2 100 0.000000 0.011021 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 42302 9133.451317 2 100 0.000000 0.009649 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 42527 9164.059910 2 100 0.000000 0.009759 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 42624 9167.169716 2 100 0.000000 0.032302 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kworker/5:1H 45269 146027697.094208 478343030 100 0.000000 3792965.431298 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 46002 10079.866828 2 100 0.000000 0.010080 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 46059 10133.465063 2 100 0.000000 0.010770 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 46061 10145.472546 2 100 0.000000 0.007936 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 46067 10185.818342 2 100 0.000000 0.009418 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 46070 10193.826482 2 100 0.000000 0.008757 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 46118 10248.755344 2 100 0.000000 0.010671 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 49180 11312.801082 2 100 0.000000 0.011472 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 54965 13150.167365 2 100 0.000000 0.010881 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 56015 13357.180909 2 100 0.000000 0.012424 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 57088 13781.382653 2 100 0.000000 0.012644 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: bioset 57218 13810.484908 2 100 0.000000 0.011482 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmwork-253:69 57219 146027665.258209 203586616 120 0.000000 3920153.880193 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmwork-253:81 57937 20789.754408 136 120 0.000000 1.863693 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmflush 61997 16396.508149 2 100 0.000000 0.011142 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kdmwork-253:117 61999 20789.783753 111 120 0.000000 0.946310 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: cfs_rh_01 91305 145997065.654744 23618 120 0.000000 11787.655538 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kiblnd_sd_01_01 91383 146027780.597382 21913599251 120 0.000000 244337148.055173 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: jbd2/md10-8 94174 146026530.131245 13788553 120 0.000000 833582.586536 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_002 94261 146026562.220206 17072164 120 0.000000 2185654.926088 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_011 96247 146027772.016053 353810813 120 0.000000 11330372.272034 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_create01 96283 146027765.917628 3175268 120 0.000000 59987.839915 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_025 96288 146027379.886580 391061220 120 0.000000 12608454.394253 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_004 96294 146026518.064813 14281419 120 0.000000 1108514.474622 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_011 96311 146026768.565987 32043759 120 0.000000 3515814.054057 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_012 96315 146026520.186850 23412628 120 0.000000 1944582.474570 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_016 96339 146026506.959675 61318892 120 0.000000 5849781.094504 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_029 96346 146027470.271270 491924321 120 0.000000 14847685.786728 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_050 96376 146027491.034581 316200248 120 0.000000 10174057.337947 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_021 96389 146026556.894340 10033369 120 0.000000 1076871.908111 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_040 96471 146026679.295911 10862793 120 0.000000 806970.935732 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_042 96474 146026609.307920 3178861 120 0.000000 237420.587518 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_045 96478 146026465.633047 54389873 120 0.000000 5874445.627016 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_047 96482 146026566.705966 39032119 120 0.000000 3672970.194173 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_050 96488 146026621.342903 17426630 120 0.000000 1792684.438105 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_054 96526 146026707.100325 18711071 120 0.000000 2223948.880893 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_056 96531 146026735.223173 41688619 120 0.000000 4985664.622868 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_064 96570 146027588.596493 428649409 120 0.000000 13258353.931804 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_063 96580 146026744.666531 22008241 120 0.000000 2710110.164088 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_064 96587 146026548.926739 32125417 120 0.000000 3142372.708823 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_068 96600 146026627.518400 18013899 120 0.000000 1313436.816544 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_069 96608 146026506.318375 29591879 120 0.000000 2960958.776086 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_068 96611 146027379.757628 456929324 120 0.000000 14087202.026238 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_088 96670 146026609.746431 54865215 120 0.000000 5218294.422500 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_089 96671 146026515.323359 36038176 120 0.000000 3552301.960812 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_095 96677 146026485.902927 14920500 120 0.000000 1062144.027410 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_100 96682 146026587.100788 28451366 120 0.000000 2686242.266300 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_101 96683 146026580.551209 37093458 120 0.000000 3801688.262771 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost_io01_110 96692 146026519.521443 15066758 120 0.000000 1090624.507927 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_088 96904 146027111.129688 423437468 120 0.000000 13204458.139689 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_097 96920 146027341.474136 455871394 120 0.000000 14112094.450754 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_098 96922 146026641.850490 496170740 120 0.000000 15123034.116330 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ll_ost01_111 96943 146027380.716641 365073628 120 0.000000 11448147.036917 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ldlm_cn01_009 116995 146027571.627097 69872825 120 0.000000 1886941.886794 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: ldlm_cn01_010 117024 146017582.524540 68926228 120 0.000000 1853808.049597 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kworker/5:2 94703 146027767.601161 463812 120 0.000000 6753.593866 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel: kworker/5:0 105523 143651637.916803 2 120 0.000000 0.008907 0.000000 1 /
Mar 21 10:27:05 fir-io1-s1 kernel:
Mar 21 10:27:05 fir-io1-s1 kernel: cpu#6, 1996.172 MHz
Mar 21 10:27:05 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:05 fir-io1-s1 kernel: .nr_switches : 33164150164
Mar 21 10:27:05 fir-io1-s1 kernel: .nr_load_updates : 2324018843
Mar 21 10:27:05 fir-io1-s1 kernel: .nr_uninterruptible : -509886
Mar 21 10:27:05 fir-io1-s1 kernel: .next_balance : 7831.644090
Mar 21 10:27:05 fir-io1-s1 kernel: .curr->pid : 72470
Mar 21 10:27:05 fir-io1-s1 kernel: .clock : 3537114247.091775
Mar 21 10:27:05 fir-io1-s1 kernel: .cpu_load[0] : 1024
Mar 21 10:27:05 fir-io1-s1 kernel: .cpu_load[1] : 16
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[2] : 13
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[3] : 19
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[4] : 26
Mar 21 10:27:06 fir-io1-s1 kernel: .avg_idle : 1269394
Mar 21 10:27:06 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:06 fir-io1-s1 kernel:
Mar 21 10:27:06 fir-io1-s1 kernel: cfs_rq[6]:/
Mar 21 10:27:06 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:06 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:06 fir-io1-s1 kernel: .min_vruntime : 180512940.676174
Mar 21 10:27:06 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:06 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:06 fir-io1-s1 kernel: .spread0 : 62626964.722486
Mar 21 10:27:06 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .blocked_load_avg : 1
Mar 21 10:27:06 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:06 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .avg->runnable_avg_sum : 177
Mar 21 10:27:06 fir-io1-s1 kernel: .avg->runnable_avg_period : 47310
Mar 21 10:27:06 fir-io1-s1 kernel:
Mar 21 10:27:06 fir-io1-s1 kernel: rt_rq[6]:/
Mar 21 10:27:06 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .rt_time : 0.442445
Mar 21 10:27:06 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:06 fir-io1-s1 kernel:
Mar 21 10:27:06 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:06 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:06 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:06 fir-io1-s1 kernel: watchdog/6 41 -8.959482 884248 0 0.000000 9839.462753 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: migration/6 42 0.000000 43400 0 0.000000 21631.945491 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ksoftirqd/6 43 180512923.981683 178118494 120 0.000000 3509968.225026 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kworker/6:0H 45 14976.652706 9 100 0.000000 0.036379 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: bioset 42854 10324.835391 2 100 0.000000 0.013477 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kdmwork-253:8 43419 28806.962438 125 120 0.000000 2.076920 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: bioset 46119 11203.766098 2 100 0.000000 0.011121 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kdmflush 46124 11237.932414 2 100 0.000000 0.011582 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kdmwork-253:46 47911 180512901.863692 305199666 120 0.000000 5313718.138307 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kworker/6:1H 54820 180512928.281987 303274604 100 0.000000 2332766.350234 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kdmwork-253:73 57475 28806.959003 122 120 0.000000 1.581549 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kdmwork-253:84 58150 28806.978308 122 120 0.000000 1.633037 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: reader#1 72475 180512928.708115 407735 120 0.000000 121562.039965 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ptlrpcd_02_01 91454 180512924.034784 515203 120 0.000000 12558.864182 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cn02_002 94218 177816214.734743 30079610 120 0.000000 958543.947064 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_000 94241 180512883.515268 339832209 120 0.000000 11289760.489004 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: jbd2/md4-8 94248 180511784.040067 15631115 120 0.000000 924756.595065 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_002 94264 180511759.716490 21919836 120 0.000000 1485807.709566 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_007 96308 180512754.584270 34466980 120 0.000000 3900635.611464 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_009 96313 180511815.074156 23191881 120 0.000000 1702824.487272 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_010 96316 180511828.666787 26682054 120 0.000000 3319364.106256 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_019 96395 180511754.665422 13926079 120 0.000000 1142742.448774 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_029 96409 180512871.548805 329114881 120 0.000000 11311769.076281 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_024 96442 180512754.407783 6559391 120 0.000000 492682.342096 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_027 96452 180512676.498300 14747198 120 0.000000 1925578.241425 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_031 96463 180511757.782143 32198179 120 0.000000 3121298.614413 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_034 96468 180512673.962655 19436326 120 0.000000 1310741.735648 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_049 96558 180511761.215964 24451857 120 0.000000 2638892.934295 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_034 96561 180512934.845515 282634090 120 0.000000 9922816.431178 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_060 96613 180512763.097660 15593192 120 0.000000 1583374.533114 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_064 96637 180511782.860965 27245554 120 0.000000 1865800.258712 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_051 96780 180512940.676174 306813975 120 0.000000 10409535.433094 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cn02_010 117023 180512925.698092 48925944 120 0.000000 1424797.846864 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189226.31947
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cn02_015 117040 180512936.824566 57859444 120 0.000000 1657611.227746 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cn02_019 117142 180512928.708809 40579670 120 0.000000 1246808.122657 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_078 73087 180512706.129461 41757705 120 0.000000 2922648.643501 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_081 73118 180512664.341758 24219802 120 0.000000 2209854.795970 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_089 73126 180511836.972155 25916906 120 0.000000 3194877.741246 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_096 73149 180511768.435411 57119772 120 0.000000 5404668.153013 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cn02_022 78533 180512933.554726 45121332 120 0.000000 1348930.037323 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cb02_004 35278 27335695.236648 30 120 0.000000 0.701059 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_cn02_029 116455 180512773.981885 52005975 120 0.000000 1534733.637334 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ldlm_bl_33 51520 180512737.618639 1220471 120 0.000000 13337.713332 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_069 36689 180512895.324013 306355648 120 0.000000 9877653.268669 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_073 36982 180512935.975250 319596059 120 0.000000 10396209.233777 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_074 36983 180512937.881536 218547619 120 0.000000 7517629.123036 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_077 74737 180512864.136317 173373750 120 0.000000 5993495.384470 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_084 74750 180512912.216819 198429584 120 0.000000 6520781.065078 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_092 75602 180512896.058430 279640802 120 0.000000 8989501.108123 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_095 77316 180512928.118813 234299190 120 0.000000 7808426.576409 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost02_096 77317 180512908.105517 221250193 120 0.000000 7429960.647137 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kworker/6:2 105816 180512928.287491 2802339 120 0.000000 51338.283936 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: md8_resync 123037 180512660.831831 24935544 125 0.000000 3794616.203640 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: kworker/6:0 2383 179951799.916891 2 120 0.000000 0.008848 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel: ll_ost_io02_103 31948 180512800.592641 10 120 0.000000 0.892557 0.000000 2 /
Mar 21 10:27:06 fir-io1-s1 kernel:
Mar 21 10:27:06 fir-io1-s1 kernel: cpu#7, 1996.172 MHz
Mar 21 10:27:06 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .nr_switches : 12342935561
Mar 21 10:27:06 fir-io1-s1 kernel: .nr_load_updates : 1769926014
Mar 21 10:27:06 fir-io1-s1 kernel: .nr_uninterruptible : -110508
Mar 21 10:27:06 fir-io1-s1 kernel: .next_balance : 7831.644962
Mar 21 10:27:06 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .clock : 3537115118.122147
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:06 fir-io1-s1 kernel: .avg_idle : 1615101
Mar 21 10:27:06 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:06 fir-io1-s1 kernel:
Mar 21 10:27:07 fir-io1-s1 kernel: cfs_rq[7]:/
Mar 21 10:27:07 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:07 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:07 fir-io1-s1 kernel: .min_vruntime : 95953176.629675
Mar 21 10:27:07 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:07 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:07 fir-io1-s1 kernel: .spread0 : -21932800.457020
Mar 21 10:27:07 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:07 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .avg->runnable_avg_sum : 27
Mar 21 10:27:07 fir-io1-s1 kernel: .avg->runnable_avg_period : 46919
Mar 21 10:27:07 fir-io1-s1 kernel:
Mar 21 10:27:07 fir-io1-s1 kernel: rt_rq[7]:/
Mar 21 10:27:07 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:07 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:07 fir-io1-s1 kernel:
Mar 21 10:27:07 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:07 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:07 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:07 fir-io1-s1 kernel: watchdog/7 46 -8.966075 884247 0 0.000000 7804.340386 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189227.31948
Mar 21 10:27:07 fir-io1-s1 kernel: migration/7 47 0.000000 22745 0 0.000000 23779.405095 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ksoftirqd/7 48 95952939.422933 136583956 120 0.000000 2643401.016117 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kworker/7:0H 50 13917.165681 9 100 0.000000 0.038615 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: khungtaskd 257 95953056.120914 29771 120 0.000000 9876.570291 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ccp-1-q4 33812 8123.960906 2 120 0.000000 0.011031 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ccp-7-q3 34432 8533.086551 2 120 0.000000 0.009789 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: bioset 45524 11805.123998 2 100 0.000000 0.012534 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmflush 45547 11859.647121 2 100 0.000000 0.014867 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: bioset 45548 11867.658225 2 100 0.000000 0.012414 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmflush 45711 12040.178738 2 100 0.000000 0.011031 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: bioset 45817 12101.712293 2 100 0.000000 0.020529 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: bioset 45885 12154.085172 2 100 0.000000 0.012543 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmwork-253:26 46003 95953130.928052 306269800 120 0.000000 5319067.823975 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmwork-253:48 49182 30180.702902 125 120 0.000000 1.905789 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kworker/7:1H 49467 95953111.511416 312550896 100 0.000000 2080327.826281 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: bioset 53444 15451.004955 2 100 0.000000 0.013856 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmwork-253:99 58712 95953138.320591 226715820 120 0.000000 4363434.727647 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmflush 59314 21110.399014 2 100 0.000000 0.014178 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kdmwork-253:113 59898 30180.728386 105 120 0.000000 0.895660 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: sssd_nss 71356 95953164.761729 909638 120 0.000000 29326.401064 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: master 72808 95953103.876118 209897 120 0.000000 6624.936338 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kiblnd_sd_03_03 91393 95953176.767610 11479908298 120 0.000000 100737555.100089 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: monitor_thread 91394 95953164.722575 3534876 120 0.000000 552328.540790 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ptlrpcd_03_05 91470 13008126.347778 11 120 0.000000 0.187258 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_000 94244 83711607.893877 211290898 120 0.000000 6239647.167547 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost_io03_014 96458 95952926.420911 26738677 120 0.000000 1888558.077050 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost_io03_015 96464 95952906.665495 12721190 120 0.000000 889482.115331 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost_io03_031 96597 95952843.347854 35378749 120 0.000000 3086561.232678 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_019 96789 83711607.894198 255419694 120 0.000000 7392062.351053 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_027 97130 95953056.519253 288483571 120 0.000000 8072207.140649 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ldlm_bl_05 103799 95952986.055693 2513012 120 0.000000 26738.753705 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost_io03_047 73473 95952820.305385 24059413 120 0.000000 2382098.749837 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: st_timer 48613 95953161.534026 405673 120 0.000000 2315.925289 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ldlm_bl_27 51514 95952989.127318 1221426 120 0.000000 13292.719005 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ldlm_bl_28 51515 95953065.245185 1221935 120 0.000000 14881.330123 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_042 35807 88104343.210241 204439028 120 0.000000 6006676.894326 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_056 129901 88104337.589383 69446995 120 0.000000 1999172.835446 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_076 109986 83711607.893596 123097340 120 0.000000 3405101.311837 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_084 110599 88104343.102735 28558788 120 0.000000 902818.359869 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost03_101 111280 95952844.065992 98656237 120 0.000000 2706066.828102 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost_io03_055 117103 95952817.921568 23021604 120 0.000000 1467196.216432 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kworker/7:1 99189 95953137.705392 1272407 120 0.000000 27820.489017 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: ll_ost_io03_067 48418 95952841.401623 3356591 120 0.000000 167759.800815 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel: kworker/7:0 3059 95912411.508387 2 120 0.000000 0.009939 0.000000 3 /
Mar 21 10:27:07 fir-io1-s1 kernel:
Mar 21 10:27:07 fir-io1-s1 kernel: cpu#8, 1996.172 MHz
Mar 21 10:27:07 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .nr_switches : 18596005820
Mar 21 10:27:07 fir-io1-s1 kernel: .nr_load_updates : 2140880552
Mar 21 10:27:07 fir-io1-s1 kernel: .nr_uninterruptible : 2085652
Mar 21 10:27:07 fir-io1-s1 kernel: .next_balance : 7831.645720
Mar 21 10:27:07 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .clock : 3537115875.660335
Mar 21 10:27:07 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:07 fir-io1-s1 kernel: .cpu_load[4] : 64
Mar 21 10:27:07 fir-io1-s1 kernel: .avg_idle : 1690837
Mar 21 10:27:07 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:07 fir-io1-s1 kernel:
Mar 21 10:27:08 fir-io1-s1 kernel: cfs_rq[8]:/
Mar 21 10:27:08 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:08 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:08 fir-io1-s1 kernel: .min_vruntime : 119465686.276118
Mar 21 10:27:08 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:08 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:08 fir-io1-s1 kernel: .spread0 : 1579708.269546
Mar 21 10:27:08 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:08 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .avg->runnable_avg_sum : 248
Mar 21 10:27:08 fir-io1-s1 kernel: .avg->runnable_avg_period : 47645
Mar 21 10:27:08 fir-io1-s1 kernel:
Mar 21 10:27:08 fir-io1-s1 kernel: rt_rq[8]:/
Mar 21 10:27:08 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:08 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:08 fir-io1-s1 kernel:
Mar 21 10:27:08 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:08 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:08 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:08 fir-io1-s1 kernel: rcu_sched 10 119465686.461435 959359676 120 0.000000 12353293.049949 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: watchdog/8 51 -11.973649 884247 0 0.000000 8968.694075 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: migration/8 52 0.000000 34165 0 0.000000 38183.900343 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ksoftirqd/8 53 119465525.743365 132212031 120 0.000000 2148012.213264 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kworker/8:0H 55 1790.072676 9 100 0.000000 0.029578 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kworker/8:1H 8731 119465643.082991 419180963 100 0.000000 2714858.032999 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kdmwork-253:1 42282 119465464.940593 203421833 120 0.000000 3901447.001749 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kdmflush 46052 9274.266197 2 100 0.000000 0.013417 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: bioset 46053 9282.277419 2 100 0.000000 0.012413 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kdmflush 53990 11993.072437 2 100 0.000000 0.012955 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kdmwork-253:53 53992 119465634.506383 290721269 120 0.000000 4805889.647369 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kdmwork-253:93 58496 119465631.429769 296120655 120 0.000000 4905291.235464 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kdmflush 58679 15828.460924 2 100 0.000000 0.014177 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ptlrpcd_00_02 91431 15413606.351008 8 120 0.000000 0.117104 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ptlrpcd_00_07 91436 15413963.629862 9 120 0.000000 0.110531 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cb00_000 94200 15397641.270759 10 120 0.000000 0.088536 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cn00_001 94211 119465632.999188 47187643 120 0.000000 1259514.747317 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_011 96258 114604495.591085 324096950 120 0.000000 9858758.469959 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_019 96276 119465622.104496 325209483 120 0.000000 10026390.680457 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_007 96301 119465307.461749 25610794 120 0.000000 2872043.981107 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cn00_003 96321 119465674.209771 56002392 120 0.000000 1511242.535521 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_022 96329 119465680.394991 391342249 120 0.000000 11640746.174357 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_020 96387 119465309.230835 18766429 120 0.000000 2284521.877636 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_030 96450 119465196.302978 25684835 120 0.000000 1772182.721173 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cn00_006 96512 119465682.300936 52593840 120 0.000000 1413798.211521 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189228.31970
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_create00 96575 119465456.189812 27626 120 0.000000 349.699111 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_044 96595 119465191.361630 23589326 120 0.000000 1561219.536839 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_050 96629 119465194.288520 32373949 120 0.000000 4243832.813501 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_052 96636 119465191.355310 41008577 120 0.000000 4815905.260831 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_053 96638 119465166.566104 19347255 120 0.000000 1400465.653349 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_create00 96748 97522403.830824 2938 120 0.000000 44.489704 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_038 96763 119465674.208589 282639707 120 0.000000 8701386.292311 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_041 96767 112883569.662560 271624753 120 0.000000 8526295.265177 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_047 96774 119465208.057634 359578168 120 0.000000 10833356.066659 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_049 96779 119434825.903036 253748094 120 0.000000 7890984.126439 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_063 96919 119465584.415328 274673445 120 0.000000 8447095.264779 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cn00_009 117036 118766851.647658 42279703 120 0.000000 1179321.772606 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cn00_013 117073 119465681.385324 49636267 120 0.000000 1355286.897951 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ldlm_cn00_014 117133 119465315.777632 47148430 120 0.000000 1311113.409854 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_062 73057 119465322.633654 68118 120 0.000000 2029.869453 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_066 73070 119465194.207400 32779827 120 0.000000 3628872.874710 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_071 73075 119465201.880345 6996826 120 0.000000 520302.524203 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_073 73077 119465283.962470 30516395 120 0.000000 2272638.600306 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_081 73113 119465327.775298 34671472 120 0.000000 3629021.043743 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_082 73114 119465205.925862 44898372 120 0.000000 4851066.254168 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_087 73280 119465194.603251 35094040 120 0.000000 3359629.358031 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost_io00_093 73286 119465229.050963 30762199 120 0.000000 3596226.249980 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_070 49820 114604495.590444 374782629 120 0.000000 11194219.679582 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_081 49831 119465589.591796 420671191 120 0.000000 12420165.900008 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_094 110573 119465451.682702 126150804 120 0.000000 3886361.629452 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_102 110621 119465667.465595 75344252 120 0.000000 2568130.466236 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: ll_ost00_103 110656 119434892.286943 115191822 120 0.000000 3678402.580501 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kworker/8:2 119070 119465673.634418 1521429 120 0.000000 27322.315442 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel: kworker/8:1 122918 119398453.698048 2 120 0.000000 0.008917 0.000000 0 /
Mar 21 10:27:08 fir-io1-s1 kernel:
Mar 21 10:27:08 fir-io1-s1 kernel: cpu#9, 1996.172 MHz
Mar 21 10:27:08 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .nr_switches : 23823956130
Mar 21 10:27:08 fir-io1-s1 kernel: .nr_load_updates : 2151235339
Mar 21 10:27:08 fir-io1-s1 kernel: .nr_uninterruptible : -254380
Mar 21 10:27:08 fir-io1-s1 kernel: .next_balance : 7831.646579
Mar 21 10:27:08 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .clock : 3537116735.188221
Mar 21 10:27:08 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:08 fir-io1-s1 kernel: .avg_idle : 4583677
Mar 21 10:27:08 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:09 fir-io1-s1 kernel:
Mar 21 10:27:09 fir-io1-s1 kernel: cfs_rq[9]:/
Mar 21 10:27:09 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:09 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:09 fir-io1-s1 kernel: .min_vruntime : 152472142.565462
Mar 21 10:27:09 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:09 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:09 fir-io1-s1 kernel: .spread0 : 34586164.515509
Mar 21 10:27:09 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .blocked_load_avg : 3
Mar 21 10:27:09 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:09 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .avg->runnable_avg_sum : 348
Mar 21 10:27:09 fir-io1-s1 kernel: .avg->runnable_avg_period : 47218
Mar 21 10:27:09 fir-io1-s1 kernel:
Mar 21 10:27:09 fir-io1-s1 kernel: rt_rq[9]:/
Mar 21 10:27:09 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:09 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:09 fir-io1-s1 kernel:
Mar 21 10:27:09 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:09 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:09 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:09 fir-io1-s1 kernel: watchdog/9 56 -11.979380 884247 0 0.000000 9953.899536 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: migration/9 57 0.000000 67813 0 0.000000 24993.066928 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ksoftirqd/9 58 152471967.047487 217459052 120 0.000000 4594601.984171 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kworker/9:0H 60 14584.324587 9 100 0.000000 0.043733 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kworker/9:1 323 152472128.055465 11773884 120 0.000000 214014.728894 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: jbd2/sdig2-8 14503 152472128.123195 710594 120 0.000000 18724.255947 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmwork-253:7 42855 24368.779373 129 120 0.000000 1.818633 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmflush 44392 8937.016562 2 100 0.000000 0.008055 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: bioset 45722 9224.510709 2 100 0.000000 0.014467 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmflush 46220 9480.517066 2 100 0.000000 0.014018 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmwork-253:47 48175 152471956.573329 294940465 120 0.000000 5150279.064191 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: bioset 52032 11543.664896 2 100 0.000000 0.010680 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmwork-253:52 53445 152471844.709793 305577234 120 0.000000 4701038.116171 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmflush 57021 13585.795794 2 100 0.000000 0.024146 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmwork-253:83 58069 24368.635760 111 120 0.000000 1.306286 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kworker/9:1H 58160 152472112.571793 466329661 100 0.000000 3595628.902040 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmwork-253:88 58338 152472089.339413 226763645 120 0.000000 4231153.835973 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kdmwork-253:103 58836 24368.577466 113 120 0.000000 1.308943 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: gdbus 71327 152472124.375996 737968 120 0.000000 44321.416936 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: rs:main Q:Reg 72465 152471287.725093 250424 120 0.000000 15634.864525 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: agetty 72655 152470219.433143 26 120 0.000000 16.866896 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ptlrpcd_01_00 91441 4924382.450644 4 120 0.000000 0.053202 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ptlrpcd_01_03 91444 8418258.507843 5 120 0.000000 0.073481 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ptlrpcd_01_05 91446 8941431.767998 5 120 0.000000 0.087146 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ptlrpcd_01_07 91448 21131700.909147 4 120 0.000000 0.042943 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: md0_raid6 91761 152470312.792357 529866223 120 0.000000 177901395.012842 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kmmpd-md0 94156 152470330.648075 10838340 120 0.000000 74760.921684 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: jbd2/md2-8 94194 152470406.822773 9064900 120 0.000000 708804.235864 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_006 94526 152470706.219347 354106968 120 0.000000 11573229.596702 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_023 96281 152470674.545655 417336425 120 0.000000 12952261.208203 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_008 96303 152470439.696791 29272202 120 0.000000 3928676.558156 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_014 96331 152470576.879159 7498552 120 0.000000 570056.863264 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_015 96336 152470525.783175 23837970 120 0.000000 2464069.831477 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_053 96404 152472133.662303 394943829 120 0.000000 12649655.567032 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_054 96405 152470399.447441 404520814 120 0.000000 12737594.369163 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_023 96407 152470360.197871 66846848 120 0.000000 6669165.195720 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_031 96441 152470377.676178 38637386 120 0.000000 3841146.901396 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_043 96475 152470358.218625 13632411 120 0.000000 967057.613106 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_044 96476 152470346.328275 53884296 120 0.000000 5782088.259666 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_046 96480 152470573.048754 33842505 120 0.000000 2979832.758420 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_061 96523 152470594.266617 330096018 120 0.000000 10675602.841298 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_058 96550 152470540.996279 8417335 120 0.000000 689466.347133 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_065 96588 152470402.749042 25498570 120 0.000000 2896158.307972 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_072 96634 152471360.938267 343989219 120 0.000000 11110778.093581 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_079 96648 152470341.575456 7955638 120 0.000000 498481.170006 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_092 96674 152470526.266562 22437525 120 0.000000 1635032.601551 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost_io01_108 96690 152470568.608036 25071028 120 0.000000 2219689.814408 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_073 96778 152472133.378097 395938916 120 0.000000 12591025.805495 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_077 96787 152471351.830694 362717060 120 0.000000 11500915.155342 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_081 96892 152471463.357806 424777697 120 0.000000 13165245.380040 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_092 96912 152472130.572225 369872286 120 0.000000 11895829.344759 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ll_ost01_105 96931 152471786.260239 333083534 120 0.000000 10914097.031965 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_cn01_017 117034 152472103.580567 75542025 120 0.000000 2010266.111147 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_cn01_021 117068 152457769.666296 68121469 120 0.000000 1842037.822835 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_cn01_023 117070 152462891.854916 79714752 120 0.000000 2122967.261007 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_cn01_025 117093 152472130.918609 73817381 120 0.000000 1987288.284798 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_cn01_027 117095 152392629.225506 66687517 120 0.000000 1817737.087697 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_cn01_031 117139 152457769.665585 65312702 120 0.000000 1774496.326761 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: lst_t_01_00 48571 5392325.478861 20941 120 0.000000 660.363814 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: lst_t_01_10 48582 5392325.219870 20944 120 0.000000 662.503859 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_bl_11 43082 152470545.316476 1315949 120 0.000000 16147.537761 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: ldlm_bl_30 51517 152470861.939101 1219311 120 0.000000 14701.182188 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel: kworker/9:2 117827 141584801.761043 2 120 0.000000 0.011212 0.000000 1 /
Mar 21 10:27:09 fir-io1-s1 kernel:
Mar 21 10:27:09 fir-io1-s1 kernel: cpu#10, 1996.172 MHz
Mar 21 10:27:09 fir-io1-s1 kernel: .nr_running : 1
Mar 21 10:27:09 fir-io1-s1 kernel: .load : 1024
Mar 21 10:27:09 fir-io1-s1 kernel: .nr_switches : 29947762681
Mar 21 10:27:09 fir-io1-s1 kernel: .nr_load_updates : 1969991848
Mar 21 10:27:09 fir-io1-s1 kernel: .nr_uninterruptible : -267135
Mar 21 10:27:09 fir-io1-s1 kernel: .next_balance : 7831.647531
Mar 21 10:27:09 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .clock : 3537117690.243387
Mar 21 10:27:09 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:09 fir-io1-s1 kernel: .cpu_load[3] : 112
Mar 21 10:27:09 fir-io1-s1 kernel: .cpu_load[4] : 42
Mar 21 10:27:09 fir-io1-s1 kernel: .avg_idle : 805030
Mar 21 10:27:09 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: cfs_rq[10]:/
Mar 21 10:27:10 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:10 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:10 fir-io1-s1 kernel: .min_vruntime : 157317556.407081
Mar 21 10:27:10 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:10 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:10 fir-io1-s1 kernel: .spread0 : 39431578.173045
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .blocked_load_avg : 2
Mar 21 10:27:10 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:10 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .avg->runnable_avg_sum : 94
Mar 21 10:27:10 fir-io1-s1 kernel: .avg->runnable_avg_period : 46849
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: rt_rq[10]:/
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_time : 0.006392
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:10 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:10 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:10 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189229.73132
Mar 21 10:27:10 fir-io1-s1 kernel: watchdog/10 61 -11.979380 884249 0 0.000000 9089.965265 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: migration/10 62 0.000000 40975 0 0.000000 23585.272290 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ksoftirqd/10 63 157316765.250252 171826960 120 0.000000 3656396.983790 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/10:0H 65 4541.611200 9 100 0.000000 0.035159 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: multipathd 58883 0.000000 960 0 0.000000 83.131866 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/10:1H 24169 157316746.486794 348498031 100 0.000000 2689890.896489 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ccp-2-q2 33905 6225.385951 2 120 0.000000 0.018646 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ccp-7-q4 34433 6485.388858 2 120 0.000000 0.014729 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmwork-253:3 42388 24023.346819 122 120 0.000000 1.734403 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmwork-253:18 45527 157316728.137199 295063027 120 0.000000 5106551.439123 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmwork-253:51 52961 24023.357922 114 120 0.000000 1.727355 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmwork-253:66 56766 157316640.660011 305398253 120 0.000000 5054471.097270 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmwork-253:116 61782 157316681.332170 306538249 120 0.000000 5202742.959418 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_003 94567 157316244.402039 30127372 120 0.000000 3411554.428251 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost02_006 94627 157316424.460263 327261973 120 0.000000 11146122.162111 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost02_007 94628 157316532.849141 266695506 120 0.000000 9383833.896304 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_011 96319 157316110.592104 15633711 120 0.000000 1982524.122759 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_037 96483 157316029.218799 16296116 120 0.000000 1856320.302758 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_063 96632 157316115.663922 43839116 120 0.000000 4880154.155240 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost02_051 96780 157317556.526940 306814088 120 0.000000 10409537.894071 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost02_057 96933 157316727.157924 303264131 120 0.000000 10239035.114012 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn02_014 117037 155388222.971464 26661908 120 0.000000 863278.259729 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_095 73148 157316238.862700 12247416 120 0.000000 1799139.212623 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost02_066 82098 157316696.583582 355803553 120 0.000000 11728818.629980 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_create02 79393 157316429.258154 1994745 120 0.000000 38227.990778 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn02_025 116386 157316765.569109 57249327 120 0.000000 1610463.238211 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn02_028 116454 157317543.853132 49100246 120 0.000000 1417939.610378 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_bl_16 43087 157316523.240068 1314612 120 0.000000 15637.707408 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/10:2 784 157317543.509272 3531443 120 0.000000 69179.217502 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/u264:2 83818 149003381.116701 62 100 0.000000 0.303589 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/10:0 63506 156486007.629698 2 120 0.000000 0.011302 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_108 32019 157316303.677351 11 120 0.000000 2.843311 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io02_109 32020 157316303.563878 11 120 0.000000 2.119598 0.000000 2 /
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: cpu#11, 1996.172 MHz
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_switches : 13022184415
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_load_updates : 1807115040
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_uninterruptible : -98343
Mar 21 10:27:10 fir-io1-s1 kernel: .next_balance : 7831.648154
Mar 21 10:27:10 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .clock : 3537118311.248631
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .avg_idle : 6490413
Mar 21 10:27:10 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: cfs_rq[11]:/
Mar 21 10:27:10 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:10 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:10 fir-io1-s1 kernel: .min_vruntime : 95233688.528235
Mar 21 10:27:10 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:10 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:10 fir-io1-s1 kernel: .spread0 : -22652289.966360
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189230.32019
Mar 21 10:27:10 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:10 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .avg->runnable_avg_sum : 64
Mar 21 10:27:10 fir-io1-s1 kernel: .avg->runnable_avg_period : 46496
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: rt_rq[11]:/
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:10 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:10 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:10 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:10 fir-io1-s1 kernel: watchdog/11 66 -11.979390 884248 0 0.000000 7527.921625 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: migration/11 67 0.000000 22201 0 0.000000 28441.446047 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ksoftirqd/11 68 95233306.872287 127724270 120 0.000000 2531185.464281 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/11:0H 70 5170.504737 9 100 0.000000 0.043675 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/11:1H 27207 95233306.860409 295593000 100 0.000000 1950951.723317 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmflush 47682 10736.180851 2 100 0.000000 0.012654 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kdmwork-253:45 47688 25314.523336 118 120 0.000000 1.787295 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: lnet_discovery 91427 95233676.558083 3539255 120 0.000000 19540.169833 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ptlrpcd_03_01 91466 13299663.444418 16 120 0.000000 0.259516 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ptlrpcd_03_04 91469 13276989.610040 13 120 0.000000 0.203977 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_bl_01 94222 95233290.227900 2516587 120 0.000000 26816.408760 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_elt 94224 95233310.913268 244 120 0.000000 2074.140014 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: lquota_wb_fir-O 94483 95233281.333854 58923 120 0.000000 412.097279 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_004 94513 82647530.603813 234951628 120 0.000000 6852144.871804 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_005 96266 95233252.803726 310257754 120 0.000000 8703274.529871 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_005 96305 95233104.469064 30085773 120 0.000000 2978890.390371 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_006 96351 95233192.737130 20083394 120 0.000000 1880092.879922 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_007 96379 95233282.267559 293932250 120 0.000000 8293685.034099 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_009 96394 95233160.793028 36045548 120 0.000000 4086950.016414 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_020 96496 95232945.948644 16434992 120 0.000000 1024093.351089 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_021 96498 95232958.398473 35300356 120 0.000000 2859696.946569 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_022 96503 95232960.436040 38652718 120 0.000000 4079010.095819 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_025 96555 95232963.560546 43767774 120 0.000000 4375341.731057 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_029 96592 95233114.877442 26197335 120 0.000000 2860877.889260 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_030 96594 95233054.222745 31903411 120 0.000000 2963787.129602 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_042 96667 95232970.625294 29170806 120 0.000000 2210928.897711 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_013 96750 82647602.758485 266072652 120 0.000000 7644640.309098 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_015 96756 95233324.830760 283707483 120 0.000000 8135500.863962 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_028 97131 87090790.191733 265812584 120 0.000000 7622827.277555 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn03_006 62893 95233688.277615 22209873 120 0.000000 585711.851149 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: crond 12673 625670.667411 6 120 0.000000 3.617644 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/11:0 62312 95233676.580895 5513647 120 0.000000 110481.909743 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn03_010 83275 95233311.325496 33526868 120 0.000000 874923.549329 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: lst_t_03_01 48595 3315038.352085 15 120 0.000000 0.149557 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: lst_t_03_07 48602 3314631.064514 14 120 0.000000 0.111444 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: lst_t_03_10 48605 3314631.050769 14 120 0.000000 0.116442 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn03_018 91504 95233683.724513 23360549 120 0.000000 615812.263485 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn03_021 91507 87610076.171748 19133977 120 0.000000 530349.947011 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ldlm_cn03_026 91514 95227106.620203 16174010 120 0.000000 469396.025649 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_040 2370 82647602.758626 219479102 120 0.000000 6404167.420391 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_047 74991 95233289.000417 120655812 120 0.000000 3491854.042583 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_054 114817 82647602.757703 77220788 120 0.000000 2144071.961416 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_095 110610 95233680.031102 129507916 120 0.000000 3538142.827206 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_102 111281 95233257.041932 102639672 120 0.000000 2798559.077319 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost03_109 111288 82647530.603092 100977400 120 0.000000 2719966.993301 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_051 101160 95233066.333042 8822612 120 0.000000 590878.052159 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_054 109255 95233060.512984 18607332 120 0.000000 1194339.808145 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_057 18565 95233676.676800 10668345 120 0.000000 702638.335531 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_061 122240 95233096.488235 9223512 120 0.000000 599015.223791 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/11:2 32436 93748293.881059 2 120 0.000000 0.010740 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/u260:1 86562 95233688.243681 11710 120 0.000000 1939.378524 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: kworker/u260:2 16352 95230044.412780 601 120 0.000000 205.732456 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_097 34169 95233312.991569 35 120 0.000000 4.344052 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_098 34249 95233316.799976 16 120 0.000000 2.902117 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_099 34403 95233688.528235 12 120 0.000000 2.366619 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel: ll_ost_io03_100 34474 95233688.564654 4 120 0.000000 1.900306 0.000000 3 /
Mar 21 10:27:10 fir-io1-s1 kernel:
Mar 21 10:27:10 fir-io1-s1 kernel: cpu#12, 1996.172 MHz
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_switches : 21313460842
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_load_updates : 2146055107
Mar 21 10:27:10 fir-io1-s1 kernel: .nr_uninterruptible : 2198550
Mar 21 10:27:10 fir-io1-s1 kernel: .next_balance : 7831.649034
Mar 21 10:27:10 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .clock : 3537119193.279368
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:10 fir-io1-s1 kernel: .cpu_load[4] : 60
Mar 21 10:27:10 fir-io1-s1 kernel: .avg_idle : 1091090
Mar 21 10:27:10 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:11 fir-io1-s1 kernel:
Mar 21 10:27:11 fir-io1-s1 kernel: cfs_rq[12]:/
Mar 21 10:27:11 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:11 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:11 fir-io1-s1 kernel: .min_vruntime : 134030671.127498
Mar 21 10:27:11 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:11 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:11 fir-io1-s1 kernel: .spread0 : 16144692.258417
Mar 21 10:27:11 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:11 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .avg->runnable_avg_sum : 61
Mar 21 10:27:11 fir-io1-s1 kernel: .avg->runnable_avg_period : 47695
Mar 21 10:27:11 fir-io1-s1 kernel:
Mar 21 10:27:11 fir-io1-s1 kernel: rt_rq[12]:/
Mar 21 10:27:11 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:11 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:11 fir-io1-s1 kernel:
Mar 21 10:27:11 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:11 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:11 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:11 fir-io1-s1 kernel: watchdog/12 71 -11.981895 884249 0 0.000000 8583.715846 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: migration/12 72 0.000000 42352 0 0.000000 29062.824715 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ksoftirqd/12 73 134030162.600023 127620864 120 0.000000 2018702.844701 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189231.31957
Mar 21 10:27:11 fir-io1-s1 kernel: kworker/12:0H 75 1391.325646 9 100 0.000000 0.041388 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: kworker/12:1H 14461 134030218.816049 411811644 100 0.000000 2637106.810572 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: bioset 44151 8074.822591 2 100 0.000000 0.012404 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: bioset 46358 8798.331793 2 100 0.000000 0.014297 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: kdmwork-253:85 58243 22747.246527 116 120 0.000000 1.609783 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: kdmwork-253:95 58559 134030204.078635 305529170 120 0.000000 4697383.912070 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: kdmwork-253:100 58737 22747.239876 129 120 0.000000 1.345955 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_000 94235 134030602.008044 309916506 120 0.000000 9395920.358671 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_005 94629 129315635.349616 344256990 120 0.000000 10295222.662910 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_008 96241 134030658.047655 341131733 120 0.000000 10441430.851593 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_016 96270 129315635.349175 306061966 120 0.000000 9595843.800824 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_017 96271 134030661.458438 291904973 120 0.000000 9117653.476006 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost_io00_006 96299 134030109.387971 16063351 120 0.000000 2017121.959309 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_026 96499 134029864.490509 280414139 120 0.000000 8645941.785551 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_030 96565 129315644.881886 348569705 120 0.000000 10719703.113576 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_033 96605 134030659.832018 322193491 120 0.000000 9831400.693323 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost_io00_049 96626 134030132.185717 20659289 120 0.000000 2682431.566624 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost_io00_057 96655 134030123.676276 33685206 120 0.000000 3628234.583470 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_034 96754 134030603.321664 377578671 120 0.000000 11256290.952991 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_035 96760 129315642.743421 227589662 120 0.000000 7259986.699822 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_040 96765 134030549.712054 445369620 120 0.000000 12912839.895527 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_051 96785 134030658.431171 356250180 120 0.000000 10464916.095754 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_065 96924 127596214.154518 320240128 120 0.000000 9687672.636595 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost_io00_061 73056 134029815.146676 4985940 120 0.000000 335495.320251 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost_io00_080 73091 134029888.268605 20174903 120 0.000000 1439293.698640 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: lst_t_00_00 48559 4355966.009607 10489 120 0.000000 418.875670 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: lst_t_00_04 48564 4355965.990410 10492 120 0.000000 437.699132 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: lst_t_00_05 48565 4355966.063541 10490 120 0.000000 427.138437 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: lst_t_00_10 48570 4355966.080343 10489 120 0.000000 426.994784 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_067 49817 134030239.085323 350603109 120 0.000000 10461262.461677 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_069 49819 129315642.750123 357884143 120 0.000000 10729509.629591 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_078 49828 129315642.752077 248895837 120 0.000000 7768335.185815 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_083 49833 133992112.389277 315370533 120 0.000000 9549046.517889 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ldlm_bl_18 43089 134030307.288073 1313912 120 0.000000 14482.982010 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_086 110033 129315642.743671 173599059 120 0.000000 5013830.308764 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_088 110035 134030157.864662 210658614 120 0.000000 5966918.152564 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_090 110037 133992112.435264 168639865 120 0.000000 4905818.449923 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_099 110618 134030183.903369 179322486 120 0.000000 5156866.623707 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost00_107 110660 129315642.743721 132842669 120 0.000000 4087890.372086 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: kworker/12:0 116742 134030659.133940 807721 120 0.000000 15558.860000 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: kworker/12:1 128645 133596542.943610 2 120 0.000000 0.007885 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel: ll_ost_io00_107 31903 134030160.281230 15 120 0.000000 2.590968 0.000000 0 /
Mar 21 10:27:11 fir-io1-s1 kernel:
Mar 21 10:27:11 fir-io1-s1 kernel: cpu#13, 1996.172 MHz
Mar 21 10:27:11 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .nr_switches : 22802177130
Mar 21 10:27:11 fir-io1-s1 kernel: .nr_load_updates : 2159512336
Mar 21 10:27:11 fir-io1-s1 kernel: .nr_uninterruptible : -308623
Mar 21 10:27:11 fir-io1-s1 kernel: .next_balance : 7831.649792
Mar 21 10:27:11 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .clock : 3537119951.312223
Mar 21 10:27:11 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:11 fir-io1-s1 kernel: .avg_idle : 746109
Mar 21 10:27:11 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:12 fir-io1-s1 kernel:
Mar 21 10:27:12 fir-io1-s1 kernel: cfs_rq[13]:/
Mar 21 10:27:12 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:12 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:12 fir-io1-s1 kernel: .min_vruntime : 145501606.035423
Mar 21 10:27:12 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:12 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:12 fir-io1-s1 kernel: .spread0 : 27615626.673430
Mar 21 10:27:12 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .load : 1024
Mar 21 10:27:12 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .blocked_load_avg : 2
Mar 21 10:27:12 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:12 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .avg->runnable_avg_sum : 98
Mar 21 10:27:12 fir-io1-s1 kernel: .avg->runnable_avg_period : 47541
Mar 21 10:27:12 fir-io1-s1 kernel:
Mar 21 10:27:12 fir-io1-s1 kernel: rt_rq[13]:/
Mar 21 10:27:12 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:12 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:12 fir-io1-s1 kernel:
Mar 21 10:27:12 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:12 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:12 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:12 fir-io1-s1 kernel: watchdog/13 76 -11.977968 884248 0 0.000000 10434.630008 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: migration/13 77 0.000000 60164 0 0.000000 28507.371505 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ksoftirqd/13 78 145500590.645168 220880911 120 0.000000 4640862.844507 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kworker/13:0H 80 4384.009026 9 100 0.000000 0.035670 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kworker/13:1 7251 145501585.368339 13287532 120 0.000000 216880.789172 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 18936 0.000000 1300 0 0.000000 197.085119 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 18943 0.000000 936 0 0.000000 75.027500 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 18944 0.000000 707387 0 0.000000 16636.734014 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 44842 0.000000 981 0 0.000000 71.804895 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 44868 0.000000 978 0 0.000000 78.029197 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 46072 0.000000 945 0 0.000000 78.080667 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 46180 0.000000 959 0 0.000000 76.944694 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 46570 0.000000 981 0 0.000000 80.275704 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 52962 0.000000 930 0 0.000000 75.959099 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 53542 0.000000 1014 0 0.000000 79.772983 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 54336 0.000000 973 0 0.000000 78.097695 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 57224 0.000000 938 0 0.000000 71.926511 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 57346 0.000000 955 0 0.000000 78.177670 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 57503 0.000000 948 0 0.000000 75.037211 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 58317 0.000000 970 0 0.000000 78.108681 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 58340 0.000000 955 0 0.000000 77.061337 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 58363 0.000000 926 0 0.000000 74.662909 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 58633 0.000000 976 0 0.000000 77.985671 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 58838 0.000000 942 0 0.000000 77.280643 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: multipathd 59281 0.000000 975 0 0.000000 77.509806 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kworker/13:1H 24100 145500999.690581 477179531 100 0.000000 3753594.867899 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189232.32040
Mar 21 10:27:12 fir-io1-s1 kernel: kdmflush 42250 7355.536802 2 100 0.000000 0.014246 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: bioset 43820 7614.203907 2 100 0.000000 0.013135 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kdmflush 57215 11108.878098 2 100 0.000000 0.009909 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kdmflush 57565 11366.512602 2 100 0.000000 0.009739 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kdmwork-253:75 57567 145500962.705592 304762681 120 0.000000 5226905.329557 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: bioset 58434 12526.079380 2 100 0.000000 0.009188 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: bioset 61998 15641.587250 2 100 0.000000 0.015540 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kiblnd_sd_01_03 91385 145501606.941505 21905972956 120 0.000000 244365057.575224 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_003 96233 145500460.059406 48631684 120 0.000000 6067483.871777 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_009 96306 145500473.822249 37796373 120 0.000000 3982302.036039 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ldlm_cn01_003 96320 145501317.140539 74112411 120 0.000000 1990805.159189 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_018 96344 145500229.520160 45984712 120 0.000000 3959632.694226 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost01_038 96360 145501326.666457 372528512 120 0.000000 12130617.488849 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost01_042 96364 145501222.488068 485771237 120 0.000000 14864466.691650 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_020 96386 145500472.249582 20388606 120 0.000000 2522576.841283 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_026 96417 145500207.354671 17219975 120 0.000000 1128757.458848 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_034 96454 145500282.030709 10904441 120 0.000000 911584.425543 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_036 96457 145500446.568863 8013457 120 0.000000 640918.654713 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_041 96473 145500459.760043 42235932 120 0.000000 4354546.830044 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_055 96529 145500249.801760 21831605 120 0.000000 1534234.653455 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_062 96577 145500262.283915 42456756 120 0.000000 3840187.913636 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost01_069 96615 145501294.974770 420167212 120 0.000000 13175219.483889 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_073 96627 145500537.205486 16097818 120 0.000000 1864188.213146 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_077 96645 145500198.448875 40955987 120 0.000000 3640461.904327 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_083 96662 145500223.435105 37278052 120 0.000000 3196893.369427 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_086 96668 145500314.630243 11754933 120 0.000000 898938.307559 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_091 96673 145500390.847476 39327375 120 0.000000 4309888.404027 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_094 96676 145500227.702332 24127191 120 0.000000 1767728.363379 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_io01_103 96685 145500314.934651 23668315 120 0.000000 2316054.600643 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost01_101 96927 145501589.253195 314803966 120 0.000000 10165059.870285 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kdmflush 16315 294257.481071 2 100 0.000000 0.012905 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: bioset 16318 294257.484223 2 100 0.000000 0.011401 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ll_ost_create01 23634 145501590.486976 1088057 120 0.000000 21532.789101 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: ldlm_bl_32 51519 145501518.729996 1218013 120 0.000000 13518.663819 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel: kworker/13:2 13024 145050295.143553 2 120 0.000000 0.010912 0.000000 1 /
Mar 21 10:27:12 fir-io1-s1 kernel:
Mar 21 10:27:12 fir-io1-s1 kernel: cpu#14, 1996.172 MHz
Mar 21 10:27:12 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .nr_switches : 23983230182
Mar 21 10:27:12 fir-io1-s1 kernel: .nr_load_updates : 2134932248
Mar 21 10:27:12 fir-io1-s1 kernel: .nr_uninterruptible : 237922
Mar 21 10:27:12 fir-io1-s1 kernel: .next_balance : 7831.650733
Mar 21 10:27:12 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .clock : 3537120889.344557
Mar 21 10:27:12 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:12 fir-io1-s1 kernel: .avg_idle : 3710439
Mar 21 10:27:12 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:12 fir-io1-s1 kernel:
Mar 21 10:27:13 fir-io1-s1 kernel: cfs_rq[14]:/
Mar 21 10:27:13 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:13 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:13 fir-io1-s1 kernel: .min_vruntime : 156052847.025893
Mar 21 10:27:13 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:13 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:13 fir-io1-s1 kernel: .spread0 : 38166867.053008
Mar 21 10:27:13 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:13 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .avg->runnable_avg_sum : 38
Mar 21 10:27:13 fir-io1-s1 kernel: .avg->runnable_avg_period : 46505
Mar 21 10:27:13 fir-io1-s1 kernel:
Mar 21 10:27:13 fir-io1-s1 kernel: rt_rq[14]:/
Mar 21 10:27:13 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:13 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:13 fir-io1-s1 kernel:
Mar 21 10:27:13 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:13 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:13 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:13 fir-io1-s1 kernel: watchdog/14 81 -11.979100 884248 0 0.000000 9624.860476 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: migration/14 82 0.000000 37892 0 0.000000 26783.190482 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ksoftirqd/14 83 156052834.757318 153334441 120 0.000000 3418816.644719 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kworker/14:0H 85 7233.286458 9 100 0.000000 0.039844 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ata_sff 3532 647.851531 2 100 0.000000 0.013847 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: poll_mpt3sas0_h 5450 1134.249837 2 100 0.000000 0.024927 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kworker/14:1H 24102 156052834.899646 318858513 100 0.000000 2435018.633560 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ccp-2-q0 33903 8453.954830 2 120 0.000000 0.013686 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmflush 42849 10684.117035 2 100 0.000000 0.014438 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmwork-253:12 44417 156052796.329115 302918413 120 0.000000 5190251.984784 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmflush 45330 11319.499460 2 100 0.000000 0.010600 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmwork-253:15 45332 27358.966909 118 120 0.000000 1.633184 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmflush 46000 11609.358971 2 100 0.000000 0.010479 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmwork-253:44 46540 156052832.786377 305791927 120 0.000000 5283907.291045 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: bioset 58242 17652.463220 2 100 0.000000 0.014307 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kdmwork-253:112 59504 156052814.494916 204157324 120 0.000000 3930205.770046 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kiblnd_connd 91376 156052834.952630 3538498 120 0.000000 59284.512811 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ptlrpcd_02_01 91454 156052834.965167 515206 120 0.000000 12558.929748 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ptlrpcd_02_08 91461 156052834.977941 517597 120 0.000000 12589.220044 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: jbd2/md0-8 94175 156051566.787954 6306780 120 0.000000 659726.547750 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: lc_watchdogd 94201 156052835.037405 6572 120 0.000000 12155.786734 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_001 94263 156052585.870731 39466771 120 0.000000 4254213.019854 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_005 94527 156052663.842278 309684464 120 0.000000 10647940.937009 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_012 96253 156052564.505110 318510527 120 0.000000 10972372.086043 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ldlm_cn02_004 96323 156052654.000864 47093880 120 0.000000 1390589.301237 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_026 96371 156052824.661769 303956450 120 0.000000 10297937.663474 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_026 96448 156052553.295753 27186203 120 0.000000 3656344.029932 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_042 96497 156051576.528723 27482220 120 0.000000 3456154.915842 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_031 96507 156052844.807603 348922906 120 0.000000 11771534.872185 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_032 96514 156052798.151715 327235894 120 0.000000 11036965.085553 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_047 96551 156051558.130118 43861977 120 0.000000 4006022.598649 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_034 96561 156052836.402789 282634212 120 0.000000 9922819.794456 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_036 96564 156052666.654321 272358019 120 0.000000 9553704.947270 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_040 96574 156052686.792629 380773309 120 0.000000 12619765.146049 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189233.31949
Mar 21 10:27:13 fir-io1-s1 kernel: ldlm_cn02_006 96610 156052835.129851 62182463 120 0.000000 1772147.352635 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_049 96766 156052672.374045 318604377 120 0.000000 10921260.879974 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_062 96945 156052680.113956 303933538 120 0.000000 10347478.831256 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ldlm_cb02_002 122270 37605987.414858 28 120 0.000000 0.625218 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ldlm_bl_09 99090 156052652.227290 2408364 120 0.000000 25709.609673 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_084 73121 156052587.373771 1401589 120 0.000000 104817.294318 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_087 73124 156051578.529028 40166557 120 0.000000 4633621.675793 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost_io02_097 73150 156051562.927508 27297754 120 0.000000 1927555.620793 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ldlm_cn02_021 78532 156052835.358898 60231844 120 0.000000 1694001.211308 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: lst_t_02_06 48589 4449460.487638 10474 120 0.000000 382.796750 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: lst_t_02_10 48593 4449455.426063 10473 120 0.000000 383.775508 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ldlm_cn02_026 116387 156052834.917215 40918098 120 0.000000 1248849.770377 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_076 74736 156052830.693251 264657422 120 0.000000 8511906.598157 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_079 74745 156052778.131674 200738126 120 0.000000 6669486.861232 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_090 74817 156052837.021694 183168325 120 0.000000 6321359.370878 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: ll_ost02_094 75765 156052674.137189 220323057 120 0.000000 7257331.049120 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kworker/14:2 107313 156052835.032907 1387257 120 0.000000 23436.810791 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: md10_resync 123234 156052482.964900 28203912 125 0.000000 3912595.813908 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel: kworker/14:1 32343 151950121.140280 2 120 0.000000 0.009077 0.000000 2 /
Mar 21 10:27:13 fir-io1-s1 kernel:
Mar 21 10:27:13 fir-io1-s1 kernel: cpu#15, 1996.172 MHz
Mar 21 10:27:13 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .nr_switches : 12303951288
Mar 21 10:27:13 fir-io1-s1 kernel: .nr_load_updates : 1767192542
Mar 21 10:27:13 fir-io1-s1 kernel: .nr_uninterruptible : -108870
Mar 21 10:27:13 fir-io1-s1 kernel: .next_balance : 7831.651579
Mar 21 10:27:13 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .clock : 3537121737.379796
Mar 21 10:27:13 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:13 fir-io1-s1 kernel: .cpu_load[4] : 3
Mar 21 10:27:13 fir-io1-s1 kernel: .avg_idle : 5111503
Mar 21 10:27:13 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:14 fir-io1-s1 kernel:
Mar 21 10:27:14 fir-io1-s1 kernel: cfs_rq[15]:/
Mar 21 10:27:14 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:14 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:14 fir-io1-s1 kernel: .min_vruntime : 95983475.257890
Mar 21 10:27:14 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:14 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:14 fir-io1-s1 kernel: .spread0 : -21902504.725484
Mar 21 10:27:14 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:14 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .avg->runnable_avg_sum : 449
Mar 21 10:27:14 fir-io1-s1 kernel: .avg->runnable_avg_period : 46274
Mar 21 10:27:14 fir-io1-s1 kernel:
Mar 21 10:27:14 fir-io1-s1 kernel: rt_rq[15]:/
Mar 21 10:27:14 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .rt_time : 0.008616
Mar 21 10:27:14 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:14 fir-io1-s1 kernel:
Mar 21 10:27:14 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:14 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:14 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:14 fir-io1-s1 kernel: watchdog/15 86 -11.980843 884249 0 0.000000 7367.021450 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: migration/15 87 0.000000 23305 0 0.000000 22356.072586 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ksoftirqd/15 88 95983237.325608 135154166 120 0.000000 2647034.795869 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kworker/15:0H 90 4325.016105 9 100 0.000000 0.039156 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kworker/15:1H 24101 95983409.824914 308687545 100 0.000000 2051107.193088 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kdmwork-253:14 45303 95983410.838841 305420477 120 0.000000 5151954.843165 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kdmflush 45523 9964.063702 2 100 0.000000 0.015940 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kdmwork-253:74 57500 95983397.292606 202961606 120 0.000000 3936635.937896 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kdmflush 57823 15290.429904 2 100 0.000000 0.019277 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kdmwork-253:87 58314 26918.303871 116 120 0.000000 1.496897 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kdmflush 58555 16694.378108 2 100 0.000000 0.012644 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: qmgr 72904 95983365.588600 21662 120 0.000000 1580.541624 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kiblnd_sd_03_01 91391 95983475.277627 11480258081 120 0.000000 100744307.588517 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ptlrpcd_03_00 91465 12604278.442472 14 120 0.000000 0.273011 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_cn03_002 94221 95979179.179531 20237246 120 0.000000 562416.570352 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: lquota_wb_fir-O 94339 95983409.831233 58926 120 0.000000 422.159371 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: lquota_wb_fir-O 94403 95983409.830982 58924 120 0.000000 406.108398 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: lquota_wb_fir-O 94458 95983409.830451 58923 120 0.000000 417.591841 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_003 96289 95983125.331299 39525677 120 0.000000 3344721.149195 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_bl_03 96416 95983360.120548 2516353 120 0.000000 26699.184376 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_012 96446 95983133.653742 26822615 120 0.000000 2037074.833921 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_017 96477 95983248.421626 41955654 120 0.000000 3880480.212014 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_023 96510 95983206.920789 36984850 120 0.000000 3226510.983324 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_026 96563 95983127.314357 48381286 120 0.000000 4500349.565594 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_027 96578 95983142.885695 37111471 120 0.000000 3369326.192593 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost_io03_043 96712 95983109.188157 39063208 120 0.000000 4071073.718618 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_021 96949 95983319.244765 249670202 120 0.000000 7093911.370217 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_026 97129 95983158.751072 323492165 120 0.000000 9020672.102584 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_029 97132 95983416.770589 238261465 120 0.000000 6855871.018033 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_cn03_014 91500 95979179.180071 20171773 120 0.000000 550806.251863 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_cn03_027 91518 94292821.188839 22469871 120 0.000000 603258.433704 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_bl_12 43083 95983360.111561 1313801 120 0.000000 14475.884924 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_bl_15 43086 95983245.211980 1312168 120 0.000000 17335.164080 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ldlm_bl_20 43091 95983289.304071 1316650 120 0.000000 14815.459872 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_041 2371 95983465.145489 206611201 120 0.000000 5961481.043199 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_059 129914 88182558.716958 115115407 120 0.000000 3116915.829507 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_063 109957 95983410.772725 53145705 120 0.000000 1547789.640431 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_096 110611 88182558.401577 74445205 120 0.000000 2127124.228332 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: ll_ost03_105 111284 95983410.157528 63768145 120 0.000000 1825503.302480 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kworker/15:0 84813 95983463.285592 900385 120 0.000000 20105.237427 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: crond 122986 89990191.572224 7 120 0.000000 3.654924 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel: kworker/15:1 114347 94190311.997554 2 120 0.000000 0.011323 0.000000 3 /
Mar 21 10:27:14 fir-io1-s1 kernel:
Mar 21 10:27:14 fir-io1-s1 kernel: cpu#16, 1996.172 MHz
Mar 21 10:27:14 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .nr_switches : 18584075107
Mar 21 10:27:14 fir-io1-s1 kernel: .nr_load_updates : 2139768518
Mar 21 10:27:14 fir-io1-s1 kernel: .nr_uninterruptible : 1890057
Mar 21 10:27:14 fir-io1-s1 kernel: .next_balance : 7831.652295
Mar 21 10:27:14 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .clock : 3537122454.405734
Mar 21 10:27:14 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:14 fir-io1-s1 kernel: .avg_idle : 9506874
Mar 21 10:27:14 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: cfs_rq[16]:/
Mar 21 10:27:15 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:15 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189234.32039
Mar 21 10:27:15 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:15 fir-io1-s1 kernel: .min_vruntime : 121422615.000381
Mar 21 10:27:15 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:15 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:15 fir-io1-s1 kernel: .spread0 : 3536635.017007
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:15 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .avg->runnable_avg_period : 47637
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: rt_rq[16]:/
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:15 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:15 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:15 fir-io1-s1 kernel: watchdog/16 91 -11.983779 884249 0 0.000000 8987.457125 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: migration/16 92 0.000000 35682 0 0.000000 39812.455924 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: Lustre: fir-OST0000: Export ffff985769982400 already connecting from 10.8.27.2@o2ib6
Mar 21 10:27:15 fir-io1-s1 kernel: Lustre: Skipped 71 previous similar messages
Mar 21 10:27:15 fir-io1-s1 kernel: ksoftirqd/16 93 121422327.350773 137198376 120 0.000000 2211048.785243 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/16:0H 95 2750.540369 9 100 0.000000 0.041598 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/16:1H 14460 121422589.337913 435422723 100 0.000000 2867053.657223 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmflush 46040 8550.057688 2 100 0.000000 0.012975 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:30 46048 121422560.806404 306754546 120 0.000000 5308614.209973 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:50 52033 121422597.333925 290890297 120 0.000000 5097153.435776 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:60 55378 26112.760466 121 120 0.000000 1.792447 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmflush 55857 12653.355436 2 100 0.000000 0.029978 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:80 57914 121422477.129549 203820175 120 0.000000 3326696.698390 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:101 58772 26112.624795 127 120 0.000000 1.405599 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:107 59040 121422454.393782 227314434 120 0.000000 4398832.105397 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:108 59129 121422582.912369 294183040 120 0.000000 5177823.140048 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:115 60629 26112.634266 105 120 0.000000 0.818938 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: sssd 71291 121422589.366068 117900 120 0.000000 3650.738894 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: rpcbind 71298 121422597.338414 117852 120 0.000000 4187.891730 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: collectd 72460 121422602.896844 386411 120 0.000000 29421.291508 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ptlrpcd_00_11 91440 16117740.238436 6 120 0.000000 0.082127 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn00_000 94210 121422604.156609 58948431 120 0.000000 1561653.184687 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_002 94258 121422295.754966 25634318 120 0.000000 2271970.325999 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_003 94314 121422606.923609 332368037 120 0.000000 9979632.937655 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_015 96265 121422604.034117 312543161 120 0.000000 9384526.730147 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_004 96291 121422222.000680 37569330 120 0.000000 4523407.905495 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_009 96310 121422334.694693 8237690 120 0.000000 1216202.814228 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn00_004 96403 121422425.645734 50171548 120 0.000000 1381174.669986 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_029 96518 121422579.342265 288283708 120 0.000000 8906713.628520 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_032 96569 114779705.327323 264017753 120 0.000000 8390899.388974 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_043 96593 121422207.020452 29771407 120 0.000000 3129338.949392 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_045 96599 121422212.139229 36013791 120 0.000000 2708039.656870 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_054 96640 121422214.468856 45365664 120 0.000000 4724686.600234 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_052 96886 121422544.023916 396611021 120 0.000000 11511676.625005 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_create00 96901 99137832.101974 42738 120 0.000000 655.502137 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_062 96917 116518499.913011 327336454 120 0.000000 9968473.450347 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn00_012 117072 121422327.342579 42133990 120 0.000000 1193491.096902 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn00_013 117073 121422604.021891 49636268 120 0.000000 1355286.902229 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_075 73079 121422261.507692 4488349 120 0.000000 371995.551317 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_084 73277 121422206.208239 28224814 120 0.000000 2712399.721244 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_094 73287 121422286.553157 8966023 120 0.000000 718330.372448 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_095 73288 121422333.216102 8092796 120 0.000000 632056.840627 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn00_026 91515 120713526.178983 33141241 120 0.000000 948289.609016 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn00_027 91516 121422386.605777 58320702 120 0.000000 1558175.183039 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_066 49816 116518499.916127 278771328 120 0.000000 8706728.703831 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_073 49823 121422484.796375 213248581 120 0.000000 7031076.934210 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_080 49830 121422603.080505 297691576 120 0.000000 9056816.854831 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_bl_29 51516 121422588.440172 1221172 120 0.000000 13328.950328 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_092 110571 114779705.108823 125256937 120 0.000000 3888248.190674 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_096 110615 121422615.000381 107728742 120 0.000000 3552765.685361 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost00_097 110616 121422490.920397 116819576 120 0.000000 3577748.867550 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io00_099 36889 121422211.199803 10377359 120 0.000000 819988.235968 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/16:2 87686 121422602.826159 575572 120 0.000000 11186.552372 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/16:0 42733 121092107.798629 2 120 0.000000 0.009829 0.000000 0 /
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: cpu#17, 1996.172 MHz
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_switches : 23795341849
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_load_updates : 2148829709
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_uninterruptible : -249971
Mar 21 10:27:15 fir-io1-s1 kernel: .next_balance : 7831.653146
Mar 21 10:27:15 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .clock : 3537123305.438150
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .avg_idle : 2862822
Mar 21 10:27:15 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: cfs_rq[17]:/
Mar 21 10:27:15 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:15 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:15 fir-io1-s1 kernel: .min_vruntime : 152553560.539203
Mar 21 10:27:15 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:15 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:15 fir-io1-s1 kernel: .spread0 : 34667580.555829
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:15 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .avg->runnable_avg_sum : 148
Mar 21 10:27:15 fir-io1-s1 kernel: .avg->runnable_avg_period : 47810
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: rt_rq[17]:/
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:15 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:15 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:15 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:15 fir-io1-s1 kernel: watchdog/17 96 -11.979711 884249 0 0.000000 10198.424246 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: migration/17 97 0.000000 68564 0 0.000000 23718.033442 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ksoftirqd/17 98 152553359.965255 216526703 120 0.000000 4573933.246746 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/17:0H 100 3742.585155 9 100 0.000000 0.034436 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kswapd1 278 152552449.466680 1911885 120 0.000000 4230752.606287 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/17:1H 27178 152553524.395862 463820407 100 0.000000 3641085.280318 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ccp-3-q4 33996 4540.442421 2 120 0.000000 0.008376 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:19 45550 152553501.468471 290876203 120 0.000000 4998628.608279 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:28 46035 22614.206638 113 120 0.000000 1.673702 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmflush 46085 7516.264208 2 100 0.000000 0.015160 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmflush 46347 7808.483905 2 100 0.000000 0.011352 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:55 54539 152553363.705075 297387646 120 0.000000 5077357.332817 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kdmwork-253:65 56489 152553501.450586 226730667 120 0.000000 4407656.793135 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: systemd-logind 71372 152553525.576245 1359899 120 0.000000 75263.006839 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: in:imjournal 72464 152553560.539203 4105317 120 0.000000 134160.303448 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ptlrpcd_rcv 91428 143173083.683791 81886 120 0.000000 1617.283126 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: md2_raid6 92247 152551839.113934 558816132 120 0.000000 181450415.641040 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn01_000 94213 152553549.136415 76561062 120 0.000000 2025210.651254 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_000 94259 152551961.316471 24779315 120 0.000000 2807855.667313 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_001 94260 152552491.011492 41026699 120 0.000000 5022685.087676 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_012 96249 152551902.908624 405635924 120 0.000000 12663124.396245 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_015 96256 152553549.389375 398854433 120 0.000000 12384750.714339 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_019 96267 152553020.166305 424643611 120 0.000000 13299282.867953 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_021 96274 152551994.098301 390103269 120 0.000000 12350785.376027 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_041 96363 152552990.187345 357298363 120 0.000000 11366620.401021 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_043 96365 152551982.702448 421145924 120 0.000000 13113336.860846 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_046 96369 152553558.838530 373125270 120 0.000000 11776516.203445 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_051 96378 152553335.662678 355305645 120 0.000000 11384356.403778 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_019 96383 152552533.343614 33628957 120 0.000000 3959144.354449 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_033 96451 152551868.391844 27736103 120 0.000000 2628751.833825 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_037 96459 152552541.977355 24411764 120 0.000000 3193941.180611 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_038 96461 152552559.354143 34686237 120 0.000000 4324218.651289 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_058 96491 152553555.898209 419350813 120 0.000000 13151241.526585 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_060 96516 152553481.670257 369610533 120 0.000000 11914541.536638 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_053 96521 152551963.443539 39828765 120 0.000000 4622427.582254 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_066 96591 152551926.510305 45840328 120 0.000000 4946944.090255 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_070 96618 152551873.821040 22058004 120 0.000000 1611414.523532 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_070 96619 152552720.559140 445717019 120 0.000000 13788540.007068 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_072 96625 152552010.001218 31089753 120 0.000000 3765752.158946 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_082 96661 152551891.764350 55057573 120 0.000000 5734240.156440 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_085 96665 152551875.907657 51048968 120 0.000000 6213013.254306 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_093 96675 152551848.836200 31720605 120 0.000000 3267187.760936 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_098 96680 152551909.392660 20388720 120 0.000000 1693205.577989 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_io01_107 96689 152551976.012393 23204983 120 0.000000 2060332.594602 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_075 96782 152553049.911030 337077929 120 0.000000 10891095.071165 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_090 96907 152552869.160847 424330449 120 0.000000 12993276.343510 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_093 96913 152553094.819284 459685040 120 0.000000 14153276.321003 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_095 96916 152552833.862096 388987481 120 0.000000 12203227.191184 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_100 96926 152552537.217465 463408544 120 0.000000 14207005.742306 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost01_102 96928 152552928.940089 381695230 120 0.000000 11799443.609077 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn01_007 108513 152553485.619544 74166815 120 0.000000 1990243.188025 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn01_014 117029 151866157.015887 60696799 120 0.000000 1662720.324280 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn01_016 117031 151866157.015466 58168270 120 0.000000 1622367.457089 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn01_026 117094 152537167.492279 76108160 120 0.000000 2022063.061786 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ldlm_cn01_028 117096 152553554.670429 63711086 120 0.000000 1749680.066829 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: lst_t_01_02 48574 5337245.618274 20944 120 0.000000 658.291126 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: lst_t_01_04 48576 5337245.744940 20934 120 0.000000 657.807232 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: lst_t_01_08 48580 5337246.219825 20941 120 0.000000 663.064342 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: ll_ost_create01 10970 152553548.564421 1894092 120 0.000000 33175.376553 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/17:1 57912 152553548.555214 3191809 120 0.000000 54077.028111 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/17:2 87960 144051664.360006 2 120 0.000000 0.010090 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel: kworker/u256:0 29095 152553548.554783 1400 120 0.000000 15.409588 0.000000 1 /
Mar 21 10:27:15 fir-io1-s1 kernel:
Mar 21 10:27:15 fir-io1-s1 kernel: cpu#18, 1996.172 MHz
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_switches : 19744152046
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_load_updates : 1827677245
Mar 21 10:27:15 fir-io1-s1 kernel: .nr_uninterruptible : -195446
Mar 21 10:27:15 fir-io1-s1 kernel: .next_balance : 7831.654089
Mar 21 10:27:15 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .clock : 3537124248.474542
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:15 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[4] : 2
Mar 21 10:27:16 fir-io1-s1 kernel: .avg_idle : 1626496
Mar 21 10:27:16 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:16 fir-io1-s1 kernel:
Mar 21 10:27:16 fir-io1-s1 kernel: cfs_rq[18]:/
Mar 21 10:27:16 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:16 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:16 fir-io1-s1 kernel: .min_vruntime : 139169656.791401
Mar 21 10:27:16 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:16 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:16 fir-io1-s1 kernel: .spread0 : 21283676.808027
Mar 21 10:27:16 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:16 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .avg->runnable_avg_sum : 157
Mar 21 10:27:16 fir-io1-s1 kernel: .avg->runnable_avg_period : 47385
Mar 21 10:27:16 fir-io1-s1 kernel:
Mar 21 10:27:16 fir-io1-s1 kernel: rt_rq[18]:/
Mar 21 10:27:16 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:16 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:16 fir-io1-s1 kernel:
Mar 21 10:27:16 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:16 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:16 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:16 fir-io1-s1 kernel: watchdog/18 101 -11.981705 884249 0 0.000000 9290.145022 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: migration/18 102 0.000000 37851 0 0.000000 26815.761812 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ksoftirqd/18 103 139169631.358907 176950325 120 0.000000 3718417.365450 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kworker/18:0H 105 6013.757266 9 100 0.000000 0.051780 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kworker/18:1H 22148 139169436.665789 371646902 100 0.000000 2762887.261010 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: bioset 42470 9810.700838 2 100 0.000000 0.007906 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kdmwork-253:5 42529 139169177.238165 304052373 120 0.000000 5315568.382995 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kdmwork-253:21 45723 24401.159608 106 120 0.000000 1.712965 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kdmwork-253:68 57089 24401.165851 113 120 0.000000 1.695164 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189236.946
Mar 21 10:27:16 fir-io1-s1 kernel: kdmwork-253:105 58881 139169425.628575 291123882 120 0.000000 4987495.533302 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: JS Sour~ Thread 71333 24049.477975 6 120 0.000000 0.060345 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: polkitd 71336 24061.474549 3 120 0.000000 0.054315 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: crond 72591 139169643.418592 125958 120 0.000000 20671.949375 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kiblnd_sd_02_01 91387 139169656.898930 19289352346 120 0.000000 180294834.620411 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kmmpd-md6 94158 139168826.379426 10673599 120 0.000000 73307.786031 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_022 96419 139168829.834225 43139163 120 0.000000 4254164.290074 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_028 96453 139168914.228681 25449880 120 0.000000 2017923.503594 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_029 96455 139168881.542318 49188514 120 0.000000 4530818.375840 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_035 96469 139169022.040154 18199367 120 0.000000 2216090.555300 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_046 96527 139168931.959149 5200176 120 0.000000 405903.242940 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost02_037 96566 139169087.837285 336505730 120 0.000000 11195368.763507 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_052 96579 139168868.520661 3421288 120 0.000000 361804.955015 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_057 96601 139168850.934882 38447285 120 0.000000 3486849.922007 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_062 96628 139168844.726431 39266133 120 0.000000 5069207.302836 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_069 96649 139168822.251932 9595753 120 0.000000 1422874.162143 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_074 96658 139168912.924683 12012347 120 0.000000 1003924.747709 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_083 73120 139168973.823430 3353271 120 0.000000 270087.776590 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_io02_091 73144 139169001.404174 37727052 120 0.000000 3594964.570800 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ldlm_cn02_023 78534 139169422.153942 52890865 120 0.000000 1520348.133430 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost_create02 87236 133137091.037088 1847452 120 0.000000 36482.766578 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ldlm_cn02_030 116456 139169417.820461 62222329 120 0.000000 1748841.691636 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kworker/18:0 92725 139169643.119327 6047604 120 0.000000 282095.548696 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: ll_ost02_082 74748 139169255.950882 217830936 120 0.000000 7178544.029145 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kworker/u264:0 64565 139121209.609153 930 100 0.000000 19.577653 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel: kworker/18:2 1248 139121221.507016 2 120 0.000000 0.008997 0.000000 2 /
Mar 21 10:27:16 fir-io1-s1 kernel:
Mar 21 10:27:16 fir-io1-s1 kernel: cpu#19, 1996.172 MHz
Mar 21 10:27:16 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .nr_switches : 12997572639
Mar 21 10:27:16 fir-io1-s1 kernel: .nr_load_updates : 1803997939
Mar 21 10:27:16 fir-io1-s1 kernel: .nr_uninterruptible : -99348
Mar 21 10:27:16 fir-io1-s1 kernel: .next_balance : 7831.654736
Mar 21 10:27:16 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .clock : 3537124892.499496
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:16 fir-io1-s1 kernel: .avg_idle : 7424715
Mar 21 10:27:16 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:16 fir-io1-s1 kernel:
Mar 21 10:27:17 fir-io1-s1 kernel: cfs_rq[19]:/
Mar 21 10:27:17 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:17 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:17 fir-io1-s1 kernel: .min_vruntime : 95430621.467155
Mar 21 10:27:17 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:17 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:17 fir-io1-s1 kernel: .spread0 : -22455358.516219
Mar 21 10:27:17 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:17 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .avg->runnable_avg_sum : 19
Mar 21 10:27:17 fir-io1-s1 kernel: .avg->runnable_avg_period : 47026
Mar 21 10:27:17 fir-io1-s1 kernel:
Mar 21 10:27:17 fir-io1-s1 kernel: rt_rq[19]:/
Mar 21 10:27:17 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:17 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:17 fir-io1-s1 kernel:
Mar 21 10:27:17 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:17 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:17 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:17 fir-io1-s1 kernel: kthreadd 2 95430480.259407 43161 120 0.000000 3449.117062 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: watchdog/19 106 -11.980372 884249 0 0.000000 7719.200299 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: migration/19 107 0.000000 21934 0 0.000000 27036.406166 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ksoftirqd/19 108 95427061.991511 126968946 120 0.000000 2527103.247041 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kworker/19:0H 110 1102.269265 9 100 0.000000 0.033624 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kswapd3 280 95430468.288493 1700601 120 0.000000 2798010.967623 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: khugepaged 282 95430620.462461 796233 139 0.000000 290936.957872 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kworker/19:1H 7786 95428057.470668 293699632 100 0.000000 1953682.939577 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: bioset 42386 6420.582540 2 100 0.000000 0.012164 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kdmwork-253:20 45615 95428057.778870 295381119 120 0.000000 5088771.513527 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kdmwork-253:37 46120 95428050.916463 305916484 120 0.000000 5222208.430199 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kdmwork-253:114 59961 95427206.083215 226393986 120 0.000000 4316676.166752 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: cfs_rh_03 91307 95402146.580518 23566 120 0.000000 11736.482087 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ptlrpcd_03_02 91467 13232699.123754 13 120 0.000000 0.224874 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ptlrpcd_03_10 91475 13213383.896599 12 120 0.000000 0.258957 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: lc_watchdogd 94201 95430609.636349 6584 120 0.000000 12156.255559 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ldlm_cn03_001 94220 95427377.168397 23348023 120 0.000000 624527.761854 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_create03 94255 93671573.853039 26 120 0.000000 0.585742 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_001 94266 95427070.568874 5858384 120 0.000000 414685.313469 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_011 96445 95426937.944283 20643857 120 0.000000 1930474.381433 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_016 96470 95426924.922557 37194409 120 0.000000 4109678.272343 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_018 96484 95426919.253914 54683904 120 0.000000 4667988.652301 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_032 96602 95426991.619375 15564381 120 0.000000 1648890.115637 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_017 96773 87244131.712775 255283873 120 0.000000 7290878.266035 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_030 97133 95430609.863364 204910544 120 0.000000 6079068.364078 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ldlm_cn03_005 114121 87785614.852568 19275652 120 0.000000 533742.282274 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_044 73470 95427009.772970 29712111 120 0.000000 2541995.518752 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: lst_s_00 48558 3311468.593663 78 120 0.000000 1.141841 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: lst_t_03_00 48594 3309666.214406 15 120 0.000000 0.333799 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ldlm_cn03_015 91501 95428059.419486 29834702 120 0.000000 795854.403336 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ldlm_cn03_019 91505 95430621.467155 35418700 120 0.000000 927295.481376 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ldlm_cn03_022 91510 95427396.604809 26356248 120 0.000000 672622.414299 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kworker/19:2 112888 95430609.473307 4946068 120 0.000000 93260.467038 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ldlm_bl_14 43085 95427708.961130 1313047 120 0.000000 15799.311386 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_037 959 82821087.982044 192929697 120 0.000000 5769748.119802 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_039 1163 95430609.621190 286700382 120 0.000000 8214431.843796 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_049 81511 95427016.420762 1616936 120 0.000000 88406.645587 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_046 74705 82821088.567136 197502038 120 0.000000 5638182.211025 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_055 114818 82820985.224461 138737913 120 0.000000 3649230.111501 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_071 109971 95426957.281742 33945992 120 0.000000 968066.022312 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_072 109972 82821090.590228 69833173 120 0.000000 1976564.432111 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_083 110598 87244131.794681 67575543 120 0.000000 1982969.038489 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189237.32066
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_086 110601 82821093.833527 79970816 120 0.000000 2160827.090560 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_091 110606 82820957.879028 24147874 120 0.000000 850189.383915 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_092 110607 95426976.221606 71227652 120 0.000000 2059939.864990 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_093 110608 82821092.302080 51129757 120 0.000000 1513943.008054 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_094 110609 87244131.702293 73166734 120 0.000000 2120810.503593 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_106 111285 82821085.894399 43649827 120 0.000000 1297377.771858 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost03_110 111289 82820985.225273 62167530 120 0.000000 1809615.547602 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_053 101174 95428051.006485 14624357 120 0.000000 991016.508160 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_059 119038 95426949.910284 8055567 120 0.000000 465057.521975 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_062 27989 95426927.165514 11126417 120 0.000000 657202.804473 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: ll_ost_io03_066 48392 95427032.595816 502 120 0.000000 42.802822 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel: kworker/19:1 21973 95413545.349425 2 120 0.000000 0.008487 0.000000 3 /
Mar 21 10:27:17 fir-io1-s1 kernel:
Mar 21 10:27:17 fir-io1-s1 kernel: cpu#20, 1996.172 MHz
Mar 21 10:27:17 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .nr_switches : 21317540519
Mar 21 10:27:17 fir-io1-s1 kernel: .nr_load_updates : 2145022445
Mar 21 10:27:17 fir-io1-s1 kernel: .nr_uninterruptible : 1989470
Mar 21 10:27:17 fir-io1-s1 kernel: .next_balance : 7831.655595
Mar 21 10:27:17 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .clock : 3537125752.537829
Mar 21 10:27:17 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:17 fir-io1-s1 kernel: .cpu_load[4] : 64
Mar 21 10:27:17 fir-io1-s1 kernel: .avg_idle : 4428229
Mar 21 10:27:17 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:17 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: cfs_rq[20]:/
Mar 21 10:27:18 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:18 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:18 fir-io1-s1 kernel: .min_vruntime : 135404303.987021
Mar 21 10:27:18 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:18 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:18 fir-io1-s1 kernel: .spread0 : 17518324.003647
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:18 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .avg->runnable_avg_sum : 670
Mar 21 10:27:18 fir-io1-s1 kernel: .avg->runnable_avg_period : 46521
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: rt_rq[20]:/
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_time : 0.006012
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:18 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:18 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:18 fir-io1-s1 kernel: watchdog/20 111 -11.981264 884250 0 0.000000 8549.061673 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: migration/20 112 0.000000 43792 0 0.000000 29063.854750 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ksoftirqd/20 113 135403636.828451 134601788 120 0.000000 2105848.389325 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/20:0H 115 1760.976375 9 100 0.000000 0.035227 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/u261:0 7385 1421.323867 4 100 0.000000 0.019216 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/20:1H 14459 135403895.871746 435866728 100 0.000000 2817457.594881 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmflush 52017 8967.921307 2 100 0.000000 0.022612 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmwork-253:94 58525 20796.318148 143 120 0.000000 1.957209 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_004 94362 130549396.248727 299618421 120 0.000000 9229180.483301 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_008 96241 135404296.631345 341131937 120 0.000000 10441435.495917 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_017 96271 135404296.463048 291905064 120 0.000000 9117655.663074 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: LNet: Service thread pid 32098 was inactive for 200.41s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Mar 21 10:27:18 fir-io1-s1 kernel: LNet: Skipped 79 previous similar messages
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_020 96280 135404239.356297 340991235 120 0.000000 10164579.926365 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_023 96397 135404292.183708 28137457 120 0.000000 2961185.332736 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_025 96400 135403284.023469 33247769 120 0.000000 3307779.036633 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_027 96506 135404286.988153 253979329 120 0.000000 8058956.018667 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_036 96761 135403612.718559 307446893 120 0.000000 9532705.727415 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_043 96769 130549396.249838 300448495 120 0.000000 9397417.174579 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_044 96770 135404262.746360 229578874 120 0.000000 7282604.472342 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_048 96775 128786858.419486 298532424 120 0.000000 9305272.488595 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_055 96896 135403947.042923 281145218 120 0.000000 8744294.248663 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_057 96903 135403739.806807 419093559 120 0.000000 12364197.015810 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ldlm_cn00_018 117145 132512145.823968 40174679 120 0.000000 1112603.850076 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_058 73053 135403353.438360 36558830 120 0.000000 4493826.597216 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_063 73058 135403586.416297 33199988 120 0.000000 3450030.522472 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_076 73080 135403569.075101 12258985 120 0.000000 1011139.328505 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_091 73284 135403615.723484 6749940 120 0.000000 499605.364727 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_092 73285 135403464.609677 28656037 120 0.000000 3103483.427158 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: lst_t_00_03 48563 4477134.501912 10494 120 0.000000 447.495636 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: lst_t_00_06 48566 4477134.508725 10486 120 0.000000 421.164183 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_075 49825 135366415.782441 352141059 120 0.000000 10649276.541212 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_079 49829 130549396.249549 304141543 120 0.000000 9369830.309692 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ldlm_bl_26 51513 135403792.954039 1222766 120 0.000000 18137.968373 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_084 110009 135403476.097168 182861676 120 0.000000 5246260.893861 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_095 110574 135404292.009173 124536235 120 0.000000 3809423.315087 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_101 110620 135403702.991379 159760159 120 0.000000 4758566.322601 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost00_104 110657 135404296.401210 151275154 120 0.000000 4591751.721408 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_103 36893 135403290.327161 37786677 120 0.000000 2680633.023775 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/20:0 63423 135404292.014754 62621 120 0.000000 1138.327395 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/20:2 103395 135266347.792870 2 120 0.000000 0.010721 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_106 31902 135403645.869423 10 120 0.000000 2.700620 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_109 31919 135403648.764888 10 120 0.000000 3.322889 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io00_110 31920 135403643.137496 13 120 0.000000 2.254295 0.000000 0 /
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: cpu#21, 1996.172 MHz
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_switches : 22837833419
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_load_updates : 2144531107
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_uninterruptible : -258421
Mar 21 10:27:18 fir-io1-s1 kernel: .next_balance : 7831.656330
Mar 21 10:27:18 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .clock : 3537126487.800402
Mar 21 10:27:18 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .cpu_load[1] : 34
Mar 21 10:27:18 fir-io1-s1 kernel: .cpu_load[2] : 24
Mar 21 10:27:18 fir-io1-s1 kernel: .cpu_load[3] : 31
Mar 21 10:27:18 fir-io1-s1 kernel: .cpu_load[4] : 35
Mar 21 10:27:18 fir-io1-s1 kernel: .avg_idle : 241529
Mar 21 10:27:18 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: cfs_rq[21]:/
Mar 21 10:27:18 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:18 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:18 fir-io1-s1 kernel: .min_vruntime : 147115030.876757
Mar 21 10:27:18 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:18 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:18 fir-io1-s1 kernel: .spread0 : 29229050.893383
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .blocked_load_avg : 9
Mar 21 10:27:18 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:18 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .avg->runnable_avg_sum : 224
Mar 21 10:27:18 fir-io1-s1 kernel: .avg->runnable_avg_period : 46354
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: rt_rq[21]:/
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:18 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:18 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:18 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:18 fir-io1-s1 kernel: watchdog/21 116 -11.979581 884250 0 0.000000 10457.214053 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: migration/21 117 0.000000 52690 0 0.000000 26954.259509 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ksoftirqd/21 118 147113668.638703 221048884 120 0.000000 4643249.440985 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/21:0H 120 4032.945121 9 100 0.000000 0.040858 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdevtmpfs 255 303664.254608 1318 120 0.000000 15.291676 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: multipathd 44882 0.000000 1014 0 0.000000 80.474875 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/21:1H 24048 147114842.109477 477020325 100 0.000000 3778024.284022 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmflush 42280 7197.898184 2 100 0.000000 0.012664 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: bioset 42528 7227.592015 2 100 0.000000 0.013786 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmflush 44146 7450.539041 2 100 0.000000 0.009458 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: bioset 49181 8982.244063 2 100 0.000000 0.013917 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: bioset 54852 10400.682110 2 100 0.000000 0.017113 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: bioset 56016 10607.162549 2 100 0.000000 0.011873 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmwork-253:79 57874 147114809.467868 227494205 120 0.000000 3755427.333368 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmwork-253:106 58910 22243.809508 120 120 0.000000 1.053857 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kiblnd_sd_01_00 91382 147115031.253787 21912550696 120 0.000000 244371315.530012 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kmmpd-md4 94162 147113229.792668 10034169 120 0.000000 69414.619522 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_002 94240 147114799.558990 356254864 120 0.000000 11623826.485068 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_013 96251 147114400.651691 453326995 120 0.000000 14014159.355960 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_create01 96283 147115015.564381 3175283 120 0.000000 59988.050026 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_006 96296 147113307.590366 9502024 120 0.000000 697346.649517 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_010 96309 147113318.636486 38157452 120 0.000000 4328581.908697 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_013 96318 147113322.705168 5951489 120 0.000000 462415.773117 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_047 96372 147114541.139348 449841475 120 0.000000 14020696.734450 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_048 96373 147113701.052798 454517749 120 0.000000 13900697.024016 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_024 96411 147113338.640900 20726579 120 0.000000 2314769.422566 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_032 96447 147113355.811482 14726955 120 0.000000 2013577.200808 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_052 96520 147113305.548299 43264631 120 0.000000 4737162.254643 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_057 96532 147113682.385836 19900324 120 0.000000 2547295.800399 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_059 96552 147113465.243426 24528108 120 0.000000 2599010.076236 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_061 96556 147113268.733467 28863334 120 0.000000 2685143.920724 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_075 96635 147113360.468122 40974123 120 0.000000 4273953.066793 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_078 96647 147113413.263289 13436553 120 0.000000 1550827.344081 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_080 96653 147113359.095679 35034986 120 0.000000 4462238.564214 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_081 96659 147113309.463015 30401948 120 0.000000 3698365.234721 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_090 96672 147113646.427450 5785964 120 0.000000 450100.964945 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_097 96679 147113314.030247 47569064 120 0.000000 4278274.441805 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_106 96688 147113328.454390 24752096 120 0.000000 2467505.102281 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_io01_111 96693 147113308.327479 36720681 120 0.000000 3092789.632463 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_074 96781 147114682.614940 395564085 120 0.000000 12541128.920660 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_091 96909 147114633.345669 434300299 120 0.000000 13269691.611531 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_094 96915 147115024.586857 439261858 120 0.000000 13552775.743750 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost01_096 96918 147115030.263091 351727139 120 0.000000 11485295.995051 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kdmwork-253:119 16319 303677.397890 455 120 0.000000 4.299029 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: raid-check 12675 147114728.069759 1059152 120 0.000000 193855.955350 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: ll_ost_create01 23595 147113306.493835 1532051 120 0.000000 26919.138649 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/21:0 46688 147114999.222924 5000965 120 0.000000 74082.823732 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: raid-check 122988 147114989.260979 81033 120 0.000000 8019.535100 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/21:1 46978 145867055.960224 2 120 0.000000 0.012514 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel: kworker/u258:2 85196 147114988.120355 48985 120 0.000000 2159.910683 0.000000 1 /
Mar 21 10:27:18 fir-io1-s1 kernel:
Mar 21 10:27:18 fir-io1-s1 kernel: cpu#22, 1996.172 MHz
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_switches : 25999091740
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_load_updates : 2190260259
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_uninterruptible : -645107
Mar 21 10:27:19 fir-io1-s1 kernel: .next_balance : 7831.657138
Mar 21 10:27:19 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .clock : 3537127294.591991
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .avg_idle : 759997
Mar 21 10:27:19 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:19 fir-io1-s1 kernel:
Mar 21 10:27:19 fir-io1-s1 kernel: cfs_rq[22]:/
Mar 21 10:27:19 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:19 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:19 fir-io1-s1 kernel: .min_vruntime : 173845073.123655
Mar 21 10:27:19 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:19 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:19 fir-io1-s1 kernel: .spread0 : 55959093.003463
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:19 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .avg->runnable_avg_sum : 88
Mar 21 10:27:19 fir-io1-s1 kernel: .avg->runnable_avg_period : 46147
Mar 21 10:27:19 fir-io1-s1 kernel:
Mar 21 10:27:19 fir-io1-s1 kernel: rt_rq[22]:/
Mar 21 10:27:19 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:19 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:19 fir-io1-s1 kernel:
Mar 21 10:27:19 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:19 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:19 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:19 fir-io1-s1 kernel: watchdog/22 121 -11.979841 884251 0 0.000000 9075.862065 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: migration/22 122 0.000000 45373 0 0.000000 26613.291415 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ksoftirqd/22 123 173845052.112615 161633914 120 0.000000 3439645.975195 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kworker/22:0H 125 3704.354558 9 100 0.000000 0.037091 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kswapd2 279 173845060.053238 1736511 120 0.000000 3646820.428128 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kworker/22:1H 27138 173845044.382170 292254278 100 0.000000 2337308.214686 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: bioset 46087 7454.336948 2 100 0.000000 0.007976 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kdmflush 46102 7498.766859 2 100 0.000000 0.010971 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: bioset 46103 7510.775811 2 100 0.000000 0.009999 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: bioset 46125 7554.564019 2 100 0.000000 0.008898 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kdmflush 53441 10716.019880 2 100 0.000000 0.012835 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kdmwork-253:57 54970 173844982.808751 305543336 120 0.000000 5337722.152088 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kdmwork-253:64 56283 22444.767264 126 120 0.000000 1.869577 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: bioset 56488 11659.650609 2 100 0.000000 0.012293 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kdmflush 57934 12621.050050 2 100 0.000000 0.022423 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: mdadm 71319 173840897.939275 4324 120 0.000000 10905.353679 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: chronyd 71329 173844979.892566 10045 120 0.000000 722.286746 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: sssd_be 71340 173845061.167509 1658545 120 0.000000 1938199.152468 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: sshd 72454 173843982.311128 556 120 0.000000 98.194221 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: writer#1 72470 173845061.654443 17913174 120 0.000000 275545.599758 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ptlrpcd_02_03 91456 173845060.108854 515715 120 0.000000 12588.191633 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ptlrpcd_02_10 91463 173845060.105398 517014 120 0.000000 12870.328133 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_010 96248 173844661.948552 386203524 120 0.000000 12800571.375330 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_016 96272 173844344.050925 336055317 120 0.000000 11296553.169361 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_008 96312 173844345.312309 31284396 120 0.000000 2098590.295999 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_012 96325 173844329.504573 8009548 120 0.000000 632457.725077 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_016 96350 173844271.588219 22215653 120 0.000000 2271020.977640 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_028 96377 173844819.903605 326855645 120 0.000000 11121762.456371 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_018 96392 173844374.428391 15897061 120 0.000000 1003258.113781 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_030 96462 173844232.413938 53031872 120 0.000000 5274541.161998 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_044 96508 173844330.587459 16786972 120 0.000000 1916923.957435 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_033 96560 173844658.587049 290121125 120 0.000000 10041710.369071 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_039 96571 173845059.726991 291047874 120 0.000000 10157454.396423 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_054 96586 173844510.526257 55461174 120 0.000000 5684681.723657 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_041 96612 173844949.439421 339592937 120 0.000000 11382611.088429 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_042 96614 173844814.056377 298490458 120 0.000000 10325067.864857 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_066 96643 173844505.608468 7414132 120 0.000000 580912.382728 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_create02 96747 166743880.144672 1416335 120 0.000000 29118.327431 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_047 96757 173844822.583164 267935207 120 0.000000 9553823.087980 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_051 96780 173845064.268089 306814233 120 0.000000 10409542.115205 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_052 96786 173844359.399521 273299356 120 0.000000 9445742.121194 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_054 96902 173844692.273642 334948364 120 0.000000 11276330.037393 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_056 96932 173845069.083779 328999148 120 0.000000 11003565.261199 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ldlm_cn02_007 116993 173845052.940255 50096993 120 0.000000 1462718.489850 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_076 73085 173844255.021922 12590825 120 0.000000 875490.566834 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_077 73086 173844263.949659 59891719 120 0.000000 5992516.821564 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_086 73123 173844634.002383 7721 120 0.000000 239.202407 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_088 73125 173844438.785991 12496929 120 0.000000 987506.350712 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_090 73132 173844642.453764 66 120 0.000000 1.619664 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_093 73146 173844331.709470 16967523 120 0.000000 1129482.426803 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_098 73151 173844517.712638 5010493 120 0.000000 386228.103912 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_create02 86851 173845061.160217 1746456 120 0.000000 35718.225346 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ldlm_bl_22 43173 173845058.035822 1315510 120 0.000000 14318.912124 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_071 36980 173844700.570406 324680666 120 0.000000 10589756.018878 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_072 36981 173845062.271741 359113946 120 0.000000 11417334.337974 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_102 110636 173845065.505233 154131981 120 0.000000 4977299.042974 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_107 110641 173844987.272850 78886152 120 0.000000 2826546.233096 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost02_111 110702 173844992.143094 92360095 120 0.000000 3222714.847671 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kworker/22:0 82340 173589405.200359 4 120 0.000000 0.020809 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: kworker/22:1 28666 173845061.158363 24565 120 0.000000 497.006043 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel: ll_ost_io02_105 31970 173844652.850372 11 120 0.000000 4.448414 0.000000 2 /
Mar 21 10:27:19 fir-io1-s1 kernel:
Mar 21 10:27:19 fir-io1-s1 kernel: cpu#23, 1996.172 MHz
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_switches : 12318272434
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_load_updates : 1766395543
Mar 21 10:27:19 fir-io1-s1 kernel: .nr_uninterruptible : -112159
Mar 21 10:27:19 fir-io1-s1 kernel: .next_balance : 7831.658068
Mar 21 10:27:19 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .clock : 3537128226.631695
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:19 fir-io1-s1 kernel: .avg_idle : 3266389
Mar 21 10:27:20 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:20 fir-io1-s1 kernel:
Mar 21 10:27:20 fir-io1-s1 kernel: cfs_rq[23]:/
Mar 21 10:27:20 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:20 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:20 fir-io1-s1 kernel: .min_vruntime : 95783312.142726
Mar 21 10:27:20 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:20 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:20 fir-io1-s1 kernel: .spread0 : -22102669.160228
Mar 21 10:27:20 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:20 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .avg->runnable_avg_sum : 28
Mar 21 10:27:20 fir-io1-s1 kernel: .avg->runnable_avg_period : 47585
Mar 21 10:27:20 fir-io1-s1 kernel:
Mar 21 10:27:20 fir-io1-s1 kernel: rt_rq[23]:/
Mar 21 10:27:20 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:20 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:20 fir-io1-s1 kernel:
Mar 21 10:27:20 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:20 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:20 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:20 fir-io1-s1 kernel: watchdog/23 126 -11.979531 884250 0 0.000000 6980.681117 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: migration/23 127 0.000000 23002 0 0.000000 23332.516976 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ksoftirqd/23 128 95783117.139532 135346888 120 0.000000 2632636.317597 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kworker/23:0H 130 4054.787476 9 100 0.000000 0.039906 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kworker/23:1H 27134 95783202.670284 309339756 100 0.000000 2060909.129011 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kdmwork-253:29 46042 24303.114396 150 120 0.000000 1.721988 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kdmwork-253:40 46178 95783296.309456 290456038 120 0.000000 5074882.666627 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kdmwork-253:54 54329 95783259.943006 305650182 120 0.000000 5042192.299155 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kdmflush 58431 14043.413929 2 100 0.000000 0.015299 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kdmflush 59896 16146.391747 2 100 0.000000 0.011543 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kiblnd_sd_03_02 91392 95783304.688713 11486472976 120 0.000000 100117598.873688 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: bioset 91842 24327.034501 2 100 0.000000 0.014068 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_003 94287 83525016.907299 195288106 120 0.000000 5818379.007794 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: lquota_wb_fir-O 94378 95783259.908340 58924 120 0.000000 425.421362 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_010 96494 83525016.907590 224260724 120 0.000000 6496833.657658 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost_io03_034 96606 95782886.918526 22126633 120 0.000000 1740138.734982 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost_io03_036 96623 95783001.845794 41356942 120 0.000000 3684235.384178 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost_io03_037 96630 95783024.716679 36229259 120 0.000000 3724891.501218 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_014 96751 95783260.467799 274656612 120 0.000000 7849677.022029 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_031 97134 83525765.536196 252229273 120 0.000000 7389419.776669 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ldlm_cn03_011 92329 95778992.749336 14474754 120 0.000000 411265.702588 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ldlm_cn03_016 91502 95782585.117374 35117220 120 0.000000 910130.514402 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_033 130123 90899172.491898 243664838 120 0.000000 7132378.975116 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ldlm_bl_13 43084 95783202.704229 1313796 120 0.000000 14251.866675 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ldlm_bl_23 51510 95783202.688319 1220965 120 0.000000 15314.083685 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kworker/23:0 73330 95783298.154204 3904811 120 0.000000 72471.552146 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_043 74692 87951074.147932 127723547 120 0.000000 3759607.790731 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_045 74694 83525758.239885 91241885 120 0.000000 2724465.817322 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_061 2629 95783264.732987 123679738 120 0.000000 3437472.732468 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_082 110597 83525016.907289 53816120 120 0.000000 1674685.154862 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_088 110603 83525764.675931 98986279 120 0.000000 2742898.850890 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_097 110655 83525016.907029 109598655 120 0.000000 2980002.165069 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ll_ost03_103 111282 95783300.146664 36256974 120 0.000000 1204927.512312 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: ldlm_cn03_028 98942 94220475.416244 5673427 120 0.000000 222318.920394 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel: kworker/23:2 106477 95241055.687271 2 120 0.000000 0.010590 0.000000 3 /
Mar 21 10:27:20 fir-io1-s1 kernel:
Mar 21 10:27:20 fir-io1-s1 kernel: cpu#24, 1996.172 MHz
Mar 21 10:27:20 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .nr_switches : 16924710474
Mar 21 10:27:20 fir-io1-s1 kernel: .nr_load_updates : 1784080108
Mar 21 10:27:20 fir-io1-s1 kernel: .nr_uninterruptible : -1919125
Mar 21 10:27:20 fir-io1-s1 kernel: .next_balance : 7831.658706
Mar 21 10:27:20 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .clock : 3537128863.656741
Mar 21 10:27:20 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:20 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:20 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: cfs_rq[24]:/
Mar 21 10:27:21 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:21 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:21 fir-io1-s1 kernel: .min_vruntime : 103093595.828019
Mar 21 10:27:21 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:21 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:21 fir-io1-s1 kernel: .spread0 : -14792386.311889
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:21 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .avg->runnable_avg_period : 46996
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: rt_rq[24]:/
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:21 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:21 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:21 fir-io1-s1 kernel: watchdog/24 131 -11.981775 884250 0 0.000000 7938.537559 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: migration/24 132 0.000000 14963 0 0.000000 20630.273368 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ksoftirqd/24 133 103093412.072189 119679745 120 0.000000 1442212.570076 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/24:0H 135 6350.452543 9 100 0.000000 0.062068 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/24:1H 27137 103093475.295269 433025495 100 0.000000 2417779.364472 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmflush 45359 13434.698824 2 100 0.000000 0.012444 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmwork-253:22 45818 103093567.967145 289949557 120 0.000000 4916597.720414 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmflush 54537 18726.669900 2 100 0.000000 0.011703 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: bioset 57022 20123.945710 2 100 0.000000 0.013476 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmflush 57290 20341.960203 2 100 0.000000 0.011121 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: bioset 58337 22093.276142 2 100 0.000000 0.011091 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmwork-253:104 58856 103093465.021316 304045267 120 0.000000 5321950.855959 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ptlrpcd_00_05 91434 9012598.179190 8 120 0.000000 0.143717 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ptlrpcd_00_09 91438 9012846.665712 6 120 0.000000 0.072009 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: bioset 91841 37026.959873 2 100 0.000000 0.012695 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_create00 94249 84805811.301647 7256 120 0.000000 88.251190 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io00_016 96349 103093353.143399 35924813 120 0.000000 3894489.035311 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io00_035 96522 103093344.769303 34350105 120 0.000000 4473403.927577 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn00_007 100087 103090382.711055 54143705 120 0.000000 1468341.177058 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io00_079 73083 103093371.657209 35640667 120 0.000000 3696658.032335 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io00_083 73115 103093351.743826 39039762 120 0.000000 4261512.507252 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io00_088 73281 103093352.453874 52042337 120 0.000000 5368189.988476 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn00_019 78468 103093585.210965 59388151 120 0.000000 1573881.540719 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn00_028 91517 103090382.702560 42496780 120 0.000000 1195456.751761 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost00_074 49824 97536517.413508 348863255 120 0.000000 10593512.507317 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/24:2 119489 103093579.453954 139254 120 0.000000 2326.290655 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/24:1 55648 102696869.922722 9 120 0.000000 0.073602 0.000000 0 /
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: cpu#25, 1996.172 MHz
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_switches : 24710921386
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_load_updates : 1921577146
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_uninterruptible : 262518
Mar 21 10:27:21 fir-io1-s1 kernel: .next_balance : 7831.659252
Mar 21 10:27:21 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .clock : 3537129409.676743
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[2] : 2
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[3] : 6
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[4] : 10
Mar 21 10:27:21 fir-io1-s1 kernel: .avg_idle : 2695905
Mar 21 10:27:21 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: cfs_rq[25]:/
Mar 21 10:27:21 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:21 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:21 fir-io1-s1 kernel: .min_vruntime : 143930745.577843
Mar 21 10:27:21 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:21 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:21 fir-io1-s1 kernel: .spread0 : 26044762.728757
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:21 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .avg->runnable_avg_sum : 93
Mar 21 10:27:21 fir-io1-s1 kernel: .avg->runnable_avg_period : 47576
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: rt_rq[25]:/
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:21 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:21 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:21 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:21 fir-io1-s1 kernel: watchdog/25 136 -11.986594 884250 0 0.000000 7951.465036 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: migration/25 137 0.000000 16480 0 0.000000 5196.739268 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ksoftirqd/25 138 143930259.710669 33167450 120 0.000000 543280.373377 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/25:0H 140 8643.420068 9 100 0.000000 0.042021 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/25:1H 27135 143930703.644012 65177164 100 0.000000 430792.674711 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ccp-3-q3 33995 12310.621378 2 120 0.000000 0.025969 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmflush 43816 15386.315924 2 100 0.000000 0.011863 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmwork-253:96 58588 143930544.456585 226583807 120 0.000000 4355616.915781 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kdmwork-253:111 59376 36989.435924 107 120 0.000000 0.946595 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: in:imjournal 72464 143930745.577843 4105451 120 0.000000 134179.061518 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_000 94238 143930223.413649 384431787 120 0.000000 12439833.168338 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_004 94358 143930642.295137 445323770 120 0.000000 13767250.323947 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_007 94539 143930707.097716 432195358 120 0.000000 13380566.281203 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_016 96257 143930666.148317 346201643 120 0.000000 11346357.646070 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_018 96264 143930447.462713 381242855 120 0.000000 12109683.607037 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_031 96353 143930326.666103 417508232 120 0.000000 13122533.555853 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_035 96357 143930268.770670 405703557 120 0.000000 12271248.567254 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_036 96358 143930556.448780 416419758 120 0.000000 12999675.248168 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_052 96399 143930425.266174 374920032 120 0.000000 11864671.269096 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io01_030 96440 143930247.614012 21156468 120 0.000000 1953423.255472 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io01_039 96465 143930215.292248 17263869 120 0.000000 1195648.368244 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_063 96533 143930736.248698 316185279 120 0.000000 10546632.320547 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_065 96572 143930738.663830 370546924 120 0.000000 11851000.714063 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost_io01_084 96663 143930254.196784 46240284 120 0.000000 5508558.925619 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ll_ost01_110 96942 143930260.418518 436828068 120 0.000000 13327094.097139 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_bl_04 97745 143930640.994776 2516553 120 0.000000 28319.222792 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_006 98392 143924168.733314 70849428 120 0.000000 1927421.982266 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_008 114630 143923566.133677 72380397 120 0.000000 1937621.781617 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_015 117030 143930724.079267 74510947 120 0.000000 1964308.996836 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_018 117038 143923566.133406 65255160 120 0.000000 1763482.380500 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_020 117067 143930705.275547 65456248 120 0.000000 1777404.271828 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_025 117093 143930733.727997 73817563 120 0.000000 1987291.465176 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_029 117136 143930733.163630 65153221 120 0.000000 1762624.557019 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_cn01_030 117138 143923566.133225 66586700 120 0.000000 1810360.394764 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: ldlm_bl_17 43088 143930731.623532 1315766 120 0.000000 15532.241563 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/25:1 76731 143930731.626459 1248091 120 0.000000 20843.713346 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel: kworker/25:0 124007 128142913.876963 2 120 0.000000 0.009858 0.000000 1 /
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:21 fir-io1-s1 kernel: cpu#26, 1996.172 MHz
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_running : 1
Mar 21 10:27:21 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_switches : 32116966121
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_load_updates : 1722604306
Mar 21 10:27:21 fir-io1-s1 kernel: .nr_uninterruptible : 77146
Mar 21 10:27:21 fir-io1-s1 kernel: .next_balance : 7831.659912
Mar 21 10:27:21 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .clock : 3537130070.512533
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[1] : 1
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[2] : 4
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[3] : 16
Mar 21 10:27:21 fir-io1-s1 kernel: .cpu_load[4] : 28
Mar 21 10:27:21 fir-io1-s1 kernel: .avg_idle : 493606
Mar 21 10:27:21 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:21 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: cfs_rq[26]:/
Mar 21 10:27:22 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:22 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:22 fir-io1-s1 kernel: .min_vruntime : 172956846.473035
Mar 21 10:27:22 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:22 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:22 fir-io1-s1 kernel: .spread0 : 55070862.765669
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:22 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .avg->runnable_avg_sum : 166
Mar 21 10:27:22 fir-io1-s1 kernel: .avg->runnable_avg_period : 47476
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: rt_rq[26]:/
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_time : 0.006864
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:22 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:22 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:22 fir-io1-s1 kernel: watchdog/26 141 -11.986234 884251 0 0.000000 7362.858754 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: migration/26 142 0.000000 15332 0 0.000000 5668.223689 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ksoftirqd/26 143 172956834.150962 50276668 120 0.000000 615626.783994 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/26:0H 145 8313.330198 9 100 0.000000 0.042251 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/26:1H 27136 172956005.215694 38537283 100 0.000000 266160.680294 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ccp-5-q2 34227 11894.412356 2 120 0.000000 0.011692 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ccp-5-q3 34228 11906.422410 2 120 0.000000 0.010060 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ccp-5-q4 34230 11918.432463 2 120 0.000000 0.010059 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmflush 57333 22071.650441 2 100 0.000000 0.010901 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: bioset 58835 25133.936436 2 100 0.000000 0.010640 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kiblnd_sd_02_01 91387 172956846.487788 19289353086 120 0.000000 180294844.033423 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kiblnd_sd_02_02 91388 157317571.317269 19288897730 120 0.000000 180358013.981753 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ldlm_cn02_008 116994 170039643.576275 40691155 120 0.000000 1225609.687188 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/26:2 1801 172956834.164748 2586516 120 0.000000 45848.255059 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ldlm_bl_35 51523 172956674.583791 1222213 120 0.000000 18228.726969 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/26:0 100992 146628751.762546 2 120 0.000000 0.008807 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost_io02_106 31986 172956020.103345 10 120 0.000000 3.670834 0.000000 2 /
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: cpu#27, 1996.172 MHz
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_switches : 12396380446
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_load_updates : 1528327703
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_uninterruptible : 84675
Mar 21 10:27:22 fir-io1-s1 kernel: .next_balance : 7831.660345
Mar 21 10:27:22 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .clock : 3537130502.721802
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:22 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: cfs_rq[27]:/
Mar 21 10:27:22 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:22 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:22 fir-io1-s1 kernel: .min_vruntime : 73764691.167602
Mar 21 10:27:22 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:22 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:22 fir-io1-s1 kernel: .spread0 : -44121293.108392
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:22 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .avg->runnable_avg_period : 46448
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: rt_rq[27]:/
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:22 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:22 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:22 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:22 fir-io1-s1 kernel: watchdog/27 146 -11.987185 884251 0 0.000000 5896.879387 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: migration/27 147 0.000000 10181 0 0.000000 4233.123681 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ksoftirqd/27 148 73764659.788738 14913137 120 0.000000 243382.066996 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/27:0H 150 8489.334592 9 100 0.000000 0.040218 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/27:2 14442 73764679.173063 2265880 120 0.000000 38126.998574 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/27:1H 27102 73764659.773660 35698997 100 0.000000 210719.923244 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ccp-7-q2 34430 12285.988811 2 120 0.000000 0.015559 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmflush 42467 14998.866509 2 100 0.000000 0.011382 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: bioset 43417 15480.905826 2 100 0.000000 0.012455 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmwork-253:16 45361 36828.746071 111 120 0.000000 1.725634 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmflush 45441 16009.795407 2 100 0.000000 0.011783 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmwork-253:25 45964 36828.740301 138 120 0.000000 1.868634 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: bioset 48174 17559.098019 2 100 0.000000 0.010851 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: bioset 57668 22145.379836 2 100 0.000000 0.013677 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmflush 58466 23705.257579 2 100 0.000000 0.011282 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kdmflush 58833 24721.547614 2 100 0.000000 0.011131 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: cfs_rh_00 91304 73759667.820164 23491 120 0.000000 11597.618351 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ptlrpcd_03_03 91468 5261701.196545 15 120 0.000000 0.312810 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ptlrpcd_03_09 91474 5257165.778814 14 120 0.000000 0.229438 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: bioset 92222 37137.307359 2 100 0.000000 0.014978 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_008 96385 68395322.716685 283724298 120 0.000000 8054172.629406 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_011 96504 68395314.631489 194142532 120 0.000000 5783107.240065 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_012 96505 73764630.952329 264156353 120 0.000000 7545379.706311 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ldlm_cn03_006 62893 73764679.176489 22209876 120 0.000000 585711.864585 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_036 946 73764609.583602 279169432 120 0.000000 7941707.180408 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_052 113340 65621302.820064 66038655 120 0.000000 1900699.501160 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_057 129902 73764634.246249 109460023 120 0.000000 3046342.450901 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_065 109959 68395323.056607 32182140 120 0.000000 1010096.738239 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: ll_ost03_111 14040 73764691.170207 35230085 120 0.000000 1141490.507566 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel: kworker/27:1 47172 66170550.361901 2 120 0.000000 0.009217 0.000000 3 /
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:22 fir-io1-s1 kernel: cpu#28, 1996.172 MHz
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_switches : 20808302258
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_load_updates : 1800695044
Mar 21 10:27:22 fir-io1-s1 kernel: .nr_uninterruptible : -1942719
Mar 21 10:27:22 fir-io1-s1 kernel: .next_balance : 7831.660926
Mar 21 10:27:22 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .clock : 3537131083.741513
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:22 fir-io1-s1 kernel: .avg_idle : 942941
Mar 21 10:27:22 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:22 fir-io1-s1 kernel:
Mar 21 10:27:23 fir-io1-s1 kernel: cfs_rq[28]:/
Mar 21 10:27:23 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:23 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:23 fir-io1-s1 kernel: .min_vruntime : 126291369.983890
Mar 21 10:27:23 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:23 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:23 fir-io1-s1 kernel: .spread0 : 8405384.942477
Mar 21 10:27:23 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .blocked_load_avg : 2
Mar 21 10:27:23 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:23 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .avg->runnable_avg_sum : 86
Mar 21 10:27:23 fir-io1-s1 kernel: .avg->runnable_avg_period : 46887
Mar 21 10:27:23 fir-io1-s1 kernel:
Mar 21 10:27:23 fir-io1-s1 kernel: rt_rq[28]:/
Mar 21 10:27:23 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:23 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:23 fir-io1-s1 kernel:
Mar 21 10:27:23 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:23 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:23 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:23 fir-io1-s1 kernel: watchdog/28 151 -11.987646 884251 0 0.000000 7423.852292 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: migration/28 152 0.000000 17509 0 0.000000 18633.509599 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ksoftirqd/28 153 126290530.846817 122249643 120 0.000000 1426928.935705 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: kworker/28:0H 155 3283.012318 9 100 0.000000 0.037301 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: kworker/28:1H 14457 126290533.036674 443779737 100 0.000000 2462060.003000 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: kdmflush 58790 24547.528246 2 100 0.000000 0.010110 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: bioset 58791 24559.536855 2 100 0.000000 0.009349 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: kiblnd_sd_00_00 91378 126291370.279187 18070234850 120 0.000000 180308470.538424 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost00_010 96252 121109049.375362 327062520 120 0.000000 10058791.353926 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost_io00_008 96307 126290519.527399 20990128 120 0.000000 2539421.429349 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost_io00_031 96460 126290191.342781 25223212 120 0.000000 3030331.257583 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost_io00_036 96528 126290406.653778 16356385 120 0.000000 1619594.094081 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost00_056 96899 122482553.755490 342068654 120 0.000000 10482726.244546 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost_io00_089 73282 126290533.997954 2796387 120 0.000000 198507.509847 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: ll_ost00_091 110570 122482565.758898 147605735 120 0.000000 4390597.094831 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: kworker/28:0 121650 126290545.475556 726003 120 0.000000 14416.342218 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel: kworker/28:2 76158 125614735.217820 30 120 0.000000 0.170287 0.000000 0 /
Mar 21 10:27:23 fir-io1-s1 kernel:
Mar 21 10:27:23 fir-io1-s1 kernel: cpu#29, 1996.172 MHz
Mar 21 10:27:23 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .nr_switches : 22643805078
Mar 21 10:27:23 fir-io1-s1 kernel: .nr_load_updates : 1873786941
Mar 21 10:27:23 fir-io1-s1 kernel: .nr_uninterruptible : 325906
Mar 21 10:27:23 fir-io1-s1 kernel: .next_balance : 7831.661358
Mar 21 10:27:23 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .clock : 3537131516.755552
Mar 21 10:27:23 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:23 fir-io1-s1 kernel: .cpu_load[2] : 144
Mar 21 10:27:23 fir-io1-s1 kernel: .cpu_load[3] : 49
Mar 21 10:27:23 fir-io1-s1 kernel: .cpu_load[4] : 26
Mar 21 10:27:23 fir-io1-s1 kernel: .avg_idle : 319608
Mar 21 10:27:23 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:23 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: cfs_rq[29]:/
Mar 21 10:27:24 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:24 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:24 fir-io1-s1 kernel: .min_vruntime : 129534930.937856
Mar 21 10:27:24 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:24 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:24 fir-io1-s1 kernel: .spread0 : 11648945.305854
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .blocked_load_avg : 8
Mar 21 10:27:24 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:24 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .avg->runnable_avg_sum : 200
Mar 21 10:27:24 fir-io1-s1 kernel: .avg->runnable_avg_period : 46542
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: rt_rq[29]:/
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:24 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:24 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:24 fir-io1-s1 kernel: watchdog/29 156 -11.985903 884251 0 0.000000 8435.905622 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: migration/29 157 0.000000 18668 0 0.000000 6888.237682 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: ksoftirqd/29 158 129533480.866482 35761132 120 0.000000 595809.382571 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/29:0H 160 19642.844595 9 100 0.000000 0.042242 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/29:2 13924 129534790.316727 6030617 120 0.000000 89131.183814 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 44794 0.000000 898 0 0.000000 71.047863 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 44959 0.000000 959 0 0.000000 73.761765 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 45004 0.000000 16384 0 0.000000 2652.092067 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 45333 0.000000 943 0 0.000000 73.545042 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 45551 0.000000 979 0 0.000000 74.560536 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 45727 0.000000 974 0 0.000000 73.691115 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 45822 0.000000 942 0 0.000000 73.358796 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46027 0.000000 963 0 0.000000 78.836487 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46049 0.000000 918 0 0.000000 70.707265 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46055 0.000000 999 0 0.000000 89.912936 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46063 0.000000 950 0 0.000000 72.019655 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46127 0.000000 914 0 0.000000 71.567255 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46249 0.000000 973 0 0.000000 79.683762 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 46303 0.000000 962 0 0.000000 74.229083 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 52061 0.000000 968 0 0.000000 83.355075 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 54556 0.000000 1021 0 0.000000 80.440596 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 54855 0.000000 952 0 0.000000 72.989529 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 55391 0.000000 977 0 0.000000 78.244421 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 56039 0.000000 919 0 0.000000 72.832826 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 56841 0.000000 978 0 0.000000 79.474190 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 57091 0.000000 968 0 0.000000 77.041932 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 57436 0.000000 991 0 0.000000 78.682203 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 57478 0.000000 981 0 0.000000 80.603099 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 57574 0.000000 893 0 0.000000 70.578064 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 57832 0.000000 984 0 0.000000 76.693957 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 57916 0.000000 938 0 0.000000 77.290808 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58058 0.000000 987 0 0.000000 78.099195 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58152 0.000000 969 0 0.000000 79.328645 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58290 0.000000 952 0 0.000000 78.007755 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58500 0.000000 973 0 0.000000 75.090848 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58530 0.000000 979 0 0.000000 79.962325 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58715 0.000000 961 0 0.000000 78.995822 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58738 0.000000 966 0 0.000000 77.594963 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58773 0.000000 986 0 0.000000 78.431366 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58796 0.000000 921 0 0.000000 74.249620 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 58912 0.000000 965 0 0.000000 76.028344 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 59044 0.000000 939 0 0.000000 79.492918 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 59965 0.000000 904 0 0.000000 71.428409 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: multipathd 62147 0.000000 998 0 0.000000 81.543682 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 46024 16766.783277 2 100 0.000000 0.013196 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 46033 16779.501511 2 100 0.000000 0.011962 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: bioset 46034 16791.511028 2 100 0.000000 0.010861 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 46151 16942.178283 2 100 0.000000 0.026321 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/29:1H 53076 129534579.062555 73673273 100 0.000000 492945.142683 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 54851 20612.070685 2 100 0.000000 0.014498 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 56277 21206.255747 2 100 0.000000 0.008777 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 57085 21569.923982 2 100 0.000000 0.012783 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: bioset 57936 22464.492593 2 100 0.000000 0.010560 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 60627 27049.577504 2 100 0.000000 0.010551 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kiblnd_sd_01_02 91384 129534931.830529 21911230589 120 0.000000 244372472.331403 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost01_001 94239 129534668.883145 399133193 120 0.000000 12659402.304691 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost01_045 96368 129534278.574913 471241715 120 0.000000 14287567.586645 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost_io01_027 96418 129533242.066064 44141916 120 0.000000 4962988.546754 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost_io01_102 96684 129533329.881683 33052610 120 0.000000 3584168.302291 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/29:1 52327 102440507.902444 2 120 0.000000 0.009127 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel: md0_resync 123288 129533179.094227 25838549 125 0.000000 3871061.843816 0.000000 1 /
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: cpu#30, 1996.172 MHz
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_switches : 13092742371
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_load_updates : 1572821514
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_uninterruptible : 253594
Mar 21 10:27:24 fir-io1-s1 kernel: .next_balance : 7831.662289
Mar 21 10:27:24 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .clock : 3537132447.794922
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:24 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: cfs_rq[30]:/
Mar 21 10:27:24 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:24 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:24 fir-io1-s1 kernel: .min_vruntime : 104620372.072211
Mar 21 10:27:24 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:24 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:24 fir-io1-s1 kernel: .spread0 : -13265613.768682
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:24 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .avg->runnable_avg_sum : 2
Mar 21 10:27:24 fir-io1-s1 kernel: .avg->runnable_avg_period : 46818
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: rt_rq[30]:/
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:24 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:24 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:24 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:24 fir-io1-s1 kernel: watchdog/30 161 -11.985852 884251 0 0.000000 7988.784988 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: migration/30 162 0.000000 20983 0 0.000000 6090.851569 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ksoftirqd/30 163 104620349.125525 30811243 120 0.000000 434575.160017 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/30:0H 165 7958.713747 9 100 0.000000 0.030968 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/30:1 7260 104620360.084324 4118183 120 0.000000 75463.972418 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/30:1H 27055 104620356.307793 53728074 100 0.000000 302564.095518 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 57471 21511.285606 2 100 0.000000 0.011111 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmwork-253:91 58436 104620355.019088 204018396 120 0.000000 3784995.594841 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmflush 58586 23397.250216 2 100 0.000000 0.011371 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: bioset 58587 23405.258757 2 100 0.000000 0.009257 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kdmwork-253:98 58681 36064.932205 116 120 0.000000 1.429154 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: writer#4 72473 104620359.487794 17739585 120 0.000000 275098.224980 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ptlrpcd_02_05 91458 104620358.133780 516648 120 0.000000 12588.101442 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: bioset 92089 36251.375714 2 100 0.000000 0.011983 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_cb02_000 94205 19983335.419075 46 120 0.000000 0.676482 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_cb02_001 94206 19982585.978558 44 120 0.000000 0.814639 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_cn02_000 94216 104620353.487536 47646776 120 0.000000 1374049.312090 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_003 94316 104620338.562639 307720981 120 0.000000 10377689.350669 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_009 96246 104620283.419427 305180526 120 0.000000 10555250.313909 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_013 96255 104620317.936332 337004347 120 0.000000 11140979.825615 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_017 96275 104620269.973652 294020778 120 0.000000 10040851.722385 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_030 96493 104620263.313792 333366848 120 0.000000 11298318.379910 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost_io02_045 96519 104620127.148789 36297042 120 0.000000 3658936.719495 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost_io02_051 96576 104620226.135961 2935548 120 0.000000 748447.373473 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_053 96788 104620359.504268 334623574 120 0.000000 11186862.218563 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_063 96946 104620284.318773 352965959 120 0.000000 11805203.430379 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_065 96948 104620370.194517 339481553 120 0.000000 11531888.696662 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_bl_07 103801 104620258.158953 2512623 120 0.000000 26719.947130 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_cn02_013 117035 104620357.551228 51628255 120 0.000000 1491546.002536 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_cn02_016 117137 104620353.490843 32214625 120 0.000000 1046215.415160 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ldlm_cn02_020 117143 104620359.633417 61614018 120 0.000000 1756395.190826 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_086 74752 104620266.831669 193693912 120 0.000000 6676352.868085 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_087 74763 104620346.743848 211111817 120 0.000000 6888562.558320 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_088 74776 104620279.489094 142068031 120 0.000000 5031538.326851 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_091 74818 104620171.770322 184988807 120 0.000000 6317152.785863 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: ll_ost02_093 75603 104620368.697425 260607436 120 0.000000 8509917.278900 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel: kworker/30:2 73242 98066995.024663 2 120 0.000000 0.008075 0.000000 2 /
Mar 21 10:27:24 fir-io1-s1 kernel:
Mar 21 10:27:24 fir-io1-s1 kernel: cpu#31, 1996.172 MHz
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_switches : 11364146735
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_load_updates : 1460488470
Mar 21 10:27:24 fir-io1-s1 kernel: .nr_uninterruptible : 97212
Mar 21 10:27:24 fir-io1-s1 kernel: .next_balance : 7831.662950
Mar 21 10:27:24 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .clock : 3537133107.820160
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:24 fir-io1-s1 kernel: .avg_idle : 2089480
Mar 21 10:27:24 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:25 fir-io1-s1 kernel:
Mar 21 10:27:25 fir-io1-s1 kernel: cfs_rq[31]:/
Mar 21 10:27:25 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:25 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:25 fir-io1-s1 kernel: .min_vruntime : 71611741.048957
Mar 21 10:27:25 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:25 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:25 fir-io1-s1 kernel: .spread0 : -46274244.791936
Mar 21 10:27:25 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:25 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .avg->runnable_avg_sum : 20
Mar 21 10:27:25 fir-io1-s1 kernel: .avg->runnable_avg_period : 47281
Mar 21 10:27:25 fir-io1-s1 kernel:
Mar 21 10:27:25 fir-io1-s1 kernel: rt_rq[31]:/
Mar 21 10:27:25 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:25 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:25 fir-io1-s1 kernel:
Mar 21 10:27:25 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:25 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:25 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:25 fir-io1-s1 kernel: watchdog/31 166 -11.986885 884251 0 0.000000 5913.703996 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: migration/31 167 0.000000 10628 0 0.000000 4853.553565 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ksoftirqd/31 168 71611407.867454 16653914 120 0.000000 264883.753659 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kworker/31:0H 170 9326.216502 9 100 0.000000 0.039054 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kworker/31:1H 27053 71611407.848876 38777119 100 0.000000 226444.450595 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ccp-1-q2 33810 12799.727441 2 120 0.000000 0.012464 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ccp-1-q3 33811 12811.737864 2 120 0.000000 0.010429 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 44415 16342.080359 2 100 0.000000 0.013766 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmwork-253:17 45444 37071.170692 117 120 0.000000 1.763308 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmflush 46176 16958.794892 2 100 0.000000 0.011352 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 46177 16966.807657 2 100 0.000000 0.013737 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmflush 46265 17064.362281 2 100 0.000000 0.012153 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 46281 17072.375261 2 100 0.000000 0.014448 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmwork-253:59 55256 37071.179307 130 120 0.000000 1.799208 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmwork-253:72 57424 37071.170881 106 120 0.000000 1.553280 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmflush 57870 23230.176978 2 100 0.000000 0.009698 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 57872 23254.268001 2 100 0.000000 0.009950 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 58149 23764.568898 2 100 0.000000 0.009578 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 58313 24213.294056 2 100 0.000000 0.010140 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 58360 24330.872265 2 100 0.000000 0.012003 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kdmwork-253:89 58361 37071.174618 121 120 0.000000 1.257689 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: bioset 58473 24541.634491 2 100 0.000000 0.010229 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kiblnd_sd_03_00 91390 71611741.188454 11479143970 120 0.000000 100744317.112641 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost_io03_035 96617 71611416.709579 31051752 120 0.000000 2838820.621496 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost_io03_041 96666 71611289.499518 14990444 120 0.000000 1522777.175582 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: lst_t_03_08 48603 1349100.579777 14 120 0.000000 0.112745 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ldlm_bl_36 51524 71611585.506782 1224239 120 0.000000 13415.118414 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost03_053 114702 66395316.016116 115758280 120 0.000000 3247089.758919 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost03_070 109970 66395316.626188 92313778 120 0.000000 2508805.666687 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost03_080 110000 66395315.645310 121176882 120 0.000000 3255310.016664 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost03_081 110596 68131644.364328 125881963 120 0.000000 3433690.603389 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: ll_ost_io03_056 117104 71611410.104504 23343920 120 0.000000 1481466.287515 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kworker/31:1 23937 71611690.136581 103944 120 0.000000 1592.762056 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel: kworker/31:2 55572 70602517.987101 2 120 0.000000 0.008717 0.000000 3 /
Mar 21 10:27:25 fir-io1-s1 kernel:
Mar 21 10:27:25 fir-io1-s1 kernel: cpu#32, 1996.172 MHz
Mar 21 10:27:25 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .nr_switches : 16854403728
Mar 21 10:27:25 fir-io1-s1 kernel: .nr_load_updates : 1783088818
Mar 21 10:27:25 fir-io1-s1 kernel: .nr_uninterruptible : -2052824
Mar 21 10:27:25 fir-io1-s1 kernel: .next_balance : 7831.663576
Mar 21 10:27:25 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .clock : 3537133733.845703
Mar 21 10:27:25 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:25 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:25 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:25 fir-io1-s1 kernel:
Mar 21 10:27:26 fir-io1-s1 kernel: cfs_rq[32]:/
Mar 21 10:27:26 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:26 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:26 fir-io1-s1 kernel: .min_vruntime : 108657424.442877
Mar 21 10:27:26 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:26 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:26 fir-io1-s1 kernel: .spread0 : -9228561.398016
Mar 21 10:27:26 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:26 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .avg->runnable_avg_period : 46161
Mar 21 10:27:26 fir-io1-s1 kernel:
Mar 21 10:27:26 fir-io1-s1 kernel: rt_rq[32]:/
Mar 21 10:27:26 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:26 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:26 fir-io1-s1 kernel:
Mar 21 10:27:26 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:26 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:26 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:26 fir-io1-s1 kernel: watchdog/32 171 -11.987575 884253 0 0.000000 8012.176880 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: migration/32 172 0.000000 180732 0 0.000000 22260.149267 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ksoftirqd/32 173 108657337.627468 131109245 120 0.000000 1559961.754805 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kworker/32:0H 175 5077.084874 9 100 0.000000 0.042891 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kworker/32:1H 14458 108657369.791374 465962178 100 0.000000 2573945.364189 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ccp-8-q0 34600 16120.271487 2 120 0.000000 0.011411 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ccp-8-q1 34601 16132.278965 2 120 0.000000 0.007484 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ccp-8-q2 34602 16144.286273 2 120 0.000000 0.007314 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ccp-8-q3 34603 16156.293241 2 120 0.000000 0.006974 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ccp-8-q4 34604 16168.300650 2 120 0.000000 0.007415 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmwork-253:0 42262 50300.341231 128 120 0.000000 1.988869 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmwork-253:2 42303 108657342.418810 203972734 120 0.000000 3877659.052307 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: bioset 45331 19306.531839 2 100 0.000000 0.011221 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmflush 45815 19462.120846 2 100 0.000000 0.012784 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmflush 45881 19475.389430 2 100 0.000000 0.015750 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmwork-253:27 46026 108657369.809860 289503754 120 0.000000 5077523.775704 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: bioset 47910 20704.455073 2 100 0.000000 0.010900 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmflush 51521 22590.770553 2 100 0.000000 0.021952 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmwork-253:49 51526 50300.338797 118 120 0.000000 1.574546 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kdmwork-253:62 55859 108657144.553873 303747143 120 0.000000 5354832.772342 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: bioset 57422 26139.085324 2 100 0.000000 0.010230 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: bioset 58067 27217.709510 2 100 0.000000 0.014378 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: bioset 59039 29894.140054 2 100 0.000000 0.010350 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ptlrpcd_00_03 91432 10354382.608678 8 120 0.000000 0.132695 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: bioset 91757 50551.408800 2 100 0.000000 0.012373 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: md4_raid6 92431 108656992.089398 552746756 120 0.000000 173097098.766271 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: inconsistency_v 94363 53001.572307 2 120 0.000000 0.023314 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_011 96317 108657021.200043 18087193 120 0.000000 1361302.001491 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost00_022 96329 108657417.930074 391342359 120 0.000000 11640748.914471 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_027 96414 108657019.092470 10172111 120 0.000000 724439.306816 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_046 96607 108657004.958547 24941680 120 0.000000 1965845.435872 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_048 96621 108657098.257972 4727122 120 0.000000 376796.780657 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ldlm_cn00_008 117033 105850474.931506 38034498 120 0.000000 1063447.967360 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ldlm_cn00_010 117041 108657103.597305 44778884 120 0.000000 1259098.611223 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_065 73060 108657003.356978 36670039 120 0.000000 3910178.084595 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_074 73078 108656996.809846 33196128 120 0.000000 3419573.494845 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost_io00_085 73278 108656994.715537 15222734 120 0.000000 1036462.059696 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ldlm_cn00_030 115844 105850474.934211 27972506 120 0.000000 836762.110364 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost00_068 49818 108657424.446053 357010600 120 0.000000 10497152.491289 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost00_082 49832 108657381.791334 372684263 120 0.000000 11077083.250767 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: ll_ost00_109 110662 108657324.039294 101077241 120 0.000000 3290898.731451 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kworker/32:1 12563 108657411.148297 56534 120 0.000000 853.275352 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel: kworker/32:2 123342 108589879.542809 2 120 0.000000 0.010590 0.000000 0 /
Mar 21 10:27:26 fir-io1-s1 kernel:
Mar 21 10:27:26 fir-io1-s1 kernel: cpu#33, 1996.172 MHz
Mar 21 10:27:26 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .nr_switches : 24671707694
Mar 21 10:27:26 fir-io1-s1 kernel: .nr_load_updates : 1917992838
Mar 21 10:27:26 fir-io1-s1 kernel: .nr_uninterruptible : 267463
Mar 21 10:27:26 fir-io1-s1 kernel: .next_balance : 7831.664304
Mar 21 10:27:26 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .clock : 3537134461.873338
Mar 21 10:27:26 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:26 fir-io1-s1 kernel: .avg_idle : 4434959
Mar 21 10:27:26 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:26 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: cfs_rq[33]:/
Mar 21 10:27:27 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:27 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:27 fir-io1-s1 kernel: .min_vruntime : 149953831.680469
Mar 21 10:27:27 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:27 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:27 fir-io1-s1 kernel: .spread0 : 32067845.839576
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:27 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .avg->runnable_avg_sum : 4
Mar 21 10:27:27 fir-io1-s1 kernel: .avg->runnable_avg_period : 47301
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: rt_rq[33]:/
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:27 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:27 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:27 fir-io1-s1 kernel: watchdog/33 176 -11.984290 884252 0 0.000000 7863.307417 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: migration/33 177 0.000000 151124 0 0.000000 5862.786220 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ksoftirqd/33 178 149953645.393739 33611150 120 0.000000 619355.884424 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/33:0H 180 18065.082027 9 100 0.000000 0.034366 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: netns 256 47.366182 2 100 0.000000 0.009919 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: writeback 258 71.384541 2 100 0.000000 0.008958 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kintegrityd 259 83.392968 2 100 0.000000 0.009038 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 260 95.401174 2 100 0.000000 0.008807 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 261 107.409150 2 100 0.000000 0.008617 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 262 119.417336 2 100 0.000000 0.008837 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: md 264 143.433708 2 100 0.000000 0.008897 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: edac-poller 265 155.441743 2 100 0.000000 0.008676 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: watchdogd 266 167.449868 2 100 0.000000 0.008747 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: irq/27-AMD-Vi 270 0.000000 2 49 0.000000 0.018424 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ksmd 281 347.730445 2 125 0.000000 0.011601 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: crypto 283 371.825447 2 100 0.000000 0.010450 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kthrotld 291 468.045111 2 100 0.000000 0.010280 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kmpath_rdacd 296 528.093973 2 100 0.000000 0.018576 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kaluad 297 540.104874 2 100 0.000000 0.011592 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kpsmoused 301 576.134476 2 100 0.000000 0.010491 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ipv6_addrconf 302 588.146430 2 100 0.000000 0.012675 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/33:1 306 149953819.779266 5295634 120 0.000000 87872.176224 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/33:1H 27054 149953809.811835 64100803 100 0.000000 416676.388288 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 52960 30740.353831 2 100 0.000000 0.012574 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 55072 32443.852831 2 100 0.000000 0.009298 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmwork-253:70 57300 149953792.465149 227866388 120 0.000000 4389076.352950 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 57335 33927.469846 2 100 0.000000 0.008246 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 58050 34991.872956 2 100 0.000000 0.009378 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 58398 36042.346175 2 100 0.000000 0.008496 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 59374 38198.977564 2 100 0.000000 0.009638 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kmmpd-md8 94163 149952977.589301 8107650 120 0.000000 59180.375219 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn01_001 94214 149943342.721252 57532584 120 0.000000 1587769.365173 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn01_002 94215 149758668.762971 64260848 120 0.000000 1750668.888389 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_create01 94250 149953819.748228 1959333 120 0.000000 35795.952265 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_008 96242 149953350.594171 322061170 120 0.000000 10622496.699976 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_010 96244 149953371.574996 367342546 120 0.000000 11735700.804574 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_022 96277 149953817.171707 366216090 120 0.000000 11755233.864610 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io01_005 96295 149952989.435672 42712548 120 0.000000 4609989.475001 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_033 96355 149953361.024195 490861599 120 0.000000 14910632.542086 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_034 96356 149953460.601326 420631944 120 0.000000 12941919.964614 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_037 96359 149953076.953590 392406054 120 0.000000 12339653.597547 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_039 96361 149953232.925141 397682290 120 0.000000 12842119.581695 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_057 96479 149953068.456403 428700420 120 0.000000 13492047.963317 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_066 96573 149953822.975160 429271081 120 0.000000 13374930.655453 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io01_071 96622 149953012.295324 33375124 120 0.000000 3409631.044024 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io01_076 96642 149952982.213854 54445373 120 0.000000 5523925.370550 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io01_087 96669 149953090.306787 23652370 120 0.000000 2957651.051399 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_078 96888 149953824.341707 397935020 120 0.000000 12665615.245362 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_079 96890 149953819.795559 371912297 120 0.000000 11985724.870714 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_082 96893 149953450.943300 348309987 120 0.000000 10983304.853607 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost01_103 96929 149953073.123361 472787397 120 0.000000 14252922.933472 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn01_011 117026 149953819.811259 74548868 120 0.000000 2000907.019249 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn01_017 117034 149953819.706320 75542072 120 0.000000 2010267.215053 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn01_019 117039 149953819.682684 76466425 120 0.000000 2042861.042959 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn01_022 117069 149953692.165834 78785425 120 0.000000 2094064.836905 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: lst_t_01_07 48579 3083603.140333 20940 120 0.000000 665.465309 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/33:0 21025 149650147.993534 2 120 0.000000 0.010621 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/u256:1 18131 149953819.717740 5486 120 0.000000 64.359165 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/u256:2 33831 149953819.699635 46 120 0.000000 0.250978 0.000000 1 /
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: cpu#34, 1996.172 MHz
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_switches : 9360165864
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_load_updates : 1450772804
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_uninterruptible : 350071
Mar 21 10:27:27 fir-io1-s1 kernel: .next_balance : 7831.665213
Mar 21 10:27:27 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .clock : 3537135370.907289
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .avg_idle : 2734477
Mar 21 10:27:27 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: cfs_rq[34]:/
Mar 21 10:27:27 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:27 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:27 fir-io1-s1 kernel: .min_vruntime : 92040323.055248
Mar 21 10:27:27 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:27 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:27 fir-io1-s1 kernel: .spread0 : -25845662.785645
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:27 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .avg->runnable_avg_sum : 100
Mar 21 10:27:27 fir-io1-s1 kernel: .avg->runnable_avg_period : 46337
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: rt_rq[34]:/
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:27 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:27 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:27 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:27 fir-io1-s1 kernel: watchdog/34 181 -11.985442 884253 0 0.000000 8371.475723 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: migration/34 182 0.000000 133819 0 0.000000 9536.616631 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ksoftirqd/34 183 92040332.487131 36137121 120 0.000000 633815.694263 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/34:0H 185 14945.232813 9 100 0.000000 0.042552 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: deferwq 321 115.134460 2 100 0.000000 0.009578 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/34:1H 27057 92039123.613116 60687353 100 0.000000 372756.208871 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 54969 28951.751501 2 100 0.000000 0.009809 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 55858 29745.293263 2 100 0.000000 0.010691 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 57597 31306.259620 2 100 0.000000 0.014928 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 58051 31951.445797 2 100 0.000000 0.010750 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 58240 32314.701539 2 100 0.000000 0.010942 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 58628 32966.502446 2 100 0.000000 0.012694 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 58880 33742.661689 2 100 0.000000 0.011832 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 59127 34092.525119 2 100 0.000000 0.009909 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 59128 34104.532806 2 100 0.000000 0.008486 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kdmflush 62140 38738.001608 2 100 0.000000 0.011773 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: bioset 62141 38750.011446 2 100 0.000000 0.010370 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: polkitd 71293 92039140.545362 720364 120 0.000000 33289.327611 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: JS GC Helper 71332 52037.410139 4 120 0.000000 0.114510 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: gssproxy 71312 51996.589967 3 120 0.000000 4.173398 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: rsyslogd 72456 92038769.693708 5933 120 0.000000 147.528798 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ptlrpcd_02_09 91462 92039853.773271 516551 120 0.000000 12638.293521 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kmmpd-md2 94159 92038764.118833 10571095 120 0.000000 72002.183516 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_create02 94252 92040310.722448 2810607 120 0.000000 53729.604923 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_create02 94253 92039016.708745 1956946 120 0.000000 36826.382292 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_006 96304 92038774.125762 19123844 120 0.000000 1302947.491723 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_015 96342 92038870.692616 27766016 120 0.000000 2697724.422849 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_024 96367 92040323.361404 321335413 120 0.000000 10858649.032659 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_025 96370 92039086.123561 313066091 120 0.000000 10682409.625702 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_023 96421 92038842.296903 10704138 120 0.000000 810578.215543 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_036 96472 92038846.999380 25767110 120 0.000000 1738819.905133 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_038 96486 92038771.919798 53949661 120 0.000000 6081330.406702 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_050 96559 92038776.030875 19093676 120 0.000000 1961592.136838 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_035 96562 92039134.591969 347267545 120 0.000000 11888479.190819 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_058 96603 92038940.043116 3712601 120 0.000000 904966.336594 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_045 96753 92039148.632774 318619718 120 0.000000 10925507.370700 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_059 96936 92039022.513246 332821956 120 0.000000 11317581.774986 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_060 96937 92039079.536852 373066764 120 0.000000 12378172.300295 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_io02_085 73122 92038794.739185 44291441 120 0.000000 4569149.905575 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn02_024 78535 91402820.025056 49176007 120 0.000000 1453273.505777 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost_create02 89765 86070367.851174 2829156 120 0.000000 55789.189508 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_bl_31 51518 92039059.710737 1223455 120 0.000000 13503.369242 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_070 36979 92039111.716625 242772815 120 0.000000 8174144.695435 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ldlm_cn02_031 93903 90126982.066947 37003148 120 0.000000 1128207.381148 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_083 74749 92039065.377060 197609141 120 0.000000 6753530.481901 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_090 74817 92040322.674064 183168717 120 0.000000 6321370.514540 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_097 77323 92039028.373815 293047118 120 0.000000 9337962.637273 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_103 110637 92039066.705663 172724868 120 0.000000 5411120.103037 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: ll_ost02_106 110640 92040316.854224 161715499 120 0.000000 5157551.128066 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/34:1 50680 92040309.014335 1657396 120 0.000000 27721.228529 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/34:0 12051 86802089.728078 2 120 0.000000 0.009368 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel: kworker/u259:1 88586 92037994.194517 14390 120 0.000000 623.125660 0.000000 2 /
Mar 21 10:27:27 fir-io1-s1 kernel:
Mar 21 10:27:27 fir-io1-s1 kernel: cpu#35, 1996.172 MHz
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_switches : 12317937255
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_load_updates : 1521796148
Mar 21 10:27:27 fir-io1-s1 kernel: .nr_uninterruptible : 88635
Mar 21 10:27:27 fir-io1-s1 kernel: .next_balance : 7831.666043
Mar 21 10:27:27 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .clock : 3537136199.935930
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:27 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:27 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:28 fir-io1-s1 kernel:
Mar 21 10:27:28 fir-io1-s1 kernel: cfs_rq[35]:/
Mar 21 10:27:28 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:28 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:28 fir-io1-s1 kernel: .min_vruntime : 78766744.430538
Mar 21 10:27:28 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:28 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:28 fir-io1-s1 kernel: .spread0 : -39119241.410355
Mar 21 10:27:28 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:28 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .avg->runnable_avg_period : 47725
Mar 21 10:27:28 fir-io1-s1 kernel:
Mar 21 10:27:28 fir-io1-s1 kernel: rt_rq[35]:/
Mar 21 10:27:28 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:28 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:28 fir-io1-s1 kernel:
Mar 21 10:27:28 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:28 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:28 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:28 fir-io1-s1 kernel: watchdog/35 186 -11.986324 884252 0 0.000000 5973.610329 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: migration/35 187 0.000000 182992 0 0.000000 4690.050750 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ksoftirqd/35 188 78766628.057704 14857353 120 0.000000 263085.180026 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: kworker/35:0 189 78766732.455837 2581992 120 0.000000 43763.391949 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: kworker/35:0H 190 19901.388062 9 100 0.000000 0.032991 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: scsi_eh_1 2430 1174.427651 2 120 0.000000 0.009809 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: scsi_tmf_1 2431 1186.435974 2 100 0.000000 0.009468 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: mlx5_page_alloc 7355 2609.647743 2 100 0.000000 0.011060 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: mlx5_fc 7433 2707.866840 2 100 0.000000 0.011833 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ib-comp-unb-wq 7447 2780.150915 2 100 0.000000 0.011853 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ib_mcast 7448 2792.159792 2 100 0.000000 0.009488 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ib_nl_sa_wq 7449 2804.168990 2 100 0.000000 0.009819 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ib_mad1 7462 2864.461743 2 100 0.000000 0.012103 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: to_fifo 7463 2876.470851 2 100 0.000000 0.009808 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: mkey_cache 7466 2888.482241 2 100 0.000000 0.012714 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: poll_mpt3sas0_s 10088 9228.891440 2 100 0.000000 0.012535 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: kworker/35:1H 27056 78766628.042042 34836756 100 0.000000 200842.078140 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: kdmwork-253:13 45266 61938.367876 122 120 0.000000 2.004575 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: bioset 46155 29143.857232 2 100 0.000000 0.017223 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: bioset 57825 35846.027868 2 100 0.000000 0.010821 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: kdmflush 58334 36907.614793 2 100 0.000000 0.011412 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: bioset 58495 37259.719306 2 100 0.000000 0.010821 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: bioset 58558 37374.651944 2 100 0.000000 0.009659 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ptlrpcd_03_07 91472 6376804.525994 13 120 0.000000 0.219901 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_016 96759 69367493.116063 261317710 120 0.000000 7566839.728854 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_024 97127 69367486.752576 268961954 120 0.000000 7716325.276627 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_025 97128 74594016.395305 305743657 120 0.000000 8671625.900753 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: lst_t_03_04 48598 1733606.386333 15 120 0.000000 0.590300 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: lst_t_03_06 48601 1732841.913874 14 120 0.000000 0.210644 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ldlm_cn03_012 91498 78761296.497614 22678930 120 0.000000 608575.573288 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ldlm_cn03_013 91499 78764134.519146 32213458 120 0.000000 843753.175702 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ldlm_cn03_024 91512 77093209.053722 20881631 120 0.000000 582565.924792 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ldlm_cn03_025 91513 78761296.496803 19576438 120 0.000000 549165.395081 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_049 110267 72433166.414889 78204510 120 0.000000 2196096.363361 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_069 109969 78766252.491923 116510271 120 0.000000 3243491.440501 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_078 109998 72433172.919409 74430124 120 0.000000 2103745.994357 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_099 111262 78766241.636774 79461956 120 0.000000 2086291.266573 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ll_ost03_108 111287 78766359.416069 111042417 120 0.000000 3061948.162844 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: ldlm_cn03_029 98943 78761296.504167 9098699 120 0.000000 337196.558218 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: md2_resync 123149 78765993.039584 28817893 125 0.000000 3944533.823526 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel: kworker/35:2 115626 78453437.002069 2 120 0.000000 0.009799 0.000000 3 /
Mar 21 10:27:28 fir-io1-s1 kernel:
Mar 21 10:27:28 fir-io1-s1 kernel: cpu#36, 1996.172 MHz
Mar 21 10:27:28 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .nr_switches : 20685835421
Mar 21 10:27:28 fir-io1-s1 kernel: .nr_load_updates : 1797077777
Mar 21 10:27:28 fir-io1-s1 kernel: .nr_uninterruptible : -2136512
Mar 21 10:27:28 fir-io1-s1 kernel: .next_balance : 7831.666747
Mar 21 10:27:28 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .clock : 3537136904.962721
Mar 21 10:27:28 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:28 fir-io1-s1 kernel: .avg_idle : 2874154
Mar 21 10:27:28 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:29 fir-io1-s1 kernel:
Mar 21 10:27:29 fir-io1-s1 kernel: cfs_rq[36]:/
Mar 21 10:27:29 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:29 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:29 fir-io1-s1 kernel: .min_vruntime : 132652800.203004
Mar 21 10:27:29 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:29 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:29 fir-io1-s1 kernel: .spread0 : 14766812.726429
Mar 21 10:27:29 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .blocked_load_avg : 193
Mar 21 10:27:29 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:29 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .avg->runnable_avg_sum : 43
Mar 21 10:27:29 fir-io1-s1 kernel: .avg->runnable_avg_period : 47947
Mar 21 10:27:29 fir-io1-s1 kernel:
Mar 21 10:27:29 fir-io1-s1 kernel: rt_rq[36]:/
Mar 21 10:27:29 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:29 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:29 fir-io1-s1 kernel:
Mar 21 10:27:29 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:29 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:29 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:29 fir-io1-s1 kernel: watchdog/36 191 -11.988468 884252 0 0.000000 7790.413444 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: migration/36 192 0.000000 197969 0 0.000000 19062.645454 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ksoftirqd/36 193 132650754.360498 134232826 120 0.000000 1574159.114886 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kworker/36:0H 195 11328.197445 9 100 0.000000 0.032742 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kworker/u262:0 7386 1826.765483 4 100 0.000000 0.014809 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: mlx5_ib_sigerr_ 7457 1879.346049 2 100 0.000000 0.011101 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kworker/36:1H 14456 132651515.790204 476298169 100 0.000000 2649274.520741 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kdmwork-253:32 46062 63156.928243 109 120 0.000000 1.869143 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: bioset 57566 37956.812798 2 100 0.000000 0.011042 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: bioset 58736 40409.204225 2 100 0.000000 0.010841 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: bioset 59315 41484.655963 2 100 0.000000 0.011042 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kdmflush 59502 41746.098443 2 100 0.000000 0.009898 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kdmflush 61780 44436.034284 2 100 0.000000 0.010090 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: gssproxy 71322 58794.336775 2 120 0.000000 0.035478 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: gssproxy 71324 58806.343682 1 120 0.000000 0.006913 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: gssproxy 71325 58818.350840 1 120 0.000000 0.007164 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: md8_raid6 92616 132649613.770860 404110934 120 0.000000 124186272.223398 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost00_006 94854 132619901.155690 373747154 120 0.000000 11174536.432180 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost00_007 96240 132652746.969286 300042243 120 0.000000 9314252.651664 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost00_013 96260 128579120.305404 373217913 120 0.000000 11138194.771638 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost_io00_012 96338 132649709.050736 30086179 120 0.000000 3593605.024024 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost_io00_014 96343 132649798.519040 28470524 120 0.000000 3251602.748204 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost_io00_040 96581 132649691.620699 44289339 120 0.000000 4967306.999397 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost00_059 96908 128579116.121389 303796042 120 0.000000 9145408.532126 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost00_060 96910 132652550.006233 262709878 120 0.000000 8105941.572271 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ldlm_cn00_017 117144 132112577.449212 42516797 120 0.000000 1180332.835811 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost_io00_060 73055 132649712.677307 15071489 120 0.000000 1589912.692954 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: lst_t_00_07 48567 3460295.361145 10499 120 0.000000 460.910875 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ldlm_cn00_029 91519 132645135.705910 41859115 120 0.000000 1174881.275820 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ldlm_cn00_031 115845 132649861.663332 49242097 120 0.000000 1347284.102399 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost_io00_101 36891 132649858.067113 5293639 120 0.000000 425014.130459 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kworker/36:1 56145 132652788.212011 51485 120 0.000000 956.936208 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: kworker/36:0 78368 132205021.476772 2 120 0.000000 0.005751 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel: ll_ost_io00_108 31918 132650727.663916 12 120 0.000000 3.424366 0.000000 0 /
Mar 21 10:27:29 fir-io1-s1 kernel:
Mar 21 10:27:29 fir-io1-s1 kernel: cpu#37, 1996.172 MHz
Mar 21 10:27:29 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .nr_switches : 22537256146
Mar 21 10:27:29 fir-io1-s1 kernel: .nr_load_updates : 1870435852
Mar 21 10:27:29 fir-io1-s1 kernel: .nr_uninterruptible : 329875
Mar 21 10:27:29 fir-io1-s1 kernel: .next_balance : 7831.667371
Mar 21 10:27:29 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .clock : 3537137530.991811
Mar 21 10:27:29 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:29 fir-io1-s1 kernel: .avg_idle : 340233
Mar 21 10:27:29 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:30 fir-io1-s1 kernel:
Mar 21 10:27:30 fir-io1-s1 kernel: cfs_rq[37]:/
Mar 21 10:27:30 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:30 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:30 fir-io1-s1 kernel: .min_vruntime : 136712945.766806
Mar 21 10:27:30 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:30 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:30 fir-io1-s1 kernel: .spread0 : 18826957.053422
Mar 21 10:27:30 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:30 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .avg->runnable_avg_sum : 202
Mar 21 10:27:30 fir-io1-s1 kernel: .avg->runnable_avg_period : 47105
Mar 21 10:27:30 fir-io1-s1 kernel:
Mar 21 10:27:30 fir-io1-s1 kernel: rt_rq[37]:/
Mar 21 10:27:30 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:30 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:30 fir-io1-s1 kernel:
Mar 21 10:27:30 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:30 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:30 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:30 fir-io1-s1 kernel: watchdog/37 196 -11.986564 884252 0 0.000000 8386.994074 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: migration/37 197 0.000000 163566 0 0.000000 7924.620010 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: ksoftirqd/37 198 136710660.789138 36204850 120 0.000000 665066.235030 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kworker/37:0H 200 16119.036454 9 100 0.000000 0.032113 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 44816 0.000000 965 0 0.000000 75.296266 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 44829 0.000000 964 0 0.000000 75.907168 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 44912 0.000000 934 0 0.000000 71.987534 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 45268 0.000000 918 0 0.000000 70.134091 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 45304 0.000000 951 0 0.000000 72.173979 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 45446 0.000000 929 0 0.000000 71.457561 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 45530 0.000000 934 0 0.000000 72.010791 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 45620 0.000000 985 0 0.000000 79.148401 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 45965 0.000000 980 0 0.000000 80.957580 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 46006 0.000000 963 0 0.000000 71.237826 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 46091 0.000000 965 0 0.000000 74.681455 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 46105 0.000000 971 0 0.000000 86.786436 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 46413 0.000000 950 0 0.000000 74.509287 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 47718 0.000000 958 0 0.000000 77.152385 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 47916 0.000000 978 0 0.000000 77.509295 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 48189 0.000000 963 0 0.000000 74.878465 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 49189 0.000000 907 0 0.000000 72.479926 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 51605 0.000000 958 0 0.000000 77.551958 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 55261 0.000000 953 0 0.000000 77.983003 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 55860 0.000000 913 0 0.000000 74.604044 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 56517 0.000000 983 0 0.000000 78.898726 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 57301 0.000000 997 0 0.000000 79.996184 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 57612 0.000000 997 0 0.000000 83.417500 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 57679 0.000000 993 0 0.000000 79.928105 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58248 0.000000 979 0 0.000000 81.418891 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58403 0.000000 954 0 0.000000 77.343855 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58441 0.000000 974 0 0.000000 79.467627 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58477 0.000000 963 0 0.000000 81.077835 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58592 0.000000 920 0 0.000000 78.793522 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58687 0.000000 949 0 0.000000 77.182062 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 58861 0.000000 943 0 0.000000 74.015713 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 59383 0.000000 970 0 0.000000 83.550110 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 59509 0.000000 1023 0 0.000000 85.232832 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 59906 0.000000 991 0 0.000000 80.647488 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 60631 0.000000 976 0 0.000000 93.286939 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: multipathd 61785 0.000000 973 0 0.000000 83.304533 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kworker/37:1H 27004 136711078.732904 72323799 100 0.000000 482320.334948 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kworker/37:147 42233 136712934.378587 6648555 120 0.000000 99833.116281 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kdmflush 42619 25998.656014 2 100 0.000000 0.011142 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kdmflush 45301 26473.512502 2 100 0.000000 0.010379 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: bioset 45443 26575.568683 2 100 0.000000 0.009828 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kdmflush 45613 26769.164157 2 100 0.000000 0.011042 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: bioset 45614 26777.173165 2 100 0.000000 0.009368 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kdmwork-253:43 46376 60013.695746 110 120 0.000000 1.724718 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kiblnd_sd_01_00 91382 136712946.585661 21912556563 120 0.000000 244371357.824765 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: ll_ost01_028 96345 136712094.562522 370543315 120 0.000000 11895297.276497 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: ll_ost_io01_029 96422 136709756.369369 6303147 120 0.000000 976776.575878 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: ll_ost01_078 96888 136712938.113655 397935225 120 0.000000 12665618.938251 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: ll_ost_create01 12450 133484376.018552 902019 120 0.000000 16814.978978 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel: kworker/37:1 112136 133219987.344648 2 120 0.000000 0.009559 0.000000 1 /
Mar 21 10:27:30 fir-io1-s1 kernel:
Mar 21 10:27:30 fir-io1-s1 kernel: cpu#38, 1996.172 MHz
Mar 21 10:27:30 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .nr_switches : 11002128988
Mar 21 10:27:30 fir-io1-s1 kernel: .nr_load_updates : 1662018562
Mar 21 10:27:30 fir-io1-s1 kernel: .nr_uninterruptible : 352035
Mar 21 10:27:30 fir-io1-s1 kernel: .next_balance : 7831.668225
Mar 21 10:27:30 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .clock : 3537138383.023189
Mar 21 10:27:30 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:30 fir-io1-s1 kernel: .avg_idle : 1239464
Mar 21 10:27:30 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:30 fir-io1-s1 kernel:
Mar 21 10:27:31 fir-io1-s1 kernel: cfs_rq[38]:/
Mar 21 10:27:31 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:31 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:31 fir-io1-s1 kernel: .min_vruntime : 101311558.261945
Mar 21 10:27:31 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:31 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:31 fir-io1-s1 kernel: .spread0 : -16574430.690447
Mar 21 10:27:31 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:31 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .avg->runnable_avg_sum : 101
Mar 21 10:27:31 fir-io1-s1 kernel: .avg->runnable_avg_period : 47516
Mar 21 10:27:31 fir-io1-s1 kernel:
Mar 21 10:27:31 fir-io1-s1 kernel: rt_rq[38]:/
Mar 21 10:27:31 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:31 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:31 fir-io1-s1 kernel:
Mar 21 10:27:31 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:31 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:31 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:31 fir-io1-s1 kernel: watchdog/38 201 -11.986053 884253 0 0.000000 8478.952771 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: migration/38 202 0.000000 132643 0 0.000000 7890.355164 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ksoftirqd/38 203 101311532.218632 34047132 120 0.000000 536155.933315 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: kworker/38:0H 205 11754708.518329 12 100 0.000000 0.076717 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: scsi_eh_2 7312 2093.895986 22 120 0.000000 5.642700 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: scsi_tmf_2 7313 2034.036689 2 100 0.000000 0.008987 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: mlx5_health0000 7324 2048.610630 2 100 0.000000 0.008597 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: kdmwork-253:10 43868 56225.803056 116 120 0.000000 1.825080 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: bioset 45963 18202.598511 2 100 0.000000 0.007935 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: kdmwork-253:33 46071 101311347.538583 289938952 120 0.000000 5065368.401068 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: bioset 46537 18895.313527 2 100 0.000000 0.030118 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: bioset 54328 22927.739831 2 100 0.000000 0.008597 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: bioset 60628 29710.181754 2 100 0.000000 0.013236 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: rpciod 71263 47063.665159 2 100 0.000000 0.008898 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: xprtiod 71264 47075.673024 2 100 0.000000 0.008486 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: mlx4_ib_mcg 71494 47418.437006 2 100 0.000000 0.012003 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ipoib_flush 71588 47624.950679 2 100 0.000000 0.010710 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: mlx5i 71590 47636.958565 2 100 0.000000 0.009538 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ipoib_wq 71601 47648.967114 2 100 0.000000 0.009368 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: rdma_cm 71973 47846.975362 2 100 0.000000 0.010560 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: writer#0 72469 101311533.886275 17681786 120 0.000000 274803.317918 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: reader#2 72476 101311532.480383 430692 120 0.000000 42883.216122 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: nfsiod 72524 48632.008490 2 100 0.000000 0.010039 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: clio 91331 55040.487630 2 100 0.000000 0.010689 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpc_hr02_000 91349 55184.615536 2 120 0.000000 0.012224 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpc_hr02_001 91350 55196.626271 2 120 0.000000 0.010741 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpc_hr02_002 91351 55208.636675 2 120 0.000000 0.010410 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpc_hr02_003 91352 55220.647050 2 120 0.000000 0.010381 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpc_hr02_004 91353 55232.657524 2 120 0.000000 0.010480 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpc_hr02_005 91354 55244.669671 2 120 0.000000 0.012153 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ptlrpcd_02_07 91460 101311482.126889 516475 120 0.000000 12645.599969 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldiskfs-rsv-con 94176 60700.746508 2 100 0.000000 0.012825 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldiskfs-rsv-con 94180 60716.119415 2 100 0.000000 0.010992 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldiskfs-rsv-con 94195 60752.157100 2 100 0.000000 0.011441 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldiskfs-rsv-con 94196 60764.167279 2 100 0.000000 0.010810 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_000 94262 101310759.423940 22118219 120 0.000000 1661718.249651 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_seq02_00 94272 61497.142776 2 120 0.000000 0.042571 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_seq02_00 94273 61509.165002 2 120 0.000000 0.022232 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_out02_00 94280 61593.260322 2 120 0.000000 0.040748 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_out02_00 94281 61605.282529 2 120 0.000000 0.022213 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldiskfs-rsv-con 94285 61658.709986 2 100 0.000000 0.011051 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldiskfs-rsv-con 94300 61682.728867 2 100 0.000000 0.009588 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: inconsistency_v 94317 61706.771547 2 120 0.000000 0.028224 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: inconsistency_v 94413 61875.062222 2 120 0.000000 0.024978 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: inconsistency_v 94443 61993.493154 2 120 0.000000 0.020689 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: inconsistency_v 94468 62122.266582 2 120 0.000000 0.020579 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_014 96262 101311128.816674 293258219 120 0.000000 10083178.459623 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_015 96269 101311131.530101 320254463 120 0.000000 10878421.851841 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_004 96292 101310943.257285 6031763 120 0.000000 501491.437608 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldlm_cn02_003 96322 101311181.795739 49131128 120 0.000000 1401399.574102 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_021 96327 101311127.731411 319531348 120 0.000000 11020079.154139 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_013 96330 101310748.127643 38086964 120 0.000000 2876557.046001 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_023 96333 101311359.060800 313535733 120 0.000000 10615399.593598 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_020 96408 101310978.142850 34534814 120 0.000000 3746570.829026 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_021 96410 101310960.881482 18715679 120 0.000000 1464195.239029 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_025 96443 101310741.948474 9523773 120 0.000000 601704.466324 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_048 96557 101311000.725791 34868656 120 0.000000 4800570.277280 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_055 96590 101310887.507999 5183305 120 0.000000 354623.717394 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_056 96598 101310959.730056 14019194 120 0.000000 1122969.145532 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_061 96624 101310976.572666 23717455 120 0.000000 3135669.660644 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_067 96644 101310980.641431 18659319 120 0.000000 2246122.832203 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_070 96650 101310966.946231 39166253 120 0.000000 4770315.490363 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_071 96651 101310980.448853 7397400 120 0.000000 1295415.308536 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_072 96656 101310978.834164 11525894 120 0.000000 1380418.009632 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_073 96657 101310960.772522 32087733 120 0.000000 4243289.711805 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_043 96749 101311398.254896 303372693 120 0.000000 10448442.128767 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_050 96776 101311076.572503 392269902 120 0.000000 12988897.710950 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_055 96911 101311123.648817 394974121 120 0.000000 13069987.068239 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_064 96947 101311266.017340 342671361 120 0.000000 11471677.211564 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: kworker/38:0 81923 101311545.999465 5612184 120 0.000000 91467.022049 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_075 73084 101310978.624669 6060480 120 0.000000 453837.997127 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_079 73116 101310937.192400 16705387 120 0.000000 2227588.203308 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_092 73145 101310942.290780 13111392 120 0.000000 1039566.815207 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_094 73147 101310988.402129 30461088 120 0.000000 3310156.159987 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_099 73152 101311000.864577 28799664 120 0.000000 3924751.275042 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldlm_cn02_022 78533 101311547.064881 45121543 120 0.000000 1348935.471713 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_00 48583 2812920.164186 10475 120 0.000000 403.116442 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_01 48584 2812920.064349 10466 120 0.000000 368.425254 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_02 48585 2812913.034974 10471 120 0.000000 372.390745 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_03 48586 2812918.683350 10471 120 0.000000 370.042321 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_04 48587 2812919.703339 10478 120 0.000000 388.541314 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_05 48588 2812920.002605 10471 120 0.000000 417.140656 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_07 48590 2812918.667714 10469 120 0.000000 381.464215 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_08 48591 2812922.618746 10473 120 0.000000 370.329174 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: lst_t_02_09 48592 2812919.915703 10472 120 0.000000 400.130724 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: kworker/38:2H 15487 101311397.435169 52548186 100 0.000000 276838.812241 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ldlm_bl_24 51511 101311119.537285 1224207 120 0.000000 18048.196591 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_080 74746 101311070.493057 215031696 120 0.000000 7199699.721877 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_098 110632 101311104.163474 180445757 120 0.000000 5732258.046609 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_099 110633 101311129.584061 143218172 120 0.000000 4635174.065870 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_100 110634 101311131.521735 154013803 120 0.000000 4962914.326454 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_104 110638 101311259.306777 103798236 120 0.000000 3588666.174700 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_106 110640 101311547.810077 161715559 120 0.000000 5157553.631416 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost02_108 110699 101311319.175151 101903571 120 0.000000 3523439.424713 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: kworker/38:1 56814 100415042.726830 2 120 0.000000 0.010950 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: sshd 31084 101310719.297433 93 120 0.000000 16.402978 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_101 31927 101311014.235867 12 120 0.000000 3.701132 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_102 31947 101311017.789390 17 120 0.000000 4.774169 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_104 31969 101311546.335185 637 120 0.000000 129.370199 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_107 31987 101311018.943620 20 120 0.000000 4.792043 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_110 32039 101311026.536715 21 120 0.000000 2.872096 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel: ll_ost_io02_111 32040 101311022.153453 16 120 0.000000 2.685251 0.000000 2 /
Mar 21 10:27:31 fir-io1-s1 kernel:
Mar 21 10:27:31 fir-io1-s1 kernel: cpu#39, 1996.172 MHz
Mar 21 10:27:31 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .nr_switches : 11281457076
Mar 21 10:27:31 fir-io1-s1 kernel: .nr_load_updates : 1449343485
Mar 21 10:27:31 fir-io1-s1 kernel: .nr_uninterruptible : 102236
Mar 21 10:27:31 fir-io1-s1 kernel: .next_balance : 7831.669621
Mar 21 10:27:31 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .clock : 3537139780.077681
Mar 21 10:27:31 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:31 fir-io1-s1 kernel: .avg_idle : 1164956
Mar 21 10:27:31 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:31 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: cfs_rq[39]:/
Mar 21 10:27:32 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:32 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:32 fir-io1-s1 kernel: .min_vruntime : 77072676.856557
Mar 21 10:27:32 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:32 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:32 fir-io1-s1 kernel: .spread0 : -40813313.048751
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:32 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:32 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189251.97126
Mar 21 10:27:32 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .avg->runnable_avg_sum : 127
Mar 21 10:27:32 fir-io1-s1 kernel: .avg->runnable_avg_period : 47880
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: rt_rq[39]:/
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:32 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:32 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:32 fir-io1-s1 kernel: watchdog/39 206 -11.987266 884253 0 0.000000 6032.586999 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: migration/39 207 0.000000 191553 0 0.000000 6405.779499 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ksoftirqd/39 208 77071007.925921 16502428 120 0.000000 284678.974899 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/39:0H 210 17123.551445 9 100 0.000000 0.032090 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ext4-rsv-conver 14504 8401.498368 2 100 0.000000 0.009809 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/39:1H 27003 77071170.769960 37648758 100 0.000000 218715.029945 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kdmwork-253:6 42626 77071162.036003 304250983 120 0.000000 5301991.638386 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kdmflush 58706 35126.823646 2 100 0.000000 0.010400 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kdmflush 58735 35198.761063 2 100 0.000000 0.015449 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: bioset 59503 36544.237301 2 100 0.000000 0.010580 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: bioset 59897 37344.362317 2 100 0.000000 0.010070 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: mlx4 71480 53859.446489 2 100 0.000000 0.012584 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: mlx4_ib 71493 53888.283769 2 100 0.000000 0.011743 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: nfsv4.1-svc 72566 55162.559402 2 120 0.000000 0.013125 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kiblnd_sd_03_03 91393 77072677.010706 11479910649 120 0.000000 100737572.849502 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: bioset 91758 59600.091325 2 100 0.000000 0.010881 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: inconsistency_v 94388 65737.917716 2 120 0.000000 0.021501 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io03_004 96298 77070926.213292 40685857 120 0.000000 3656991.823793 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost03_009 96481 71064474.613599 220869741 120 0.000000 6508113.433219 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn03_003 96938 71529949.421214 19228719 120 0.000000 513735.196861 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn03_008 42674 77070156.758681 23789167 120 0.000000 623418.262269 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn03_020 91506 77070156.757399 18861663 120 0.000000 517560.923839 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/39:0 84640 77072664.869742 1901551 120 0.000000 28951.007666 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost03_034 937 71064474.823651 251113922 120 0.000000 7248763.630673 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost03_035 938 71064474.623338 307389184 120 0.000000 8693687.900742 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io03_050 81512 77070930.657509 33039247 120 0.000000 2223248.431425 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost03_096 110611 77072652.120154 74445206 120 0.000000 2127124.232019 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn03_031 98945 77070156.763821 11606215 120 0.000000 352032.483944 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: python 73761 77072676.935492 5273194 120 0.000000 4192398.585886 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io03_064 31716 77070919.640911 8558616 120 0.000000 504728.462295 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/39:2 100351 74304336.318191 2 120 0.000000 0.009248 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel: sleep 34418 77071981.655631 2 120 0.000000 0.538290 0.000000 3 /
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: cpu#40, 1996.172 MHz
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_switches : 16825279579
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_load_updates : 1779985891
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_uninterruptible : -2297696
Mar 21 10:27:32 fir-io1-s1 kernel: .next_balance : 7831.670234
Mar 21 10:27:32 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .clock : 3537140390.101317
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .avg_idle : 8065310
Mar 21 10:27:32 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: cfs_rq[40]:/
Mar 21 10:27:32 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:32 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:32 fir-io1-s1 kernel: .min_vruntime : 104380103.090287
Mar 21 10:27:32 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:32 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:32 fir-io1-s1 kernel: .spread0 : -13505887.620104
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:32 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .avg->runnable_avg_period : 47587
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: rt_rq[40]:/
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:32 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:32 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:32 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:32 fir-io1-s1 kernel: watchdog/40 211 -11.990021 884253 0 0.000000 7886.433518 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: migration/40 212 0.000000 20203 0 0.000000 22805.260832 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ksoftirqd/40 213 104380045.070119 142006104 120 0.000000 1657478.137228 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/40:0H 215 3186.757015 9 100 0.000000 0.045717 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/40:1H 14455 104380045.054558 496505943 100 0.000000 2772043.351600 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kdmwork-253:39 46156 41604.080026 120 120 0.000000 1.662632 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kdmflush 54323 22960.583899 2 100 0.000000 0.011451 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kdmflush 58148 26173.461379 2 100 0.000000 0.011621 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: bioset 58524 27179.004896 2 100 0.000000 0.010601 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: smartd 71292 104361578.667522 1030589 120 0.000000 21293.779323 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: agetty 72657 41376.508236 9 120 0.000000 9.920019 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ptlrpc_hr00_001 91337 41615.938933 2 120 0.000000 0.018295 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ptlrpcd_00_00 91429 9605135.886827 7 120 0.000000 0.108418 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: md6_raid6 92157 104379703.589329 440366990 120 0.000000 145514799.963440 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: bioset 92353 42131.726720 2 100 0.000000 0.012743 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: bioset 92355 42143.735569 2 100 0.000000 0.009718 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: jbd2/md6-8 94193 104379723.952832 6928574 120 0.000000 670498.173840 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn00_002 94212 103731951.242519 37221905 120 0.000000 1040574.352191 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_create00 94247 104379938.013017 17620 120 0.000000 181.544846 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_001 94257 104379893.412392 23910178 120 0.000000 2401821.586305 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_003 96287 104379888.800401 25626724 120 0.000000 3560164.597613 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_021 96390 104379819.393676 12274638 120 0.000000 1303565.709007 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_038 96534 104379732.669249 46168471 120 0.000000 4305864.788895 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_039 96554 104379865.569637 12377543 120 0.000000 935312.511899 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost00_031 96567 104380045.270283 346347283 120 0.000000 10522468.760226 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_051 96631 104379750.807488 14343881 120 0.000000 1911178.778060 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost00_038 96763 104380103.090287 282641037 120 0.000000 8701416.084395 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost00_042 96768 104379941.783616 328197861 120 0.000000 9942631.490285 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_078 73082 104379736.019673 47406999 120 0.000000 4596820.681302 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_096 73475 104379751.922455 13024434 120 0.000000 828491.112553 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189252.96949
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn00_023 84120 104380090.302028 57058102 120 0.000000 1513470.527354 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ldlm_cn00_024 91508 101697526.561048 37902580 120 0.000000 1094669.413074 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: ll_ost_io00_100 36890 104379896.561064 2093590 120 0.000000 177561.902434 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/40:1 30742 104380089.732085 199687 120 0.000000 3551.892671 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel: kworker/40:0 57152 104114070.012627 2 120 0.000000 0.009298 0.000000 0 /
Mar 21 10:27:32 fir-io1-s1 kernel:
Mar 21 10:27:32 fir-io1-s1 kernel: cpu#41, 1996.172 MHz
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_switches : 24744162708
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_load_updates : 1919003368
Mar 21 10:27:32 fir-io1-s1 kernel: .nr_uninterruptible : 259787
Mar 21 10:27:32 fir-io1-s1 kernel: .next_balance : 7831.670873
Mar 21 10:27:32 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .clock : 3537141034.122473
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:32 fir-io1-s1 kernel: .avg_idle : 1228464
Mar 21 10:27:32 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:33 fir-io1-s1 kernel:
Mar 21 10:27:33 fir-io1-s1 kernel: cfs_rq[41]:/
Mar 21 10:27:33 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:33 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:33 fir-io1-s1 kernel: .min_vruntime : 143207902.483455
Mar 21 10:27:33 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:33 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:33 fir-io1-s1 kernel: .spread0 : 25321910.953630
Mar 21 10:27:33 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:33 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .avg->runnable_avg_sum : 140
Mar 21 10:27:33 fir-io1-s1 kernel: .avg->runnable_avg_period : 47159
Mar 21 10:27:33 fir-io1-s1 kernel:
Mar 21 10:27:33 fir-io1-s1 kernel: rt_rq[41]:/
Mar 21 10:27:33 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:33 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:33 fir-io1-s1 kernel:
Mar 21 10:27:33 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:33 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:33 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:33 fir-io1-s1 kernel: systemd 1 143207879.508738 1009109 120 0.000000 145697.198324 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: watchdog/41 216 -11.982406 884254 0 0.000000 7772.661246 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: migration/41 217 0.000000 19861 0 0.000000 5405.355429 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ksoftirqd/41 218 143207865.333739 32461392 120 0.000000 529128.448780 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kworker/41:0H 220 12262.658693 9 100 0.000000 0.045107 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kworker/41:2 13932 143207884.960858 4829653 120 0.000000 85892.799818 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kworker/41:1H 26980 143207865.366372 63631808 100 0.000000 417273.756189 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kvm-irqfd-clean 35293 16309.503265 2 100 0.000000 0.012403 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kdmwork-253:38 46126 42395.335051 111 120 0.000000 1.521749 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: bioset 57474 26483.277210 2 100 0.000000 0.008306 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kdmflush 58854 28746.627060 2 100 0.000000 0.008505 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: bioset 58855 28758.634082 2 100 0.000000 0.007604 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_015 96256 143207898.302253 398856216 120 0.000000 12384784.179841 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_024 96286 143207574.851433 309747098 120 0.000000 9977735.328909 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_027 96326 143207798.965867 322844999 120 0.000000 10685605.989050 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_040 96362 143207803.723344 366049678 120 0.000000 11666492.183430 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_044 96366 143207807.449033 458696992 120 0.000000 13831871.235478 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_046 96369 143207895.249418 373125334 120 0.000000 11776517.282775 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_049 96375 143207784.900917 423213447 120 0.000000 13181881.165363 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_059 96515 143207729.750092 393839056 120 0.000000 12360932.838056 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_067 96583 143207303.070262 399512728 120 0.000000 12494573.639804 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_076 96783 143207346.260084 365899918 120 0.000000 11602224.614514 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_083 96894 143207902.483455 381088427 120 0.000000 12219147.066728 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_084 96895 143207889.590488 406526087 120 0.000000 12802699.134220 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_085 96897 143207341.431777 365709674 120 0.000000 11459848.066120 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_089 96906 143207431.709407 437190367 120 0.000000 13499838.611771 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_106 96934 143207779.812272 428965384 120 0.000000 13245081.907053 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_107 96939 143207720.274251 442969817 120 0.000000 13765722.424271 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ll_ost01_108 96940 143207728.502916 386333406 120 0.000000 12259178.332000 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ldlm_cn01_013 117028 143207886.548696 69904657 120 0.000000 1877150.296082 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ldlm_cn01_024 117092 142627939.124221 59114904 120 0.000000 1649258.213579 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ldlm_cn01_028 117096 143207891.889628 63711311 120 0.000000 1749684.721462 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: ldlm_cn01_029 117136 143207890.484677 65153256 120 0.000000 1762625.235230 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kworker/41:1 29081 118933284.722149 2 120 0.000000 0.010290 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel: kworker/u258:0 9744 143204596.530639 8863 120 0.000000 514.613978 0.000000 1 /
Mar 21 10:27:33 fir-io1-s1 kernel:
Mar 21 10:27:33 fir-io1-s1 kernel: cpu#42, 1996.172 MHz
Mar 21 10:27:33 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .nr_switches : 12129947505
Mar 21 10:27:33 fir-io1-s1 kernel: .nr_load_updates : 1579985647
Mar 21 10:27:33 fir-io1-s1 kernel: .nr_uninterruptible : 257045
Mar 21 10:27:33 fir-io1-s1 kernel: .next_balance : 7831.671513
Mar 21 10:27:33 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .clock : 3537141671.147459
Mar 21 10:27:33 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:33 fir-io1-s1 kernel: .cpu_load[3] : 85
Mar 21 10:27:33 fir-io1-s1 kernel: .cpu_load[4] : 36
Mar 21 10:27:33 fir-io1-s1 kernel: .avg_idle : 2300227
Mar 21 10:27:33 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:33 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: cfs_rq[42]:/
Mar 21 10:27:34 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:34 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:34 fir-io1-s1 kernel: .min_vruntime : 95700133.201960
Mar 21 10:27:34 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:34 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:34 fir-io1-s1 kernel: .spread0 : -22185859.061191
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:34 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .avg->runnable_avg_sum : 91
Mar 21 10:27:34 fir-io1-s1 kernel: .avg->runnable_avg_period : 47277
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: rt_rq[42]:/
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:34 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:34 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:34 fir-io1-s1 kernel: watchdog/42 221 -11.986765 884253 0 0.000000 8181.934213 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: migration/42 222 0.000000 20743 0 0.000000 8624.039674 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ksoftirqd/42 223 95700088.997733 32914750 120 0.000000 517854.825251 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/42:0H 225 9704.266256 9 100 0.000000 0.049835 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/42:1H 26979 95700088.978928 52489616 100 0.000000 345613.950209 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmwork-253:4 42472 39960.141544 120 120 0.000000 2.053656 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmwork-253:24 45954 39960.139604 118 120 0.000000 1.609148 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 47903 18526.369046 2 100 0.000000 0.007776 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 56282 23260.953164 2 100 0.000000 0.009598 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 57497 24142.775278 2 100 0.000000 0.010330 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 57498 24154.784056 2 100 0.000000 0.009498 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 58311 25703.439309 2 100 0.000000 0.010419 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 58627 26331.889327 2 100 0.000000 0.010519 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 59274 27770.512052 2 100 0.000000 0.013086 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 59276 27784.414187 2 100 0.000000 0.009619 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmwork-253:109 59277 39960.145316 106 120 0.000000 0.970519 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: polkitd 71330 39599.956642 1 120 0.000000 0.051458 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: reader#3 72477 95700117.609100 416226 120 0.000000 111412.228377 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ptlrpcd_02_06 91459 95700114.938703 517341 120 0.000000 12601.104133 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_002 94243 95700056.582888 286491203 120 0.000000 9923100.614816 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_004 94514 95700056.377038 346839808 120 0.000000 11815916.525353 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_008 94931 95700132.422931 329204383 120 0.000000 11211958.275909 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_011 96250 95700081.977495 427190255 120 0.000000 14039572.343428 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_018 96278 95700056.544483 284561036 120 0.000000 9895708.764726 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_019 96279 95700056.854614 317457476 120 0.000000 11046462.206588 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_005 96297 95699638.404026 17217448 120 0.000000 1999300.781245 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn02_005 96324 95124043.057699 38424661 120 0.000000 1176582.190753 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_027 96374 95700039.987715 369773185 120 0.000000 12273024.311816 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_017 96382 95699767.946071 29789193 120 0.000000 3208147.302306 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_032 96466 95699801.924353 31052557 120 0.000000 3635927.730006 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_033 96467 95699715.892839 33011345 120 0.000000 2265582.575775 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_039 96489 95699650.818769 31232367 120 0.000000 3225051.172545 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_040 96492 95699692.212509 32756439 120 0.000000 3803616.323901 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_043 96502 95699798.972006 29389752 120 0.000000 3486301.895590 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_053 96585 95699680.119978 2912011 120 0.000000 237513.494920 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_068 96646 95699771.849372 18324397 120 0.000000 1341838.969006 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_058 96935 95700079.577071 258227074 120 0.000000 8965649.143926 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn02_017 117140 95124043.058771 49539101 120 0.000000 1473642.402371 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn02_018 117141 93935291.256262 29558453 120 0.000000 942188.846730 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_080 73117 95699750.391927 27594465 120 0.000000 3140434.073343 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_082 73119 95699702.875505 33428985 120 0.000000 3640550.655088 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_create02 79223 92437668.501385 780442 120 0.000000 15662.076826 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/42:2 93281 95700116.904431 3180889 120 0.000000 56762.069982 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_078 74743 95700096.176100 266289990 120 0.000000 8508286.008019 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_085 74751 95700072.816816 199543906 120 0.000000 6684596.996774 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_089 74799 95700112.552146 258244829 120 0.000000 8426046.886041 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_105 110639 95700052.723377 109981108 120 0.000000 3750325.216385 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost02_109 110700 95700129.760993 166336357 120 0.000000 5350936.255848 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/42:0 93129 79534397.150839 2 120 0.000000 0.009277 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io02_100 31917 95699807.119769 15 120 0.000000 5.078150 0.000000 2 /
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: cpu#43, 1996.172 MHz
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_switches : 12410700962
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_load_updates : 1527245100
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_uninterruptible : 84996
Mar 21 10:27:34 fir-io1-s1 kernel: .next_balance : 7831.672320
Mar 21 10:27:34 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .clock : 3537142478.180821
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .avg_idle : 10000000
Mar 21 10:27:34 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: cfs_rq[43]:/
Mar 21 10:27:34 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:34 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:34 fir-io1-s1 kernel: .min_vruntime : 73515649.782734
Mar 21 10:27:34 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:34 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:34 fir-io1-s1 kernel: .spread0 : -44370342.480417
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:34 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .avg->runnable_avg_sum : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .avg->runnable_avg_period : 46482
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: rt_rq[43]:/
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:34 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:34 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:34 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:34 fir-io1-s1 kernel: watchdog/43 226 -11.987145 884254 0 0.000000 5856.464758 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: migration/43 227 0.000000 15184 0 0.000000 3965.539425 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ksoftirqd/43 228 73515617.090878 14292382 120 0.000000 233318.134764 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/43:0H 230 11979.687449 9 100 0.000000 0.049154 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/43:1 7266 73515637.814925 2408681 120 0.000000 41546.986717 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/43:1H 26975 73515617.075600 34295886 100 0.000000 199795.440977 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 42261 20496.701919 2 100 0.000000 0.011271 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 43409 20958.108130 2 100 0.000000 0.014598 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 48171 23035.040866 2 100 0.000000 0.013085 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 55377 26731.094244 2 100 0.000000 0.010299 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 55516 26800.871536 2 100 0.000000 0.011402 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 55518 26825.036049 2 100 0.000000 0.008977 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 56470 27494.987566 2 100 0.000000 0.011011 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 56762 27657.442078 2 100 0.000000 0.012023 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmwork-253:67 57024 45180.733718 133 120 0.000000 1.974911 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: bioset 59375 32123.648920 2 100 0.000000 0.011743 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kdmflush 59958 32978.226244 2 100 0.000000 0.009818 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ptlrpcd_03_08 91473 5028015.684323 13 120 0.000000 0.193443 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ptlrpcd_03_11 91476 5028015.712817 11 120 0.000000 0.158162 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io03_024 96525 73514666.649232 27104629 120 0.000000 2720570.642452 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost_io03_040 96664 73514668.106233 32629517 120 0.000000 3125391.537507 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_018 96777 73515569.132074 272984831 120 0.000000 7833253.393654 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_020 96790 73515568.696918 280186604 120 0.000000 8017704.390684 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_023 97126 73515565.037724 294257678 120 0.000000 8389311.273274 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_030 97133 73515637.908114 204910549 120 0.000000 6079068.526981 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn03_004 101264 73514544.388895 28952326 120 0.000000 763912.868821 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn03_007 6146 73514544.389216 37109665 120 0.000000 930714.399407 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn03_009 56012 73514544.390237 34616163 120 0.000000 872649.028315 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_039 1163 73515643.391602 286700747 120 0.000000 8214439.176635 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_044 74693 73515648.253654 200098061 120 0.000000 5665573.659858 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_064 109958 73515610.077345 54867505 120 0.000000 1674124.663688 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ll_ost03_098 111261 73515570.675971 51311738 120 0.000000 1412264.077851 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: ldlm_cn03_030 98944 73512382.221059 18619213 120 0.000000 527273.539587 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: md6_resync 14512 73515491.239298 160232796 125 0.000000 13167599.242922 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel: kworker/43:0 65175 65694054.244712 2 120 0.000000 0.008736 0.000000 3 /
Mar 21 10:27:34 fir-io1-s1 kernel:
Mar 21 10:27:34 fir-io1-s1 kernel: cpu#44, 1996.172 MHz
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_switches : 20676687855
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_load_updates : 1794655080
Mar 21 10:27:34 fir-io1-s1 kernel: .nr_uninterruptible : -2396581
Mar 21 10:27:34 fir-io1-s1 kernel: .next_balance : 7831.672955
Mar 21 10:27:34 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .clock : 3537143115.207129
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:34 fir-io1-s1 kernel: .avg_idle : 1831535
Mar 21 10:27:34 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:35 fir-io1-s1 kernel:
Mar 21 10:27:35 fir-io1-s1 kernel: cfs_rq[44]:/
Mar 21 10:27:35 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:35 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:35 fir-io1-s1 kernel: .min_vruntime : 127509704.811987
Mar 21 10:27:35 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:35 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:35 fir-io1-s1 kernel: .spread0 : 9623712.437076
Mar 21 10:27:35 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:35 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .avg->runnable_avg_sum : 68
Mar 21 10:27:35 fir-io1-s1 kernel: .avg->runnable_avg_period : 46514
Mar 21 10:27:35 fir-io1-s1 kernel:
Mar 21 10:27:35 fir-io1-s1 kernel: rt_rq[44]:/
Mar 21 10:27:35 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:35 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:35 fir-io1-s1 kernel:
Mar 21 10:27:35 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:35 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:35 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:35 fir-io1-s1 kernel: watchdog/44 231 -11.988087 884254 0 0.000000 7709.633305 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: migration/44 232 0.000000 22489 0 0.000000 20139.126999 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ksoftirqd/44 233 127509033.455286 144123007 120 0.000000 1659610.918290 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kworker/44:0H 235 4096.022575 9 100 0.000000 0.037500 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: mlx5_cmd_0000:8 7339 1823.008395 2 100 0.000000 0.010851 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kworker/44:1H 14454 127509033.437506 503289192 100 0.000000 2822698.300502 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ccp-6-q0 34334 14983.042595 2 120 0.000000 0.010630 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ccp-6-q1 34335 14995.050353 2 120 0.000000 0.007764 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ccp-6-q2 34336 15007.058163 2 120 0.000000 0.007816 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ccp-6-q3 34337 15019.065311 2 120 0.000000 0.007154 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ccp-6-q4 34338 15031.072298 2 120 0.000000 0.006993 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: bioset 45302 18724.448283 2 100 0.000000 0.010680 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kdmflush 55244 23913.682790 2 100 0.000000 0.010560 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: bioset 55255 23940.218312 2 100 0.000000 0.018365 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: bioset 57599 26024.996770 2 100 0.000000 0.010691 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kdmflush 58066 26629.466923 2 100 0.000000 0.010631 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kdmflush 58358 27311.700314 2 100 0.000000 0.011632 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: bioset 61781 32116.416820 2 100 0.000000 0.009949 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: gssproxy 71323 42762.625993 1 120 0.000000 0.017484 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: gssproxy 71326 42774.632599 1 120 0.000000 0.006612 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: reader#4 72479 42902.925212 1 120 0.000000 0.023214 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_cfg_requeue 94225 120926633.187495 1518 120 0.000000 54.218004 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_017 96271 127509693.565295 291905249 120 0.000000 9117659.118079 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_018 96273 127482606.621047 278955186 120 0.000000 8689407.549555 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_create00 96285 120564403.432391 41018 120 0.000000 476.582062 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_025 96335 127509692.836663 376276221 120 0.000000 11205916.027699 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_015 96348 127508813.463373 8433058 120 0.000000 719677.644789 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_018 96381 127508964.069427 39585844 120 0.000000 4421400.828634 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_019 96384 127508970.084607 9147773 120 0.000000 1006771.986889 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_024 96398 127508824.299545 33716778 120 0.000000 4184667.901657 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_026 96401 127508970.190880 22805174 120 0.000000 3388266.148961 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_028 96415 127508934.238825 11345856 120 0.000000 1092684.826014 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_029 96444 127508636.546273 18784838 120 0.000000 2207733.695073 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_037 96530 127508955.574828 23323011 120 0.000000 2889432.497386 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_042 96584 127508641.047813 44928981 120 0.000000 4826287.057113 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_047 96616 127508936.522586 7897978 120 0.000000 912094.354534 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_055 96641 127508891.104121 26806942 120 0.000000 2970475.281075 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_037 96762 127509694.323575 392626393 120 0.000000 11678705.787049 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_039 96764 127482605.342123 291343307 120 0.000000 9015951.703826 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_061 96914 127509209.906651 331912916 120 0.000000 10079457.892366 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ldlm_cn00_016 117135 127504288.577513 39880562 120 0.000000 1121715.677304 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_064 73059 127508970.232120 15746590 120 0.000000 1887513.734694 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_067 73071 127508887.238314 13476205 120 0.000000 1079842.071688 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_072 73076 127508644.607252 16640568 120 0.000000 1175544.097750 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_090 73283 127508954.532634 30235034 120 0.000000 3297157.676656 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ldlm_cn00_022 84119 127003140.249912 48337779 120 0.000000 1327299.058086 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_093 110572 122347891.444443 117409007 120 0.000000 3712383.813050 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_098 110617 127509010.020448 172544480 120 0.000000 5258006.622265 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_103 110656 127509704.051487 115192897 120 0.000000 3678425.321026 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost00_106 110659 127509324.033750 183595173 120 0.000000 5193400.989593 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_098 36888 127508928.204622 5730637 120 0.000000 461808.367639 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_102 36892 127508663.158033 7407808 120 0.000000 475641.288548 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: ll_ost_io00_104 36894 127508682.646985 3402872 120 0.000000 287399.929422 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kworker/44:2 57245 127509641.981595 145368 120 0.000000 2199.481916 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kworker/44:1 50190 127317395.462831 2 120 0.000000 0.008357 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel: kworker/u257:0 800 127502900.446584 3026 120 0.000000 181.916364 0.000000 0 /
Mar 21 10:27:35 fir-io1-s1 kernel:
Mar 21 10:27:35 fir-io1-s1 kernel: cpu#45, 1996.172 MHz
Mar 21 10:27:35 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .nr_switches : 22943099338
Mar 21 10:27:35 fir-io1-s1 kernel: .nr_load_updates : 1873353932
Mar 21 10:27:35 fir-io1-s1 kernel: .nr_uninterruptible : 259928
Mar 21 10:27:35 fir-io1-s1 kernel: .next_balance : 7831.673833
Mar 21 10:27:35 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .clock : 3537143990.236646
Mar 21 10:27:35 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:35 fir-io1-s1 kernel: .cpu_load[2] : 147
Mar 21 10:27:35 fir-io1-s1 kernel: .cpu_load[3] : 64
Mar 21 10:27:35 fir-io1-s1 kernel: .cpu_load[4] : 60
Mar 21 10:27:35 fir-io1-s1 kernel: .avg_idle : 393971
Mar 21 10:27:35 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:35 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: cfs_rq[45]:/
Mar 21 10:27:36 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:36 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:36 fir-io1-s1 kernel: .min_vruntime : 131240208.840078
Mar 21 10:27:36 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:36 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:36 fir-io1-s1 kernel: .spread0 : 13354215.435991
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .blocked_load_avg : 7
Mar 21 10:27:36 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:36 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .avg->runnable_avg_sum : 208
Mar 21 10:27:36 fir-io1-s1 kernel: .avg->runnable_avg_period : 46562
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: rt_rq[45]:/
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:36 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:36 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:36 fir-io1-s1 kernel: watchdog/45 236 -11.986013 884254 0 0.000000 8839.372500 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: migration/45 237 0.000000 17411 0 0.000000 6624.271475 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ksoftirqd/45 238 131239033.120519 34951832 120 0.000000 580784.600612 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/45:0H 240 12119.713064 9 100 0.000000 0.044565 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: scsi_eh_0 1956 484.797842 2 120 0.000000 0.011383 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: scsi_tmf_0 1957 496.807040 2 100 0.000000 0.009899 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kmpathd 18898 5997.198461 2 100 0.000000 0.012093 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kmpath_handlerd 18899 6009.207971 2 100 0.000000 0.010319 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: multipathd 44810 0.000000 959 0 0.000000 79.503596 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: multipathd 44973 0.000000 922 0 0.000000 77.552749 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: multipathd 59131 0.000000 982 0 0.000000 80.168651 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/45:1H 26976 131239225.555614 70882421 100 0.000000 469285.533657 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ccp-2-q3 33906 16597.495690 2 120 0.000000 0.021691 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ccp-2-q4 33907 16605.505517 2 120 0.000000 0.009829 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 43668 19775.358525 2 100 0.000000 0.009959 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: bioset 58771 28689.092689 2 100 0.000000 0.007736 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 58879 28923.382724 2 100 0.000000 0.010349 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kiblnd_sd_01_02 91384 131240209.276693 21911237687 120 0.000000 244372524.282471 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost01_003 94315 131239828.186267 409335277 120 0.000000 12759913.434505 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost01_058 96491 131240174.756565 419351372 120 0.000000 13151251.786920 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost_io01_096 96678 131238582.324754 17698912 120 0.000000 1930103.754178 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost01_086 96898 131240174.988038 382060908 120 0.000000 12272336.110729 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/45:2 127544 131240147.835839 3575253 120 0.000000 52321.093843 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/45:1 127149 125133264.162760 2 120 0.000000 0.010149 0.000000 1 /
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: cpu#46, 1996.172 MHz
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_switches : 10099057596
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_load_updates : 1547945585
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_uninterruptible : 295756
Mar 21 10:27:36 fir-io1-s1 kernel: .next_balance : 7831.674346
Mar 21 10:27:36 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .clock : 3537144502.259508
Mar 21 10:27:36 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .cpu_load[1] : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .cpu_load[2] : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .cpu_load[3] : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .cpu_load[4] : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .avg_idle : 3056081
Mar 21 10:27:36 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: cfs_rq[46]:/
Mar 21 10:27:36 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:36 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:36 fir-io1-s1 kernel: .min_vruntime : 103468888.066960
Mar 21 10:27:36 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:36 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:36 fir-io1-s1 kernel: .spread0 : -14417105.337127
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:36 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .avg->runnable_avg_sum : 77
Mar 21 10:27:36 fir-io1-s1 kernel: .avg->runnable_avg_period : 47990
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: rt_rq[46]:/
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:36 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:36 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:36 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:36 fir-io1-s1 kernel: watchdog/46 241 -11.984830 884256 0 0.000000 8578.331735 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: migration/46 242 0.000000 23983 0 0.000000 17379.639850 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ksoftirqd/46 243 103468873.539883 33214926 120 0.000000 527326.369653 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/46:0H 245 18559.804473 9 100 0.000000 0.041689 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: multipathd 18942 103468827.521137 59980 120 0.000000 2186.073230 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 45262 14764.619901 2 100 0.000000 0.012945 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: bioset 45264 14776.628239 2 100 0.000000 0.009059 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 46093 15142.105428 2 100 0.000000 0.010760 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: bioset 46094 15154.112555 2 100 0.000000 0.008016 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmwork-253:35 46095 103468874.561548 306131507 120 0.000000 5267824.057750 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmwork-253:42 46282 103468855.655919 296808342 120 0.000000 5197376.485091 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/46:1H 52920 103468876.067002 56167057 100 0.000000 310621.031435 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 55061 19983.443474 2 100 0.000000 0.010239 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: bioset 57299 21674.588256 2 100 0.000000 0.012082 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmwork-253:71 57336 103468874.068478 203212088 120 0.000000 3912318.849947 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 57421 21786.294899 2 100 0.000000 0.011903 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 57665 22228.448656 2 100 0.000000 0.010429 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 58490 24208.057862 2 100 0.000000 0.011852 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 58518 24235.928157 2 100 0.000000 0.011052 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 58908 25630.464223 2 100 0.000000 0.009558 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: bioset 58909 25642.473520 2 100 0.000000 0.009849 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kdmflush 59038 25787.604715 2 100 0.000000 0.012704 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: reader#0 72474 103468882.839236 4683356 120 0.000000 936363.768813 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ptlrpcd_02_00 91453 103468875.998951 518123 120 0.000000 12775.568958 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: raid5wq 91755 41518.527753 2 100 0.000000 0.012113 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ldlm_bl_02 94223 103468788.141956 2513818 120 0.000000 26574.970095 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_001 94242 103468836.624052 387919252 120 0.000000 12762987.015545 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost_create02 96282 101404019.097228 1593035 120 0.000000 30850.752883 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_022 96328 103468832.235018 292865100 120 0.000000 10132551.835637 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189256.129902
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost_io02_014 96337 103468631.045855 43236142 120 0.000000 3701323.290129 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost_io02_041 96495 103468717.914092 31397617 120 0.000000 3538059.782478 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost_io02_059 96609 103468719.316167 66700879 120 0.000000 6098656.338780 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost_io02_065 96639 103468697.018871 23307480 120 0.000000 2360967.031475 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_048 96758 103468741.840595 374545031 120 0.000000 12589028.070518 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ldlm_bl_06 103800 103468712.649194 2514885 120 0.000000 26599.188991 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ldlm_cn02_009 117022 103468738.499201 50519613 120 0.000000 1470497.531720 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ldlm_cb02_003 5818 20625952.645452 33 120 0.000000 0.974766 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ldlm_cn02_022 78533 103468876.393967 45121605 120 0.000000 1348936.615642 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ldlm_cn02_027 116388 103468798.651639 40361675 120 0.000000 1241037.148767 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_081 74747 103468873.038918 180881118 120 0.000000 6236505.768298 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_101 110635 103468798.560772 147154119 120 0.000000 4746216.256769 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_106 110640 103468885.693121 161715870 120 0.000000 5157562.137775 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: ll_ost02_110 110701 103468862.021587 117260474 120 0.000000 3954625.610333 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/46:0 104134 103468876.073092 121042 120 0.000000 1732.670887 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel: kworker/46:2 59861 103324897.685322 2 120 0.000000 0.009619 0.000000 2 /
Mar 21 10:27:36 fir-io1-s1 kernel:
Mar 21 10:27:36 fir-io1-s1 kernel: cpu#47, 1996.172 MHz
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_switches : 11336375537
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_load_updates : 1452450549
Mar 21 10:27:36 fir-io1-s1 kernel: .nr_uninterruptible : 96949
Mar 21 10:27:36 fir-io1-s1 kernel: .next_balance : 7831.675102
Mar 21 10:27:36 fir-io1-s1 kernel: .curr->pid : 0
Mar 21 10:27:36 fir-io1-s1 kernel: .clock : 3537145260.287694
Mar 21 10:27:37 fir-io1-s1 kernel: .cpu_load[0] : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .cpu_load[1] : 256
Mar 21 10:27:37 fir-io1-s1 kernel: .cpu_load[2] : 45
Mar 21 10:27:37 fir-io1-s1 kernel: .cpu_load[3] : 31
Mar 21 10:27:37 fir-io1-s1 kernel: .cpu_load[4] : 20
Mar 21 10:27:37 fir-io1-s1 kernel: .avg_idle : 2969763
Mar 21 10:27:37 fir-io1-s1 kernel: .max_idle_balance_cost : 5000000
Mar 21 10:27:37 fir-io1-s1 kernel:
Mar 21 10:27:37 fir-io1-s1 kernel: cfs_rq[47]:/
Mar 21 10:27:37 fir-io1-s1 kernel: .exec_clock : 0.000000
Mar 21 10:27:37 fir-io1-s1 kernel: .MIN_vruntime : 0.000001
Mar 21 10:27:37 fir-io1-s1 kernel: .min_vruntime : 72018572.568988
Mar 21 10:27:37 fir-io1-s1 kernel: .max_vruntime : 0.000001
Mar 21 10:27:37 fir-io1-s1 kernel: .spread : 0.000000
Mar 21 10:27:37 fir-io1-s1 kernel: .spread0 : -45867420.835099
Mar 21 10:27:37 fir-io1-s1 kernel: .nr_spread_over : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .nr_running : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .load : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .runnable_load_avg : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .blocked_load_avg : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .tg_load_avg : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .tg_load_contrib : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .tg_runnable_contrib : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .tg->runnable_avg : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .tg->cfs_bandwidth.timer_active: 0
Mar 21 10:27:37 fir-io1-s1 kernel: .throttled : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .throttle_count : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .avg->runnable_avg_sum : 39
Mar 21 10:27:37 fir-io1-s1 kernel: .avg->runnable_avg_period : 46408
Mar 21 10:27:37 fir-io1-s1 kernel:
Mar 21 10:27:37 fir-io1-s1 kernel: rt_rq[47]:/
Mar 21 10:27:37 fir-io1-s1 kernel: .rt_nr_running : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .rt_throttled : 0
Mar 21 10:27:37 fir-io1-s1 kernel: .rt_time : 0.000000
Mar 21 10:27:37 fir-io1-s1 kernel: .rt_runtime : 950.000000
Mar 21 10:27:37 fir-io1-s1 kernel:
Mar 21 10:27:37 fir-io1-s1 kernel: runnable tasks:
Mar 21 10:27:37 fir-io1-s1 kernel: task PID tree-key switches prio wait-time sum-exec sum-sleep
Mar 21 10:27:37 fir-io1-s1 kernel: ----------------------------------------------------------------------------------------------------------
Mar 21 10:27:37 fir-io1-s1 kernel: watchdog/47 246 -11.986524 884254 0 0.000000 6256.299457 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: migration/47 247 0.000000 15688 0 0.000000 5441.169195 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ksoftirqd/47 248 72018230.874368 16082321 120 0.000000 255173.316681 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kworker/47:0H 250 13104.624561 9 100 0.000000 0.047260 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kworker/47:1 7269 72018560.902351 5904500 120 0.000000 109699.929609 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kworker/47:1H 26977 72018230.864461 37469705 100 0.000000 216335.275692 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: bioset 45360 19945.079367 2 100 0.000000 0.011031 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kdmwork-253:31 46054 43703.181409 107 120 0.000000 1.549006 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kdmflush 55376 25290.822326 2 100 0.000000 0.011041 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kdmflush 58274 28195.447856 2 100 0.000000 0.009989 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: bioset 58276 28203.456040 2 100 0.000000 0.009158 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: auditd 71259 72018553.150055 474820 116 0.000000 15367.579470 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: bioset 92090 44318.047735 2 100 0.000000 0.010980 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: bioset 92527 44887.973807 2 100 0.000000 0.016311 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: bioset 92528 44899.982494 2 100 0.000000 0.009199 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_002 94246 64134727.819840 270469853 120 0.000000 7771042.876930 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost_io03_039 96660 72018070.514068 41748108 120 0.000000 4026435.101993 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_022 96950 64134046.926327 235138638 120 0.000000 6929232.083995 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_050 113338 66774192.791649 40630733 120 0.000000 1251567.342411 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_062 109956 72018568.771426 105796874 120 0.000000 2900359.047103 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_073 109973 64134729.334969 59310055 120 0.000000 1748776.221557 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_075 109985 64134727.820131 112596908 120 0.000000 3098271.762571 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_079 109999 66774193.087112 100361116 120 0.000000 2770583.674379 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_085 110600 72018461.908401 91946115 120 0.000000 2536558.663607 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_087 110602 64134728.721709 68127283 120 0.000000 1953256.834319 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_103 111282 72018566.725655 36257274 120 0.000000 1204933.730958 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost03_107 111286 64134727.819971 86943336 120 0.000000 2378115.308855 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: ll_ost_io03_060 120699 72018243.217915 7670 120 0.000000 1199.262450 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel: kworker/47:0 101150 71484740.045311 2 120 0.000000 0.008958 0.000000 3 /
Mar 21 10:27:37 fir-io1-s1 kernel:
Mar 21 10:27:40 fir-io1-s1 kernel: INFO: rcu_sched self-detected stall on CPU
Mar 21 10:27:40 fir-io1-s1 kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Mar 21 10:27:40 fir-io1-s1 kernel: {
Mar 21 10:27:40 fir-io1-s1 kernel: 2
Mar 21 10:27:40 fir-io1-s1 kernel: }
Mar 21 10:27:40 fir-io1-s1 kernel: (detected by 21, t=0 jiffies, g=516612362, c=516612361, q=1085125)
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 0:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/0 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 0 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769ca6>] ? native_safe_halt+0x6/0x10
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8574ff37>] ? rest_init+0x77/0x80
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85d861c6>] ? start_kernel+0x44b/0x46c
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85d85b7b>] ? repair_env_string+0x5c/0x5c
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85d85120>] ? early_idt_handler_array+0x120/0x120
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85d8572f>] ? x86_64_start_reservations+0x24/0x26
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85d85885>] ? x86_64_start_kernel+0x154/0x177
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 1:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/1 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 2:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/2 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769ca6>] ? native_safe_halt+0x6/0x10
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 3:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/3 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 4:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/4 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 5:
Mar 21 10:27:40 fir-io1-s1 kernel: ll_ost01_065 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 96572 2 0x00000080
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0e4235a>] ? tgt_request_handle+0xaea/0x1580 [ptlrpc]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0e1ba51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0a1dbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0de692b>] ? ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0de37b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850d67c2>] ? default_wake_function+0x12/0x20
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850cba9b>] ? __wake_up_common+0x5b/0x90
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0dea25c>] ? ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffffc0de9760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c1c31>] ? kthread+0xd1/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85774c24>] ? ret_from_fork_nospec_begin+0xe/0x21
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c1b60>] ? insert_kthread_work+0x40/0x40
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 6:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/6 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 7:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/7 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 8:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/8 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 9:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/9 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 10:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/10 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 11:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/11 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 12:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/12 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 13:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/13 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 14:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/14 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 15:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/15 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 16:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/16 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 17:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/17 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 18:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/18 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 19:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/19 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 20:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/20 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 21:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/21 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000008
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: <IRQ>
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850d5d88>] sched_show_task+0xa8/0x110
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850d9c09>] dump_cpu_task+0x39/0x70
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff851528c0>] rcu_dump_cpu_stacks+0x90/0xd0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85156212>] rcu_check_callbacks+0x6f2/0x730
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510ae40>] ? tick_sched_do_timer+0x50/0x50
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850ab136>] update_process_times+0x46/0x80
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510abb0>] tick_sched_handle+0x30/0x70
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510ae79>] tick_sched_timer+0x39/0x80
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c5f93>] __hrtimer_run_queues+0xf3/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c651f>] hrtimer_interrupt+0xaf/0x1d0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8505a2cb>] local_apic_timer_interrupt+0x3b/0x60
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff857796c3>] smp_apic_timer_interrupt+0x43/0x60
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85775df2>] apic_timer_interrupt+0x162/0x170
Mar 21 10:27:40 fir-io1-s1 kernel: <EOI>
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769ca6>] ? native_safe_halt+0x6/0x10
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 22:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/22 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 23:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/23 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 24:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/24 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 25:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/25 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 26:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/26 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 27:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/27 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 28:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/28 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 29:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/29 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 30:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/30 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 31:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/31 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 32:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/32 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 33:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/33 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 34:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/34 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 35:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/35 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 36:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/36 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 37:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/37 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 38:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/38 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 39:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/39 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 40:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/40 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 41:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/41 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 42:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/42 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 43:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/43 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 44:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/44 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 45:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/45 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510afcc>] ? tick_nohz_stop_sched_tick+0x7c/0x380
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 46:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/46 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 47:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/47 R
Mar 21 10:27:40 fir-io1-s1 kernel: running task
Mar 21 10:27:40 fir-io1-s1 kernel: 0 0 1 0x00000000
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85152a8d>] ? rcu_eqs_enter_common.isra.30+0x3d/0xe0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] ? default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] ? arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] ? cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] ? start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] ? start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: LustreError: dumping log to /tmp/lustre-log.1553189258.129913
Mar 21 10:27:40 fir-io1-s1 kernel: {
Mar 21 10:27:40 fir-io1-s1 kernel: 2} (t=2869 jiffies g=516612362 c=516612361 q=1218674)
Mar 21 10:27:40 fir-io1-s1 kernel: Task dump for CPU 2:
Mar 21 10:27:40 fir-io1-s1 kernel: swapper/2 R running task 0 0 1 0x00000008
Mar 21 10:27:40 fir-io1-s1 kernel: Call Trace:
Mar 21 10:27:40 fir-io1-s1 kernel: <IRQ> [<ffffffff850d5d88>] sched_show_task+0xa8/0x110
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850d9c09>] dump_cpu_task+0x39/0x70
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff851528c0>] rcu_dump_cpu_stacks+0x90/0xd0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85155f62>] rcu_check_callbacks+0x442/0x730
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff857795e6>] ? do_IRQ+0x56/0xf0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510ae40>] ? tick_sched_do_timer+0x50/0x50
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850ab136>] update_process_times+0x46/0x80
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510abb0>] tick_sched_handle+0x30/0x70
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8510ae79>] tick_sched_timer+0x39/0x80
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c5f93>] __hrtimer_run_queues+0xf3/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850c651f>] hrtimer_interrupt+0xaf/0x1d0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff8505a2cb>] local_apic_timer_interrupt+0x3b/0x60
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff857796c3>] smp_apic_timer_interrupt+0x43/0x60
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85775df2>] apic_timer_interrupt+0x162/0x170
Mar 21 10:27:40 fir-io1-s1 kernel: <EOI> [<ffffffff85769aa0>] ? __cpuidle_text_start+0x8/0x8
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769ca6>] ? native_safe_halt+0x6/0x10
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85769abe>] default_idle+0x1e/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850366f0>] arch_cpu_idle+0x20/0xc0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850fc49a>] cpu_startup_entry+0x14a/0x1e0
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff85057db7>] start_secondary+0x1f7/0x270
Mar 21 10:27:40 fir-io1-s1 kernel: [<ffffffff850000d5>] start_cpu+0x5/0x14
Mar 21 10:27:40 fir-io1-s1 kernel: LNet: Service thread pid 129913 completed after 202.12s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Mar 21 10:27:40 fir-io1-s1 kernel: Lustre: 96903:0:(service.c:2165:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (100:108s); client may timeout. req@ffff983806022c50 x1628636599812592/t0(0) o8->3052619e-2c8c-4b06-c964-a6941084f511@10.9.102.18@o2ib4:0/0 lens 520/384 e 0 to 0 dl 1553189152 ref 1 fl Complete:/0/0 rc 0/0
Mar 21 10:27:40 fir-io1-s1 kernel: LNet: Skipped 11 previous similar messages
Mar 21 10:27:41 fir-io1-s1 kernel: Lustre: 96499:0:(service.c:2165:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (100:181s); client may timeout. req@ffff98380be39450 x1628636524315088/t0(0) o8->e9eb5572-8516-901c-333e-efaafbfe0b2e@10.8.26.6@o2ib6:0/0 lens 520/384 e 0 to 0 dl 1553189080 ref 1 fl Complete:/0/0 rc 0/0
Mar 21 10:27:41 fir-io1-s1 kernel: Lustre: 96499:0:(service.c:2165:ptlrpc_server_handle_request()) Skipped 2 previous similar messages
Mar 21 10:27:41 fir-io1-s1 kernel: LNet: Service thread pid 96384 completed after 240.78s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Mar 21 10:27:41 fir-io1-s1 kernel: LNet: Skipped 44 previous similar messages
Mar 21 10:27:41 fir-io1-s1 kernel: Lustre: fir-OST000a: haven't heard from client 61b3b634-d14c-38fa-0b06-fc989a21c68f (at 10.9.107.8@o2ib4) in 435 seconds. I think it's dead, and I am evicting it. exp ffff98683bad4000, cur 1553189261 expire 1553188857 last 1553188826
Mar 21 10:27:41 fir-io1-s1 kernel: Lustre: Skipped 151 previous similar messages
Mar 21 10:27:43 fir-io1-s1 kernel: Lustre: fir-OST000a: Client 4485a810-0c4c-dddd-f2ca-2d24839a5904 (at 10.9.105.71@o2ib4) reconnecting
Mar 21 10:27:43 fir-io1-s1 kernel: Lustre: Skipped 1 previous similar message
Mar 21 10:27:44 fir-io1-s1 kernel: LNet: Service thread pid 96595 completed after 290.34s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Mar 21 10:27:44 fir-io1-s1 kernel: LNet: Skipped 50 previous similar messages
Mar 21 10:27:44 fir-io1-s1 kernel: Lustre: 111287:0:(service.c:2165:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (100:53s); client may timeout. req@ffff9869b5594050 x1628636662727184/t0(0) o8->071c4d75-3883-79e2-6ff4-794d858ce05f@10.9.102.17@o2ib4:0/0 lens 520/384 e 0 to 0 dl 1553189211 ref 1 fl Complete:/0/0 rc 0/0
Mar 21 10:27:44 fir-io1-s1 kernel: Lustre: 111287:0:(service.c:2165:ptlrpc_server_handle_request()) Skipped 29 previous similar messages
Mar 21 10:27:45 fir-io1-s1 kernel: LustreError: 96295:0:(service.c:2128:ptlrpc_server_handle_request()) @@@ Dropping timed-out request from 12345-10.8.2.24@o2ib6: deadline 208:33s ago
req@ffff985756582850 x1628574683899296/t0(0) o4->e0d09136-0a0d-4d3c-a8ef-7cfcd4b2ff05@10.8.2.24@o2ib6:212/0 lens 488/0 e 2 to 0 dl 1553189232 ref 1 fl Interpret:/0/ffffffff rc 0/-1
Mar 21 10:27:54 fir-io1-s1 kernel: Lustre: fir-OST0000: Client 7af51858-b0e7-090e-d608-4383a011f590 (at 10.9.105.1@o2ib4) reconnecting
Mar 21 10:27:54 fir-io1-s1 kernel: Lustre: Skipped 19 previous similar messages