Console [warble1] log opened at 2018-04-08 03:38:40 AEST. 2018-04-08 03:47:23 [10410.681476] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 03:47:23 [10410.696026] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 03:57:23 [11009.250623] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 03:57:23 [11009.265194] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 04:00:00 AEST. 2018-04-08 04:07:23 [11607.819323] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 04:07:23 [11607.833902] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 04:17:23 [12206.386954] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 04:17:23 [12206.401532] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 04:27:23 [12804.954479] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 04:27:23 [12804.969067] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 04:37:23 [13403.523229] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 04:37:23 [13403.537783] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 04:47:23 [14002.091269] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 04:47:23 [14002.105863] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 04:57:23 [14600.658709] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 04:57:23 [14600.673290] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 05:00:00 AEST. 2018-04-08 05:07:23 [15199.225822] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 05:07:23 [15199.240416] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 05:17:23 [15797.793743] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 05:17:23 [15797.808320] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 05:27:23 [16396.359733] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 05:27:24 [16396.374288] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 05:37:23 [16994.926531] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 05:37:24 [16994.941116] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 05:47:24 [17593.493163] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 05:47:24 [17593.507748] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 05:57:24 [18192.059777] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 05:57:24 [18192.074363] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 05:59:59 AEST. 2018-04-08 06:07:24 [18790.626132] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 06:07:24 [18790.640678] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 06:17:24 [19389.192930] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 06:17:24 [19389.207483] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 06:27:24 [19987.760673] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 06:27:24 [19987.775225] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 06:37:24 [20586.326951] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 06:37:24 [20586.341536] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 06:47:24 [21184.895254] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 06:47:24 [21184.909826] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 06:57:24 [21783.462227] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 06:57:24 [21783.476807] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 07:00:00 AEST. 2018-04-08 07:07:24 [22382.029492] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 07:07:24 [22382.044067] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 07:17:24 [22980.593697] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 07:17:24 [22980.608282] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 07:27:24 [23579.160223] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 07:27:24 [23579.174768] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 07:37:24 [24177.726212] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 07:37:24 [24177.740795] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 07:47:24 [24776.291543] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 07:47:24 [24776.306035] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 07:57:24 [25374.857255] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 07:57:24 [25374.871749] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 08:00:00 AEST. 2018-04-08 08:07:24 [25973.423028] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 08:07:24 [25973.437535] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 08:17:24 [26571.988789] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 08:17:24 [26572.003290] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 08:27:24 [27170.554095] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 08:27:24 [27170.568594] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 08:37:24 [27769.118778] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 08:37:24 [27769.133265] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 08:47:24 [28367.683544] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 08:47:24 [28367.698055] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 08:57:24 [28966.248966] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 08:57:24 [28966.263466] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 08:59:59 AEST. 2018-04-08 09:07:24 [29564.814100] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 09:07:24 [29564.828600] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 09:17:24 [30163.379704] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 09:17:24 [30163.394213] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 09:27:24 [30761.945841] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 09:27:24 [30761.960334] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 09:37:24 [31360.511178] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 09:37:24 [31360.525699] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 09:47:24 [31959.076757] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 09:47:24 [31959.091253] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 09:57:24 [32557.641750] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 09:57:24 [32557.656256] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 09:59:59 AEST. 2018-04-08 10:07:24 [33156.207574] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 10:07:24 [33156.222089] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 10:17:24 [33754.773305] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 10:17:24 [33754.787832] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 10:27:24 [34353.339018] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 10:27:24 [34353.353527] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 10:37:24 [34951.904904] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 10:37:24 [34951.919421] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 10:47:24 [35550.470821] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 10:47:24 [35550.485328] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 10:57:24 [36149.037251] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 10:57:24 [36149.051776] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 11:00:00 AEST. 2018-04-08 11:07:24 [36747.603435] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 11:07:24 [36747.617943] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 11:17:24 [37346.170406] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 11:17:24 [37346.184921] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 11:27:24 [37944.737137] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 11:27:24 [37944.751655] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 11:37:24 [38543.303603] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 11:37:24 [38543.318110] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 11:47:24 [39141.870559] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 11:47:24 [39141.885054] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 11:57:24 [39740.436602] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 11:57:24 [39740.451107] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 12:00:00 AEST. 2018-04-08 12:07:24 [40339.003752] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 12:07:24 [40339.018272] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 12:17:24 [40937.570620] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 12:17:24 [40937.585142] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 12:27:25 [41536.137706] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 12:27:25 [41536.152217] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 12:37:25 [42134.704856] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 12:37:25 [42134.719376] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 12:47:25 [42733.271755] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 12:47:25 [42733.286262] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 12:57:25 [43331.838943] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 12:57:25 [43331.853465] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Console [warble1] log at 2018-04-08 13:00:00 AEST. 2018-04-08 13:07:25 [43930.405784] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 13:07:25 [43930.420291] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 13:17:25 [44528.972844] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 13:17:25 [44528.987361] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages 2018-04-08 13:18:36 [44600.193483] SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) 2018-04-08 13:19:27 [44651.011962] SysRq : Show backtrace of all active CPUs 2018-04-08 13:19:27 [44651.017916] sending NMI to all CPUs: 2018-04-08 13:19:27 [44651.024574] NMI backtrace for cpu 0 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.032396] NMI backtrace for cpu 1 2018-04-08 13:19:27 [44651.036655] CPU: 1 PID: 1 Comm: systemd Tainted: P OE ------------ 3.10.0-693.17.1.el7.x86_64 #1 2018-04-08 13:19:27 [44651.047315] Hardware name: Dell Inc. PowerEdge R740/0JM3W2, BIOS 1.3.7 02/08/2018 2018-04-08 13:19:27 [44651.055556] task: ffff88606efd8000 ti: ffff88012e900000 task.ti: ffff88012e900000 2018-04-08 13:19:27 [44651.063787] RIP: 0033:[<00007f6715885240>] [<00007f6715885240>] 0x7f671588523f 2018-04-08 13:19:27 [44651.071839] RSP: 002b:00007ffcbad21528 EFLAGS: 00000246 2018-04-08 13:19:27 [44651.077904] RAX: 00007ffcbad215a3 RBX: 0000000000000007 RCX: 0000000000000000 2018-04-08 13:19:27 [44651.085772] RDX: 0000000000000007 RSI: 00005558d4f86e74 RDI: 00007ffcbad215a3 2018-04-08 13:19:27 [44651.093632] RBP: 00007ffcbad21de0 R08: 0000000000000007 R09: 0000000000000000 2018-04-08 13:19:27 [44651.101490] R10: 00000000000000ae R11: 0000000000000000 R12: 00007ffcbad21590 2018-04-08 13:19:27 [44651.109336] R13: 00007ffcbad21598 R14: 000000000000000c R15: 00007ffcbad215a3 2018-04-08 13:19:27 [44651.117174] FS: 00007f6716fea940(0000) GS:ffff88bebbe00000(0000) knlGS:0000000000000000 2018-04-08 13:19:27 [44651.125958] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 2018-04-08 13:19:27 [44651.132399] CR2: 00007f6716ffb000 CR3: 000000bebd57e000 CR4: 00000000003607e0 2018-04-08 13:19:27 [44651.140219] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 2018-04-08 13:19:27 [44651.148040] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 2018-04-08 13:19:27 [44651.155846] 2018-04-08 13:19:27 [44651.158012] NMI backtrace for cpu 2 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.165725] NMI backtrace for cpu 3 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.173418] NMI backtrace for cpu 4 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.181095] NMI backtrace for cpu 5 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.188762] NMI backtrace for cpu 6 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.196413] NMI backtrace for cpu 7 2018-04-08 13:19:27 [44651.200508] CPU: 7 PID: 24023 Comm: mdt_out01_001 Tainted: P OE ------------ 3.10.0-693.17.1.el7.x86_64 #1 2018-04-08 13:19:27 [44651.211876] Hardware name: Dell Inc. PowerEdge R740/0JM3W2, BIOS 1.3.7 02/08/2018 2018-04-08 13:19:27 [44651.219952] task: ffff88be65bceeb0 ti: ffff88bd9203c000 task.ti: ffff88bd9203c000 2018-04-08 13:19:27 [44651.228019] RIP: 0010:[] [] mutex_unlock+0x14/0x20 2018-04-08 13:19:27 [44651.236608] RSP: 0018:ffff88bd9203f910 EFLAGS: 00000202 2018-04-08 13:19:27 [44651.242509] RAX: 0000000000000000 RBX: ffff885e5e5a4038 RCX: ffff88bd9203ffd8 2018-04-08 13:19:27 [44651.250218] RDX: 0000000000000001 RSI: ffff885e5e2fa0d0 RDI: ffff885e5e5a4010 2018-04-08 13:19:27 [44651.257926] RBP: ffff88bd9203f910 R08: 00006041408025f0 R09: ffffffffc04a3545 2018-04-08 13:19:27 [44651.265627] R10: ffffe8fffc6c25f0 R11: ffffea0179886c00 R12: ffff885e5e5a4010 2018-04-08 13:19:27 [44651.273311] R13: 0000000000000000 R14: 0000000000000002 R15: ffff88be933976f0 2018-04-08 13:19:27 [44651.280996] FS: 0000000000000000(0000) GS:ffff88bebbec0000(0000) knlGS:0000000000000000 2018-04-08 13:19:27 [44651.289626] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 2018-04-08 13:19:27 [44651.295909] CR2: 00007fee7c8f84f0 CR3: 00000000019fa000 CR4: 00000000003607e0 2018-04-08 13:19:27 [44651.303581] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 2018-04-08 13:19:27 [44651.311236] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 2018-04-08 13:19:27 [44651.318884] Call Trace: 2018-04-08 13:19:27 [44651.321848] [] arc_released+0x65/0x90 [zfs] 2018-04-08 13:19:27 [44651.328189] [] dbuf_rele_and_unlock+0x97/0x4b0 [zfs] 2018-04-08 13:19:27 [44651.335296] [] ? spl_kmem_cache_free+0x175/0x1e0 [spl] 2018-04-08 13:19:27 [44651.342566] [] ? zio_destroy+0x83/0x90 [zfs] 2018-04-08 13:19:27 [44651.348953] [] ? zio_wait+0x154/0x1b0 [zfs] 2018-04-08 13:19:27 [44651.355242] [] dbuf_rele+0x36/0x40 [zfs] 2018-04-08 13:19:27 [44651.361261] [] dmu_buf_rele_array.part.5+0x40/0x70 [zfs] 2018-04-08 13:19:27 [44651.368667] [] dmu_read_impl+0x127/0x160 [zfs] 2018-04-08 13:19:27 [44651.375196] [] dmu_read_by_dnode+0xe/0x10 [zfs] 2018-04-08 13:19:27 [44651.381814] [] osd_read+0x111/0x2a0 [osd_zfs] 2018-04-08 13:19:27 [44651.388251] [] dt_read+0x14/0x50 [obdclass] 2018-04-08 13:19:27 [44651.394509] [] out_read+0x4a6/0xaa0 [ptlrpc] 2018-04-08 13:19:27 [44651.400851] [] out_handle+0x1304/0x1920 [ptlrpc] 2018-04-08 13:19:27 [44651.407529] [] ? lustre_msg_get_opc+0x22/0xf0 [ptlrpc] 2018-04-08 13:19:27 [44651.414729] [] ? tgt_request_preprocess.isra.26+0x299/0x790 [ptlrpc] 2018-04-08 13:19:27 [44651.423132] [] tgt_request_handle+0x925/0x1370 [ptlrpc] 2018-04-08 13:19:27 [44651.430413] [] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] 2018-04-08 13:19:27 [44651.438476] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] 2018-04-08 13:19:27 [44651.445675] [] ? default_wake_function+0x12/0x20 2018-04-08 13:19:27 [44651.452363] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:19:27 [44651.458609] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] 2018-04-08 13:19:27 [44651.465289] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:19:27 [44651.473088] [] kthread+0xcf/0xe0 2018-04-08 13:19:27 [44651.478375] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:19:27 [44651.484882] [] ret_from_fork+0x58/0x90 2018-04-08 13:19:27 [44651.490694] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:19:27 [44651.497195] Code: 6a ff ff ba fc ff ff ff 85 c0 5b 0f 45 c2 5d eb e8 66 0f 1f 44 00 00 0f 1f 44 00 00 55 48 c7 47 18 00 00 00 00 48 89 e5 f0 ff 07 <7f> 05 e8 f5 0a 00 00 5d c3 0f 1f 00 0f 1f 44 00 00 55 48 8b 47 2018-04-08 13:19:27 [44651.516891] NMI backtrace for cpu 8 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.524393] NMI backtrace for cpu 9 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:27 [44651.531896] NMI backtrace for cpu 10 2018-04-08 13:19:27 [44651.535927] CPU: 10 PID: 0 Comm: swapper/10 Tainted: P OE ------------ 3.10.0-693.17.1.el7.x86_64 #1 2018-04-08 13:19:28 [44651.546633] Hardware name: Dell Inc. PowerEdge R740/0JM3W2, BIOS 1.3.7 02/08/2018 2018-04-08 13:19:28 [44651.554563] task: ffff88012e24cf10 ti: ffff88012e264000 task.ti: ffff88012e264000 2018-04-08 13:19:28 [44651.562496] RIP: 0010:[] [] _raw_spin_lock_irq+0x9/0x30 2018-04-08 13:19:28 [44651.571381] RSP: 0018:ffff88012e267e48 EFLAGS: 00000293 2018-04-08 13:19:28 [44651.577145] RAX: ffff88012e267fd8 RBX: ffff885ebdb58a00 RCX: 0000000000000001 2018-04-08 13:19:28 [44651.584726] RDX: ffff885ebdb40000 RSI: ffffffff816ac7c9 RDI: ffff885ebdb58a00 2018-04-08 13:19:28 [44651.592315] RBP: ffff88012e267e48 R08: 000028b550376800 R09: ffff885ebdb57a50 2018-04-08 13:19:28 [44651.599901] R10: 7fffffffffffffff R11: 7fffffffffffffff R12: ffff88012e264000 2018-04-08 13:19:28 [44651.607483] R13: 000000000000000a R14: ffff88012e264000 R15: ffff88012e264000 2018-04-08 13:19:28 [44651.615063] FS: 0000000000000000(0000) GS:ffff885ebdb40000(0000) knlGS:0000000000000000 2018-04-08 13:19:28 [44651.623600] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 2018-04-08 13:19:28 [44651.629795] CR2: 00007f462f113000 CR3: 00000000019fa000 CR4: 00000000003607e0 2018-04-08 13:19:28 [44651.637379] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 2018-04-08 13:19:28 [44651.644961] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 2018-04-08 13:19:28 [44651.652541] Call Trace: 2018-04-08 13:19:28 [44651.655447] [] __schedule+0xb5/0x9b0 2018-04-08 13:19:28 [44651.661123] [] schedule_preempt_disabled+0x29/0x70 2018-04-08 13:19:28 [44651.668015] [] cpu_startup_entry+0x18a/0x1c0 2018-04-08 13:19:28 [44651.674385] [] start_secondary+0x1d6/0x250 2018-04-08 13:19:28 [44651.680583] Code: 1f 00 0f 1f 44 00 00 55 48 89 e5 f0 ff 47 04 48 8b 7d 08 be 00 02 00 00 e8 95 3c 9e ff 5d c3 0f 1f 00 0f 1f 44 00 00 55 48 89 e5 66 0f 1f 44 00 00 31 c0 ba 01 00 00 00 f0 0f b1 17 85 c0 75 2018-04-08 13:19:28 [44651.700345] NMI backtrace for cpu 11 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:28 [44651.707958] NMI backtrace for cpu 12 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:28 [44651.715562] NMI backtrace for cpu 13 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:19:28 [44651.723161] NMI backtrace for cpu 14 2018-04-08 13:19:28 [44651.727206] CPU: 14 PID: 283092 Comm: bash Tainted: P OE ------------ 3.10.0-693.17.1.el7.x86_64 #1 2018-04-08 13:19:28 [44651.737844] Hardware name: Dell Inc. PowerEdge R740/0JM3W2, BIOS 1.3.7 02/08/2018 2018-04-08 13:19:28 [44651.745811] task: ffff88bd83bb6eb0 ti: ffff88bd6e2a4000 task.ti: ffff88bd6e2a4000 2018-04-08 13:19:28 [44651.753779] RIP: 0010:[] [] find_next_bit+0xad/0xe0 2018-04-08 13:19:28 [44651.762360] RSP: 0018:ffff88bd6e2a7db0 EFLAGS: 00000006 2018-04-08 13:19:28 [44651.768168] RAX: 0000000000008000 RBX: 000000000000e02e RCX: 000000000000000f 2018-04-08 13:19:28 [44651.775797] RDX: 000000000000000f RSI: 00000000000001c0 RDI: 0000000000000000 2018-04-08 13:19:28 [44651.783417] RBP: ffff88bd6e2a7db0 R08: ffffffff81b22e20 R09: ffff885ebcf1af00 2018-04-08 13:19:28 [44651.791041] R10: 0000000000000cb1 R11: 0000000000000001 R12: ffffffff81b22e20 2018-04-08 13:19:28 [44651.798669] R13: 0000000000000400 R14: 0000000000000286 R15: 0000000000000002 2018-04-08 13:19:28 [44651.806293] FS: 00007f56f8dc0740(0000) GS:ffff885ebdbc0000(0000) knlGS:0000000000000000 2018-04-08 13:19:28 [44651.814876] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 2018-04-08 13:19:28 [44651.821117] CR2: 00007f56f8dce978 CR3: 000000bd6ba4c000 CR4: 00000000003607e0 2018-04-08 13:19:28 [44651.828744] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 2018-04-08 13:19:28 [44651.836370] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 2018-04-08 13:19:28 [44651.844000] Call Trace: 2018-04-08 13:19:28 [44651.846954] [] default_send_IPI_mask_sequence_phys+0x5d/0x100 2018-04-08 13:19:28 [44651.854839] [] physflat_send_IPI_mask+0xe/0x10 2018-04-08 13:19:28 [44651.861417] [] arch_trigger_all_cpu_backtrace+0x2bd/0x2d0 2018-04-08 13:19:28 [44651.868946] [] sysrq_handle_showallcpus+0x13/0x20 2018-04-08 13:19:28 [44651.875779] [] __handle_sysrq+0x107/0x170 2018-04-08 13:19:28 [44651.881925] [] write_sysrq_trigger+0x2f/0x40 2018-04-08 13:19:28 [44651.888325] [] proc_reg_write+0x3d/0x80 2018-04-08 13:19:28 [44651.894279] [] vfs_write+0xbd/0x1e0 2018-04-08 13:19:28 [44651.899881] [] SyS_write+0x7f/0xe0 2018-04-08 13:19:28 [44651.905387] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:19:28 [44651.911834] Code: ff ff ff 29 f1 48 d3 ea 48 21 d0 74 41 f3 48 0f bc c0 48 01 f8 5d c3 0f 1f 80 00 00 00 00 48 c7 c0 ff ff ff ff 48 d3 e0 49 23 00 <48> 83 fe 3f 76 c6 48 85 c0 75 d7 49 83 c0 08 48 83 ee 40 48 83 2018-04-08 13:19:28 [44651.931575] NMI backtrace for cpu 15 skipped: idling at pc 0xffffffff816adb04 2018-04-08 13:23:42 [44905.047146] SysRq : Show State 2018-04-08 13:23:42 [44905.050797] task PC stack pid father 2018-04-08 13:23:42 [44905.057235] systemd S ffff88606efd8000 0 1 0 0x00000000 2018-04-08 13:23:42 [44905.064811] Call Trace: 2018-04-08 13:23:42 [44905.067745] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.073181] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:42 [44905.080704] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 2018-04-08 13:23:42 [44905.087967] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:42 [44905.094793] [] ep_poll+0x23e/0x360 2018-04-08 13:23:42 [44905.100323] [] ? do_timerfd_settime+0x238/0x340 2018-04-08 13:23:42 [44905.106974] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:42 [44905.113017] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:42 [44905.119056] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:42 [44905.125520] kthreadd S ffff88606efd8fd0 0 2 0 0x00000000 2018-04-08 13:23:42 [44905.133070] Call Trace: 2018-04-08 13:23:42 [44905.135971] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.141398] [] kthreadd+0x2f5/0x300 2018-04-08 13:23:42 [44905.146991] [] ? kthread_create_on_cpu+0x60/0x60 2018-04-08 13:23:42 [44905.153710] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.159553] [] ? kthread_create_on_cpu+0x60/0x60 2018-04-08 13:23:42 [44905.166253] ksoftirqd/0 S ffff88012e948000 0 3 2 0x00000000 2018-04-08 13:23:42 [44905.173784] Call Trace: 2018-04-08 13:23:42 [44905.176670] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.182070] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.188323] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.194584] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.199885] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.206394] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.212215] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.218720] kworker/0:0H S ffff88012e949fa0 0 5 2 0x00000000 2018-04-08 13:23:42 [44905.226236] Call Trace: 2018-04-08 13:23:42 [44905.229104] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:42 [44905.235528] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.240914] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:42 [44905.246901] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:42 [44905.253834] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.259119] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.265613] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.271420] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.277913] migration/0 S ffff88012e94cf10 0 8 2 0x00000000 2018-04-08 13:23:42 [44905.285416] Call Trace: 2018-04-08 13:23:42 [44905.288282] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.293665] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.299911] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.306161] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.311447] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.317929] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.323714] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.330186] rcu_bh S ffff88012e94dee0 0 9 2 0x00000000 2018-04-08 13:23:42 [44905.337659] Call Trace: 2018-04-08 13:23:42 [44905.340497] [] ? __switch_to+0xcd/0x500 2018-04-08 13:23:42 [44905.346366] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.351714] [] rcu_gp_kthread+0xb2/0x710 2018-04-08 13:23:42 [44905.357662] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:42 [44905.363866] [] ? rcu_gp_fqs+0x90/0x90 2018-04-08 13:23:42 [44905.369554] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.374807] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.381265] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.387032] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.393493] rcu_sched S ffff88012e94eeb0 0 10 2 0x00000000 2018-04-08 13:23:42 [44905.400958] Call Trace: 2018-04-08 13:23:42 [44905.403784] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.409122] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:23:42 [44905.415332] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:23:42 [44905.421713] [] ? prepare_to_wait+0x56/0x90 2018-04-08 13:23:42 [44905.427834] [] rcu_gp_kthread+0x349/0x710 2018-04-08 13:23:42 [44905.433866] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:42 [44905.440079] [] ? rcu_gp_fqs+0x90/0x90 2018-04-08 13:23:42 [44905.445760] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.451002] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.457463] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.463230] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.469688] migration/1 S ffff88606e3fcf10 0 13 2 0x00000000 2018-04-08 13:23:42 [44905.477147] Call Trace: 2018-04-08 13:23:42 [44905.479977] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.485314] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.491515] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.497719] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.502961] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.509421] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.515187] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.521645] ksoftirqd/1 S ffff88606e3fbf40 0 14 2 0x00000000 2018-04-08 13:23:42 [44905.529110] Call Trace: 2018-04-08 13:23:42 [44905.531932] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.537262] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.543462] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.549659] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.554903] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.561352] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.567108] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.573559] kworker/1:0H S ffff88606e3f9fa0 0 16 2 0x00000000 2018-04-08 13:23:42 [44905.581010] Call Trace: 2018-04-08 13:23:42 [44905.583833] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:42 [44905.590211] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.595544] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:42 [44905.601483] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:42 [44905.608371] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.613617] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.620076] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.625847] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.632302] migration/2 S ffff88012ced0fd0 0 19 2 0x00000000 2018-04-08 13:23:42 [44905.639769] Call Trace: 2018-04-08 13:23:42 [44905.642592] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.647934] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.654140] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.660346] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.665594] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.672056] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.677821] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.684280] ksoftirqd/2 S ffff88012ced1fa0 0 20 2 0x00000000 2018-04-08 13:23:42 [44905.691738] Call Trace: 2018-04-08 13:23:42 [44905.694564] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.699900] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.706102] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.712307] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.717567] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.724035] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.729807] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.736277] kworker/2:0H S ffff88012ced3f40 0 22 2 0x00000000 2018-04-08 13:23:42 [44905.743752] Call Trace: 2018-04-08 13:23:42 [44905.746586] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:42 [44905.752964] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.758303] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:42 [44905.764255] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:42 [44905.771157] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.776417] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.782890] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.788670] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.795139] migration/3 S ffff88606d328fd0 0 24 2 0x00000000 2018-04-08 13:23:42 [44905.802600] Call Trace: 2018-04-08 13:23:42 [44905.805431] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.810777] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.816986] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.823191] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.828448] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.834919] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.840700] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.847167] ksoftirqd/3 S ffff88606d329fa0 0 25 2 0x00000000 2018-04-08 13:23:42 [44905.854630] Call Trace: 2018-04-08 13:23:42 [44905.857458] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.862803] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:42 [44905.869011] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:42 [44905.875221] [] kthread+0xcf/0xe0 2018-04-08 13:23:42 [44905.880474] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.886942] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:42 [44905.892719] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:42 [44905.899185] kworker/3:0H S ffff88606d32bf40 0 27 2 0x00000000 2018-04-08 13:23:42 [44905.906662] Call Trace: 2018-04-08 13:23:42 [44905.909495] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:42 [44905.915883] [] schedule+0x29/0x70 2018-04-08 13:23:42 [44905.921223] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:42 [44905.927172] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44905.934074] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44905.939329] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44905.945799] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44905.951574] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44905.958040] migration/4 S ffff88012ced5ee0 0 29 2 0x00000000 2018-04-08 13:23:43 [44905.965502] Call Trace: 2018-04-08 13:23:43 [44905.968329] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44905.973680] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44905.979888] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44905.986104] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44905.991356] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44905.997829] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.003611] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.010076] ksoftirqd/4 S ffff88012ced4f10 0 30 2 0x00000000 2018-04-08 13:23:43 [44906.017548] Call Trace: 2018-04-08 13:23:43 [44906.020377] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.025723] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.031930] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.038142] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.043392] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.049862] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.055634] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.062105] kworker/4:0H S ffff88012cf48fd0 0 32 2 0x00000000 2018-04-08 13:23:43 [44906.069588] Call Trace: 2018-04-08 13:23:43 [44906.072423] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:43 [44906.078809] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.084148] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:43 [44906.090097] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44906.097000] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.102257] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.108724] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.114500] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.120963] migration/5 S ffff88606d32dee0 0 34 2 0x00000000 2018-04-08 13:23:43 [44906.128436] Call Trace: 2018-04-08 13:23:43 [44906.131267] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.136614] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.142824] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.149038] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.154300] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.160770] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.166546] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.173012] ksoftirqd/5 S ffff88606d32cf10 0 35 2 0x00000000 2018-04-08 13:23:43 [44906.180476] Call Trace: 2018-04-08 13:23:43 [44906.183311] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.188659] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.194866] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.201076] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.206328] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.212800] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.218571] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.225039] kworker/5:0H S ffff88606d368fd0 0 37 2 0x00000000 2018-04-08 13:23:43 [44906.232506] Call Trace: 2018-04-08 13:23:43 [44906.235341] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:43 [44906.241726] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.247066] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:43 [44906.253018] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44906.259918] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.265173] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.271643] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.277417] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.283882] migration/6 R running task 0 39 2 0x00000000 2018-04-08 13:23:43 [44906.291344] Call Trace: 2018-04-08 13:23:43 [44906.294176] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.299522] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.305730] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.311937] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.317194] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.323665] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.329446] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.335913] ksoftirqd/6 R running task 0 40 2 0x00000000 2018-04-08 13:23:43 [44906.343375] Call Trace: 2018-04-08 13:23:43 [44906.346205] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.351549] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.357758] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.363965] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.369219] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.375687] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.381462] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.387929] kworker/6:0H S ffff88012cf4af70 0 42 2 0x00000000 2018-04-08 13:23:43 [44906.395403] Call Trace: 2018-04-08 13:23:43 [44906.398229] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:43 [44906.404610] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.409950] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:43 [44906.415899] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44906.422802] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.428058] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.434525] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.440297] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.446767] migration/7 S ffff88606d36dee0 0 44 2 0x00000000 2018-04-08 13:23:43 [44906.454235] Call Trace: 2018-04-08 13:23:43 [44906.457064] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.462403] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.468615] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.474820] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.480077] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.486543] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.492320] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.498788] ksoftirqd/7 S ffff88606d36cf10 0 45 2 0x00000000 2018-04-08 13:23:43 [44906.506257] Call Trace: 2018-04-08 13:23:43 [44906.509085] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.514424] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.520633] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.526840] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.532094] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.538561] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.544336] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.550804] kworker/7:0 S ffff88606d36bf40 0 46 2 0x00000000 2018-04-08 13:23:43 [44906.558281] Call Trace: 2018-04-08 13:23:43 [44906.561114] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:43 [44906.567497] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.572843] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:43 [44906.578796] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44906.585694] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.590949] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.597418] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.603193] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.609658] kworker/7:0H S ffff88606d36af70 0 47 2 0x00000000 2018-04-08 13:23:43 [44906.617124] Call Trace: 2018-04-08 13:23:43 [44906.619960] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:43 [44906.626349] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.631698] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:43 [44906.637647] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44906.644550] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.649815] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.656290] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.662072] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.668544] migration/8 S ffff88012cfb8000 0 49 2 0x00000000 2018-04-08 13:23:43 [44906.676019] Call Trace: 2018-04-08 13:23:43 [44906.678856] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.684206] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.690420] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.696628] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.701883] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.708351] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.714133] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.720599] ksoftirqd/8 S ffff88012cfb8fd0 0 50 2 0x00000000 2018-04-08 13:23:43 [44906.728072] Call Trace: 2018-04-08 13:23:43 [44906.730900] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.736250] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.742458] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.748663] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.753922] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.760393] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.766171] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.772638] kworker/8:0H S ffff88012cfbaf70 0 52 2 0x00000000 2018-04-08 13:23:43 [44906.780101] Call Trace: 2018-04-08 13:23:43 [44906.782929] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:43 [44906.789318] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.794668] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:43 [44906.800619] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:43 [44906.807530] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.812792] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.819269] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.825051] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.831524] migration/9 S ffff88606d3d8000 0 54 2 0x00000000 2018-04-08 13:23:43 [44906.838988] Call Trace: 2018-04-08 13:23:43 [44906.841826] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.847175] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.853393] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.859608] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.864867] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.871338] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:43 [44906.877114] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.883588] ksoftirqd/9 S ffff88606d3d8fd0 0 55 2 0x00000000 2018-04-08 13:23:43 [44906.891059] Call Trace: 2018-04-08 13:23:43 [44906.893890] [] schedule+0x29/0x70 2018-04-08 13:23:43 [44906.899234] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:43 [44906.905441] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:43 [44906.911650] [] kthread+0xcf/0xe0 2018-04-08 13:23:43 [44906.916904] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:43 [44906.923371] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44906.929145] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44906.935613] kworker/9:0H S ffff88606d3daf70 0 57 2 0x00000000 2018-04-08 13:23:44 [44906.943090] Call Trace: 2018-04-08 13:23:44 [44906.945926] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:44 [44906.952312] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44906.957653] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44906.963601] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44906.970503] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44906.975756] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44906.982228] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44906.988008] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44906.994475] migration/10 S ffff88012cfbdee0 0 59 2 0x00000000 2018-04-08 13:23:44 [44907.001945] Call Trace: 2018-04-08 13:23:44 [44907.004776] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.010123] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.016332] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.022540] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.027797] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.034265] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.040047] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.046514] ksoftirqd/10 S ffff88012cfbcf10 0 60 2 0x00000000 2018-04-08 13:23:44 [44907.053975] Call Trace: 2018-04-08 13:23:44 [44907.056807] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.062152] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.068363] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.074570] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.079824] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.086291] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.092066] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.098533] kworker/10:0H S ffff88012c818000 0 62 2 0x00000000 2018-04-08 13:23:44 [44907.106000] Call Trace: 2018-04-08 13:23:44 [44907.108835] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:44 [44907.115223] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.120562] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44907.126510] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44907.133413] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.138667] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.145138] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.150920] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.157389] migration/11 S ffff88606d3ddee0 0 64 2 0x00000000 2018-04-08 13:23:44 [44907.164863] Call Trace: 2018-04-08 13:23:44 [44907.167695] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.173045] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.179259] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.185469] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.190732] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.197203] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.202985] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.209451] ksoftirqd/11 S ffff88606d3dcf10 0 65 2 0x00000000 2018-04-08 13:23:44 [44907.216916] Call Trace: 2018-04-08 13:23:44 [44907.219752] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.225097] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.231306] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.237513] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.242766] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.249235] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.255008] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.261478] kworker/11:0H S ffff88606cc18000 0 67 2 0x00000000 2018-04-08 13:23:44 [44907.268951] Call Trace: 2018-04-08 13:23:44 [44907.271786] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:44 [44907.278165] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.283506] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44907.289455] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44907.296360] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.301621] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.308090] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.313880] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.320348] migration/12 S ffff88012c81dee0 0 69 2 0x00000000 2018-04-08 13:23:44 [44907.327810] Call Trace: 2018-04-08 13:23:44 [44907.330638] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.335987] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.342196] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.348403] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.353658] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.360128] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.365908] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.372375] ksoftirqd/12 S ffff88012c81cf10 0 70 2 0x00000000 2018-04-08 13:23:44 [44907.379839] Call Trace: 2018-04-08 13:23:44 [44907.382666] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.388013] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.394221] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.400431] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.405682] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.412151] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.417929] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.424394] kworker/12:0H S ffff88012c81af70 0 72 2 0x00000000 2018-04-08 13:23:44 [44907.431861] Call Trace: 2018-04-08 13:23:44 [44907.434694] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:44 [44907.441073] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.446417] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44907.452364] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44907.459265] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.464520] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.470990] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.476765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.483232] migration/13 S ffff88606cc1dee0 0 74 2 0x00000000 2018-04-08 13:23:44 [44907.490692] Call Trace: 2018-04-08 13:23:44 [44907.493522] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.498869] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.505077] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.511285] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.516539] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.523009] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.528782] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.535251] ksoftirqd/13 S ffff88606cc1cf10 0 75 2 0x00000000 2018-04-08 13:23:44 [44907.542713] Call Trace: 2018-04-08 13:23:44 [44907.545544] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.550886] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.557100] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.563304] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.568558] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.575026] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.580801] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.587267] kworker/13:0 S ffff88606cc1bf40 0 76 2 0x00000000 2018-04-08 13:23:44 [44907.594747] Call Trace: 2018-04-08 13:23:44 [44907.597578] [] ? start_worker+0x27/0x30 2018-04-08 13:23:44 [44907.603437] [] ? manage_workers.isra.24+0x189/0x2a0 2018-04-08 13:23:44 [44907.610339] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.615679] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44907.621627] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44907.628530] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.633785] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.640253] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.646029] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.652491] kworker/13:0H S ffff88606cc1af70 0 77 2 0x00000000 2018-04-08 13:23:44 [44907.659964] Call Trace: 2018-04-08 13:23:44 [44907.662794] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:44 [44907.669186] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.674534] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44907.680485] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44907.687393] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.692657] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.699132] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.704910] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.711378] migration/14 S ffff88012c819fa0 0 79 2 0x00000000 2018-04-08 13:23:44 [44907.718850] Call Trace: 2018-04-08 13:23:44 [44907.721682] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.727030] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.733238] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.739454] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.744710] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.751178] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.756949] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.763416] ksoftirqd/14 S ffff88012c8a0000 0 80 2 0x00000000 2018-04-08 13:23:44 [44907.770887] Call Trace: 2018-04-08 13:23:44 [44907.773717] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.779066] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.785277] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.791492] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.796747] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.803218] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.809002] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.815468] kworker/14:0H S ffff88012c8a1fa0 0 82 2 0x00000000 2018-04-08 13:23:44 [44907.822946] Call Trace: 2018-04-08 13:23:44 [44907.825784] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:44 [44907.832171] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.837522] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:44 [44907.843482] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:44 [44907.850390] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.855654] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.862128] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.867909] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.874376] migration/15 S ffff88606cc19fa0 0 84 2 0x00000000 2018-04-08 13:23:44 [44907.881847] Call Trace: 2018-04-08 13:23:44 [44907.884679] [] schedule+0x29/0x70 2018-04-08 13:23:44 [44907.890027] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:44 [44907.896246] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:44 [44907.902462] [] kthread+0xcf/0xe0 2018-04-08 13:23:44 [44907.907722] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:44 [44907.914191] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:44 [44907.919965] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44907.926433] ksoftirqd/15 S ffff88606cc68000 0 85 2 0x00000000 2018-04-08 13:23:45 [44907.933902] Call Trace: 2018-04-08 13:23:45 [44907.936732] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44907.942080] [] smpboot_thread_fn+0xd5/0x180 2018-04-08 13:23:45 [44907.948285] [] ? lg_double_unlock+0x40/0x40 2018-04-08 13:23:45 [44907.954495] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44907.959750] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44907.966216] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44907.971991] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44907.978458] kworker/15:0 S ffff88606cc68fd0 0 86 2 0x00000000 2018-04-08 13:23:45 [44907.985943] Call Trace: 2018-04-08 13:23:45 [44907.988776] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:45 [44907.995155] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.000498] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:45 [44908.006445] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:45 [44908.013347] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.018604] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.025071] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.030846] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.037313] kworker/15:0H S ffff88606cc69fa0 0 87 2 0x00000000 2018-04-08 13:23:45 [44908.044775] Call Trace: 2018-04-08 13:23:45 [44908.047612] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:45 [44908.054001] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.059350] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:45 [44908.065300] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:45 [44908.072210] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.077474] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.083951] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.089733] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.096206] kdevtmpfs S ffff88012c8a4f10 0 90 2 0x00000000 2018-04-08 13:23:45 [44908.103678] Call Trace: 2018-04-08 13:23:45 [44908.106515] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.111868] [] devtmpfsd+0x16d/0x180 2018-04-08 13:23:45 [44908.117477] [] ? handle_create.isra.2+0x220/0x220 2018-04-08 13:23:45 [44908.124211] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.129476] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.135954] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.141737] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.148211] netns S ffff885ec0e30000 0 91 2 0x00000000 2018-04-08 13:23:45 [44908.155684] Call Trace: 2018-04-08 13:23:45 [44908.158521] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.163871] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.169913] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:45 [44908.176301] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.181565] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.188034] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.193818] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.200293] khungtaskd S ffff885ec0e30fd0 0 92 2 0x00000000 2018-04-08 13:23:45 [44908.207764] Call Trace: 2018-04-08 13:23:45 [44908.210602] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.215949] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:23:45 [44908.222157] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:23:45 [44908.228544] [] schedule_timeout_interruptible+0x1e/0x20 2018-04-08 13:23:45 [44908.235801] [] watchdog+0x4c/0x2c0 2018-04-08 13:23:45 [44908.241242] [] ? reset_hung_task_detector+0x20/0x20 2018-04-08 13:23:45 [44908.248154] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.253417] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.259888] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.265670] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.272139] writeback S ffff885ec0e31fa0 0 93 2 0x00000000 2018-04-08 13:23:45 [44908.279619] Call Trace: 2018-04-08 13:23:45 [44908.282458] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.287807] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.293852] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:45 [44908.300238] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.305504] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.311980] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.317758] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.324224] kintegrityd S ffff885ec0e32f70 0 94 2 0x00000000 2018-04-08 13:23:45 [44908.331698] Call Trace: 2018-04-08 13:23:45 [44908.334534] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.339883] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.345921] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:45 [44908.352307] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.357562] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.364029] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.369806] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.376270] bioset S ffff885ec0e33f40 0 95 2 0x00000000 2018-04-08 13:23:45 [44908.383734] Call Trace: 2018-04-08 13:23:45 [44908.386564] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.391913] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.397950] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:45 [44908.404336] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.409591] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.416060] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.421834] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.428300] kblockd S ffff885ec0e34f10 0 96 2 0x00000000 2018-04-08 13:23:45 [44908.435772] Call Trace: 2018-04-08 13:23:45 [44908.438601] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.443952] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.449986] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:45 [44908.456375] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.461628] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.468100] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.473883] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.480351] md S ffff885ec0e36eb0 0 98 2 0x00000000 2018-04-08 13:23:45 [44908.487821] Call Trace: 2018-04-08 13:23:45 [44908.490657] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.496010] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.502051] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:45 [44908.508439] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.513691] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.520158] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.525930] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.532402] kworker/1:1 S ffff88bebeb78fd0 0 100 2 0x00000000 2018-04-08 13:23:45 [44908.539878] Call Trace: 2018-04-08 13:23:45 [44908.542715] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:45 [44908.549098] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.554437] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:45 [44908.560387] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:45 [44908.567286] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.572543] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.579013] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.584786] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.591253] kworker/3:1 S ffff88bebeb79fa0 0 101 2 0x00000000 2018-04-08 13:23:45 [44908.598721] Call Trace: 2018-04-08 13:23:45 [44908.601556] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:45 [44908.607941] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.613282] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:45 [44908.619234] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:45 [44908.626141] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.631408] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.637884] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.643668] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.650142] kswapd0 S ffff88bebeb7eeb0 0 106 2 0x00000000 2018-04-08 13:23:45 [44908.657614] Call Trace: 2018-04-08 13:23:45 [44908.660453] [] ? calculate_normal_threshold+0x27/0x50 2018-04-08 13:23:45 [44908.667535] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.672885] [] kswapd+0x38c/0x440 2018-04-08 13:23:45 [44908.678236] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:45 [44908.684453] [] ? balance_pgdat+0x5e0/0x5e0 2018-04-08 13:23:45 [44908.690580] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.695843] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.702319] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.708098] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.714568] kswapd1 S ffff88bebeb7af70 0 107 2 0x00000000 2018-04-08 13:23:45 [44908.722032] Call Trace: 2018-04-08 13:23:45 [44908.724874] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.730228] [] kswapd+0x38c/0x440 2018-04-08 13:23:45 [44908.735579] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:45 [44908.741800] [] ? balance_pgdat+0x5e0/0x5e0 2018-04-08 13:23:45 [44908.747926] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.753190] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.759660] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.765436] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.771899] ksmd S ffff88bebeb7bf40 0 108 2 0x00000000 2018-04-08 13:23:45 [44908.779367] Call Trace: 2018-04-08 13:23:45 [44908.782199] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.787551] [] ksm_scan_thread+0x16a/0x240 2018-04-08 13:23:45 [44908.793679] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:45 [44908.799894] [] ? ksm_do_scan+0x11b0/0x11b0 2018-04-08 13:23:45 [44908.806024] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.811282] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.817748] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.823521] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.829989] khugepaged S ffff885eb9a10000 0 109 2 0x00000000 2018-04-08 13:23:45 [44908.837455] Call Trace: 2018-04-08 13:23:45 [44908.840287] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.845634] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:23:45 [44908.851842] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:23:45 [44908.858225] [] khugepaged+0x226/0x480 2018-04-08 13:23:45 [44908.863920] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:45 [44908.870121] [] ? khugepaged_scan_mm_slot+0xcf0/0xcf0 2018-04-08 13:23:45 [44908.877108] [] kthread+0xcf/0xe0 2018-04-08 13:23:45 [44908.882360] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.888821] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:45 [44908.894599] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:45 [44908.901065] crypto S ffff885eb9a10fd0 0 110 2 0x00000000 2018-04-08 13:23:45 [44908.908539] Call Trace: 2018-04-08 13:23:45 [44908.911370] [] schedule+0x29/0x70 2018-04-08 13:23:45 [44908.916716] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:45 [44908.922754] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44908.929132] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44908.934380] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44908.940837] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44908.946602] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44908.953066] kthrotld S ffff885eb9a48fd0 0 118 2 0x00000000 2018-04-08 13:23:46 [44908.960532] Call Trace: 2018-04-08 13:23:46 [44908.963362] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44908.968702] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44908.974738] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44908.981116] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44908.986372] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44908.992836] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44908.998599] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.005062] kworker/u898:1 S ffff88beb8ac0000 0 119 2 0x00000000 2018-04-08 13:23:46 [44909.012538] Call Trace: 2018-04-08 13:23:46 [44909.015368] [] ? __call_usermodehelper+0x7c/0x90 2018-04-08 13:23:46 [44909.022016] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:46 [44909.028405] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.033746] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:46 [44909.039697] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:46 [44909.046607] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.051861] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.058330] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.064104] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.070574] kmpath_rdacd S ffff88beb8ac0fd0 0 120 2 0x00000000 2018-04-08 13:23:46 [44909.078040] Call Trace: 2018-04-08 13:23:46 [44909.080879] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.086228] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.092273] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.098662] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.103923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.110391] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.116170] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.122634] kworker/5:1 S ffff88beb8ac6eb0 0 122 2 0x00000000 2018-04-08 13:23:46 [44909.130115] Call Trace: 2018-04-08 13:23:46 [44909.132952] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:46 [44909.139343] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.144693] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:46 [44909.150648] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:46 [44909.157556] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.162821] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.169297] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.175080] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.181552] kworker/15:1 S ffff88beb8b70000 0 124 2 0x00000000 2018-04-08 13:23:46 [44909.189026] Call Trace: 2018-04-08 13:23:46 [44909.191864] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:46 [44909.198256] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.203605] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:46 [44909.209562] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:46 [44909.216470] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.221736] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.228211] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.233991] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.240465] kpsmoused S ffff88beb8b70fd0 0 125 2 0x00000000 2018-04-08 13:23:46 [44909.247949] Call Trace: 2018-04-08 13:23:46 [44909.250787] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.256138] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.262181] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.268572] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.273842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.280319] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.286098] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.292570] ipv6_addrconf S ffff88beb8b71fa0 0 126 2 0x00000000 2018-04-08 13:23:46 [44909.300042] Call Trace: 2018-04-08 13:23:46 [44909.302881] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.308231] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.314278] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.320664] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.325925] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.332396] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.338179] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.344656] deferwq S ffff885eb9a4cf10 0 145 2 0x00000000 2018-04-08 13:23:46 [44909.352136] Call Trace: 2018-04-08 13:23:46 [44909.354972] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.360320] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.366366] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.372755] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.378019] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.384496] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.390276] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.396746] ib-comp-wq S ffff885eb8cf8000 0 332 2 0x00000000 2018-04-08 13:23:46 [44909.404225] Call Trace: 2018-04-08 13:23:46 [44909.407063] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.412407] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.418442] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.424827] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.430088] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.436557] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.442340] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.448807] ib_addr S ffff88beb8b75ee0 0 333 2 0x00000000 2018-04-08 13:23:46 [44909.456294] Call Trace: 2018-04-08 13:23:46 [44909.459125] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.464470] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.470506] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.476885] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.482141] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.488608] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.494381] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.500850] ib_mcast S ffff885eb9730000 0 334 2 0x00000000 2018-04-08 13:23:46 [44909.508327] Call Trace: 2018-04-08 13:23:46 [44909.511163] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.516508] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.522541] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.528924] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.534176] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.540645] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.546421] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.552891] ib_nl_sa_wq S ffff885eb97e4f10 0 335 2 0x00000000 2018-04-08 13:23:46 [44909.560366] Call Trace: 2018-04-08 13:23:46 [44909.563202] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.568549] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.574586] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.580967] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.586225] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.592693] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.598466] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.604939] scsi_eh_0 S ffff885eb97e3f40 0 336 2 0x00000000 2018-04-08 13:23:46 [44909.612417] Call Trace: 2018-04-08 13:23:46 [44909.615258] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.620606] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:46 [44909.626902] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:46 [44909.633370] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.638626] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.645095] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.650867] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.657340] scsi_tmf_0 S ffff885eb97e2f70 0 337 2 0x00000000 2018-04-08 13:23:46 [44909.664823] Call Trace: 2018-04-08 13:23:46 [44909.667660] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.673005] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.679048] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.685427] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.690681] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.697158] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.702932] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.709404] ata_sff S ffff885eb958eeb0 0 339 2 0x00000000 2018-04-08 13:23:46 [44909.716886] Call Trace: 2018-04-08 13:23:46 [44909.719723] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.725070] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.731112] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.737502] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.742763] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.749234] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.755006] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.761474] kworker/10:1 S ffff885eb958dee0 0 341 2 0x00000000 2018-04-08 13:23:46 [44909.768950] Call Trace: 2018-04-08 13:23:46 [44909.771789] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:46 [44909.778170] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.783513] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:46 [44909.789463] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:46 [44909.796369] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.801624] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.808093] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.813869] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.820347] scsi_eh_1 S ffff885eb8cfaf70 0 345 2 0x00000000 2018-04-08 13:23:46 [44909.827818] Call Trace: 2018-04-08 13:23:46 [44909.830656] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.836000] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:46 [44909.842296] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:46 [44909.848771] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.854035] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.860506] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.866289] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.872765] scsi_tmf_1 S ffff88beb8b73f40 0 346 2 0x00000000 2018-04-08 13:23:46 [44909.880250] Call Trace: 2018-04-08 13:23:46 [44909.883093] [] schedule+0x29/0x70 2018-04-08 13:23:46 [44909.888437] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:46 [44909.894485] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:46 [44909.900871] [] kthread+0xcf/0xe0 2018-04-08 13:23:46 [44909.906134] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:46 [44909.912611] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:46 [44909.918397] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44909.924873] fw_event_mpt3sa S ffff88beb8b76eb0 0 347 2 0x00000000 2018-04-08 13:23:47 [44909.932356] Call Trace: 2018-04-08 13:23:47 [44909.935189] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44909.940536] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44909.946582] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44909.952970] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44909.958234] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44909.964710] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44909.970493] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44909.976970] scsi_eh_2 S ffff88beb8b74f10 0 348 2 0x00000000 2018-04-08 13:23:47 [44909.984452] Call Trace: 2018-04-08 13:23:47 [44909.987288] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44909.994024] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44909.999370] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.005677] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.012152] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.017414] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.023894] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.029674] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.036150] scsi_tmf_2 S ffff88beb8b72f70 0 349 2 0x00000000 2018-04-08 13:23:47 [44910.043623] Call Trace: 2018-04-08 13:23:47 [44910.046461] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.051804] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.057842] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.064230] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.069496] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.075969] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.081745] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.088221] scsi_eh_3 S ffff885eb6210000 0 350 2 0x00000000 2018-04-08 13:23:47 [44910.095697] Call Trace: 2018-04-08 13:23:47 [44910.098533] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.105266] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.110614] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.116920] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.123397] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.128659] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.135137] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.140917] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.147394] scsi_tmf_3 S ffff885eb8cfbf40 0 351 2 0x00000000 2018-04-08 13:23:47 [44910.154866] Call Trace: 2018-04-08 13:23:47 [44910.157703] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.163051] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.169096] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.175488] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.180750] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.187227] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.193014] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.199495] scsi_eh_4 S ffff885eb8cfcf10 0 352 2 0x00000000 2018-04-08 13:23:47 [44910.206967] Call Trace: 2018-04-08 13:23:47 [44910.209800] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.216540] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.221897] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.228200] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.234679] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.239947] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.246426] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.252209] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.258681] scsi_tmf_4 S ffff885eb6210fd0 0 353 2 0x00000000 2018-04-08 13:23:47 [44910.266166] Call Trace: 2018-04-08 13:23:47 [44910.269008] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.274355] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.280400] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.286788] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.292055] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.298530] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.304312] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.310787] scsi_eh_5 S ffff885eb6211fa0 0 354 2 0x00000000 2018-04-08 13:23:47 [44910.318266] Call Trace: 2018-04-08 13:23:47 [44910.321106] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.327841] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.333194] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.339506] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.345988] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.351250] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.357727] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.363510] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.369984] scsi_tmf_5 S ffff885eb6212f70 0 355 2 0x00000000 2018-04-08 13:23:47 [44910.377468] Call Trace: 2018-04-08 13:23:47 [44910.380302] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.385651] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.391692] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.398087] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.403345] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.409822] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.415606] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.422082] scsi_eh_6 S ffff885eb97e1fa0 0 356 2 0x00000000 2018-04-08 13:23:47 [44910.429552] Call Trace: 2018-04-08 13:23:47 [44910.432390] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.439127] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.444478] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.450781] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.457258] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.462521] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.468999] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.474782] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.481252] scsi_tmf_6 S ffff885eb6213f40 0 357 2 0x00000000 2018-04-08 13:23:47 [44910.488736] Call Trace: 2018-04-08 13:23:47 [44910.491579] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.496928] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.502970] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.509360] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.514624] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.521103] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.526885] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.533360] scsi_eh_7 S ffff885eb8cfdee0 0 358 2 0x00000000 2018-04-08 13:23:47 [44910.540837] Call Trace: 2018-04-08 13:23:47 [44910.543679] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.550413] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.555762] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.562068] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.568547] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.573817] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.580294] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.586083] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.592557] scsi_tmf_7 S ffff885eb6214f10 0 359 2 0x00000000 2018-04-08 13:23:47 [44910.600038] Call Trace: 2018-04-08 13:23:47 [44910.602873] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.608222] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.614271] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.620653] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.625920] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.632398] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.638180] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.644654] scsi_eh_8 S ffff885eb5a08fd0 0 374 2 0x00000000 2018-04-08 13:23:47 [44910.652135] Call Trace: 2018-04-08 13:23:47 [44910.654973] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.661708] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.667064] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.673373] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.679856] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.685120] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.691596] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.697378] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.703851] scsi_tmf_8 S ffff885eb5a09fa0 0 375 2 0x00000000 2018-04-08 13:23:47 [44910.711335] Call Trace: 2018-04-08 13:23:47 [44910.714168] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.719516] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.725562] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.731952] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.737215] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.743689] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.749474] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.755954] scsi_eh_9 S ffff885eb5908fd0 0 376 2 0x00000000 2018-04-08 13:23:47 [44910.763428] Call Trace: 2018-04-08 13:23:47 [44910.766268] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.773004] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.778354] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.784660] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.791134] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.796395] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.802876] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.808669] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.815140] scsi_tmf_9 S ffff885eb5909fa0 0 377 2 0x00000000 2018-04-08 13:23:47 [44910.822620] Call Trace: 2018-04-08 13:23:47 [44910.825455] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.830806] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:47 [44910.836849] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:47 [44910.843236] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.848502] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.854978] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.860761] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.867238] scsi_eh_10 S ffff885eb958bf40 0 378 2 0x00000000 2018-04-08 13:23:47 [44910.874717] Call Trace: 2018-04-08 13:23:47 [44910.877555] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:47 [44910.884292] [] schedule+0x29/0x70 2018-04-08 13:23:47 [44910.889651] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:47 [44910.895955] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:47 [44910.902428] [] kthread+0xcf/0xe0 2018-04-08 13:23:47 [44910.907692] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:47 [44910.914169] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:47 [44910.919953] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44910.926430] scsi_tmf_10 S ffff885eb958af70 0 379 2 0x00000000 2018-04-08 13:23:48 [44910.933906] Call Trace: 2018-04-08 13:23:48 [44910.936744] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44910.942092] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44910.948135] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44910.954524] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44910.959790] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44910.966265] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44910.972046] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44910.978525] scsi_eh_11 S ffff885eb5a0af70 0 380 2 0x00000000 2018-04-08 13:23:48 [44910.986002] Call Trace: 2018-04-08 13:23:48 [44910.988842] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:48 [44910.995577] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.000924] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:48 [44911.007232] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:48 [44911.013709] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.018979] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.025455] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.031244] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.037721] scsi_tmf_11 S ffff885eb5a0bf40 0 381 2 0x00000000 2018-04-08 13:23:48 [44911.045203] Call Trace: 2018-04-08 13:23:48 [44911.048040] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.053387] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.059434] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.065823] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.071082] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.077561] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.083342] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.089821] scsi_eh_12 S ffff885eb5a0cf10 0 382 2 0x00000000 2018-04-08 13:23:48 [44911.097299] Call Trace: 2018-04-08 13:23:48 [44911.100135] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:48 [44911.106874] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.112231] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:48 [44911.118537] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:48 [44911.125023] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.130294] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.136772] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.142562] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.149034] scsi_tmf_12 S ffff885eb5a0dee0 0 383 2 0x00000000 2018-04-08 13:23:48 [44911.156514] Call Trace: 2018-04-08 13:23:48 [44911.159351] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.164697] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.170744] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.177135] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.182394] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.188874] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.194656] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.201133] scsi_eh_13 S ffff885eb5a0eeb0 0 384 2 0x00000000 2018-04-08 13:23:48 [44911.208601] Call Trace: 2018-04-08 13:23:48 [44911.211441] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:48 [44911.218177] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.223528] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:48 [44911.229830] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:48 [44911.236310] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.241578] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.248053] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.253839] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.260309] scsi_tmf_13 S ffff885eb5ab0000 0 385 2 0x00000000 2018-04-08 13:23:48 [44911.267784] Call Trace: 2018-04-08 13:23:48 [44911.270620] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.275967] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.282011] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.288399] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.293664] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.300145] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.305923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.312398] scsi_eh_14 S ffff885eb5ab8000 0 386 2 0x00000000 2018-04-08 13:23:48 [44911.319877] Call Trace: 2018-04-08 13:23:48 [44911.322717] [] ? __scsi_iterate_devices+0x68/0x90 2018-04-08 13:23:48 [44911.329453] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.334802] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:48 [44911.341107] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:48 [44911.347583] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.352848] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.359325] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.365117] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.371586] scsi_tmf_14 S ffff885eb5ab8fd0 0 387 2 0x00000000 2018-04-08 13:23:48 [44911.379064] Call Trace: 2018-04-08 13:23:48 [44911.381905] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.387254] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.393299] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.399687] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.404953] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.411426] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.417210] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.423687] scsi_eh_15 S ffff885eb590af70 0 388 2 0x00000000 2018-04-08 13:23:48 [44911.431167] Call Trace: 2018-04-08 13:23:48 [44911.434004] [] ? __scsi_iterate_devices+0x75/0x90 2018-04-08 13:23:48 [44911.440740] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.446091] [] scsi_error_handler+0xa3/0x8b0 2018-04-08 13:23:48 [44911.452397] [] ? scsi_eh_get_sense+0x250/0x250 2018-04-08 13:23:48 [44911.458878] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.464143] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.470620] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.476404] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.482877] scsi_tmf_15 S ffff885eb590bf40 0 389 2 0x00000000 2018-04-08 13:23:48 [44911.490348] Call Trace: 2018-04-08 13:23:48 [44911.493184] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.498532] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.504577] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.510970] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.516239] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.522714] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.528498] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.534975] kworker/u897:14 S ffff885eb5ab5ee0 0 396 2 0x00000000 2018-04-08 13:23:48 [44911.542444] Call Trace: 2018-04-08 13:23:48 [44911.545284] [] ? mod_timer+0x14a/0x220 2018-04-08 13:23:48 [44911.551061] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.556413] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:48 [44911.562373] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:48 [44911.569282] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.574546] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.581022] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.586805] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.593277] bnx2x S ffff885eb6120000 0 399 2 0x00000000 2018-04-08 13:23:48 [44911.600759] Call Trace: 2018-04-08 13:23:48 [44911.603596] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.608941] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.614980] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.621368] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.626629] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.633098] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.638883] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.645357] bnx2x_iov S ffff885eb6120fd0 0 400 2 0x00000000 2018-04-08 13:23:48 [44911.652831] Call Trace: 2018-04-08 13:23:48 [44911.655668] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.661017] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.667061] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.673454] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.678713] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.685191] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.690973] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.697450] kworker/8:1 S ffff885eb5abcf10 0 413 2 0x00000000 2018-04-08 13:23:48 [44911.704924] Call Trace: 2018-04-08 13:23:48 [44911.707756] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:48 [44911.714144] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.719494] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:48 [44911.725450] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:48 [44911.732355] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.737614] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.744083] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.749865] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.756338] kworker/11:1 S ffff88beb2598fd0 0 415 2 0x00000000 2018-04-08 13:23:48 [44911.763806] Call Trace: 2018-04-08 13:23:48 [44911.766641] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:48 [44911.773032] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.778379] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:48 [44911.784330] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:48 [44911.791240] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.796503] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.802980] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.808764] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.815234] bond0 S ffff88beb259cf10 0 491 2 0x00000000 2018-04-08 13:23:48 [44911.822710] Call Trace: 2018-04-08 13:23:48 [44911.825545] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.830895] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:48 [44911.836938] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:48 [44911.843327] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.848592] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.855069] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.860850] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.867326] kworker/0:1H S ffff885eb0218fd0 0 520 2 0x00000000 2018-04-08 13:23:48 [44911.874808] Call Trace: 2018-04-08 13:23:48 [44911.877644] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:48 [44911.884035] [] schedule+0x29/0x70 2018-04-08 13:23:48 [44911.889384] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:48 [44911.895339] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:48 [44911.902250] [] kthread+0xcf/0xe0 2018-04-08 13:23:48 [44911.907514] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:48 [44911.913996] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:48 [44911.919781] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44911.926260] kworker/9:2 S ffff88beb259af70 0 572 2 0x00000000 2018-04-08 13:23:49 [44911.933740] Call Trace: 2018-04-08 13:23:49 [44911.936576] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:49 [44911.942969] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44911.948323] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44911.954280] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44911.961195] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44911.966464] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44911.972941] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44911.978727] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44911.985200] kworker/12:1H S ffff885eac91eeb0 0 600 2 0x00000000 2018-04-08 13:23:49 [44911.992684] Call Trace: 2018-04-08 13:23:49 [44911.995525] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:49 [44912.001923] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.007281] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44912.013246] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44912.020153] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.025418] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.031898] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.037682] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.044156] poll_mpt3sas0_s S ffff885eac91dee0 0 601 2 0x00000000 2018-04-08 13:23:49 [44912.051641] Call Trace: 2018-04-08 13:23:49 [44912.054478] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.059834] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.065882] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.072276] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.077542] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.084017] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.089799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.096274] kworker/5:2 S ffff88beb2f2eeb0 0 605 2 0x00000000 2018-04-08 13:23:49 [44912.103747] Call Trace: 2018-04-08 13:23:49 [44912.106586] [] ? process_one_work+0x336/0x440 2018-04-08 13:23:49 [44912.112981] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.118332] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44912.124289] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44912.131202] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.136470] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.142947] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.148728] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.155201] kworker/11:2 S 000000000000000b 0 655 2 0x00000000 2018-04-08 13:23:49 [44912.162687] Call Trace: 2018-04-08 13:23:49 [44912.165531] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.170890] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44912.176847] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44912.183756] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.189027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.195509] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.201297] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.207766] kworker/2:1H S ffff885eb8cf9fa0 0 674 2 0x00000000 2018-04-08 13:23:49 [44912.215243] Call Trace: 2018-04-08 13:23:49 [44912.218090] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:49 [44912.224487] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.229843] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44912.235801] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44912.242709] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.247972] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.254450] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.260232] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.266704] kworker/3:1H S ffff88beb7615ee0 0 685 2 0x00000000 2018-04-08 13:23:49 [44912.274189] Call Trace: 2018-04-08 13:23:49 [44912.277034] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:49 [44912.283427] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.288780] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44912.294738] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44912.301646] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.306912] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.313391] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.319179] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.325650] ib_cm S ffff88beb7614f10 0 742 2 0x00000000 2018-04-08 13:23:49 [44912.333134] Call Trace: 2018-04-08 13:23:49 [44912.335970] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.341328] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.347374] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.353760] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.359027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.365506] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.371296] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.377775] ipoib_flush S ffff88beb7613f40 0 745 2 0x00000000 2018-04-08 13:23:49 [44912.385260] Call Trace: 2018-04-08 13:23:49 [44912.388103] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.393449] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.399495] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.405886] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.411147] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.417622] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.423411] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.429882] systemd-journal R running task 0 890 1 0x00000000 2018-04-08 13:23:49 [44912.437364] Call Trace: 2018-04-08 13:23:49 [44912.440201] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.445549] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:49 [44912.452981] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 2018-04-08 13:23:49 [44912.460155] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:49 [44912.466889] [] ep_poll+0x23e/0x360 2018-04-08 13:23:49 [44912.472332] [] ? do_truncate+0x88/0xc0 2018-04-08 13:23:49 [44912.478123] [] ? __sb_start_write+0x58/0x110 2018-04-08 13:23:49 [44912.484432] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:49 [44912.490384] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:49 [44912.496335] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:49 [44912.502713] systemd-udevd S ffff885eb9730fd0 0 931 1 0x00000000 2018-04-08 13:23:49 [44912.510191] Call Trace: 2018-04-08 13:23:49 [44912.513030] [] ? kmem_cache_alloc+0x35/0x1e0 2018-04-08 13:23:49 [44912.519333] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.524681] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:49 [44912.532112] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 2018-04-08 13:23:49 [44912.539282] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:49 [44912.546023] [] ep_poll+0x23e/0x360 2018-04-08 13:23:49 [44912.551455] [] ? do_unlinkat+0xf1/0x2d0 2018-04-08 13:23:49 [44912.557324] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:49 [44912.563281] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:49 [44912.569227] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:49 [44912.575604] iw_cm_wq S ffff885eb9736eb0 0 975 2 0x00000000 2018-04-08 13:23:49 [44912.583087] Call Trace: 2018-04-08 13:23:49 [44912.585920] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.591270] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.597314] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.603700] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.608959] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.615427] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.621199] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.627669] rdma_cm S 0000000000000004 0 1010 2 0x00000000 2018-04-08 13:23:49 [44912.635138] Call Trace: 2018-04-08 13:23:49 [44912.637976] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.643325] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.649370] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.655760] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.661015] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.667485] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.673257] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.679726] nfit S ffff88beb8485ee0 0 1026 2 0x00000000 2018-04-08 13:23:49 [44912.687194] Call Trace: 2018-04-08 13:23:49 [44912.690033] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.695377] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.701415] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.707803] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.713060] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.719530] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.725302] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.731773] irq/148-mei_me S ffff88012ced6eb0 0 1068 2 0x00000000 2018-04-08 13:23:49 [44912.739241] Call Trace: 2018-04-08 13:23:49 [44912.742074] [] ? irq_finalize_oneshot.part.29+0xe0/0xe0 2018-04-08 13:23:49 [44912.749333] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.754681] [] irq_thread+0xd1/0x180 2018-04-08 13:23:49 [44912.760293] [] ? irq_forced_thread_fn+0x50/0x50 2018-04-08 13:23:49 [44912.766859] [] ? irq_thread_check_affinity+0xf0/0xf0 2018-04-08 13:23:49 [44912.773860] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.779123] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.785596] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.791375] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.797841] kworker/u898:3 S ffff88beb8ac1fa0 0 1128 2 0x00000000 2018-04-08 13:23:49 [44912.805319] Call Trace: 2018-04-08 13:23:49 [44912.808156] [] ? __call_usermodehelper+0x4e/0x90 2018-04-08 13:23:49 [44912.814803] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:49 [44912.821194] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.826542] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:49 [44912.832501] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:49 [44912.839412] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.844674] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.851151] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.856932] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.863409] kmpathd S ffff88012ce64f10 0 1449 2 0x00000000 2018-04-08 13:23:49 [44912.870892] Call Trace: 2018-04-08 13:23:49 [44912.873729] [] schedule+0x29/0x70 2018-04-08 13:23:49 [44912.879087] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:49 [44912.885130] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:49 [44912.891518] [] kthread+0xcf/0xe0 2018-04-08 13:23:49 [44912.896782] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.903260] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:49 [44912.909040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:49 [44912.915512] kmpath_handlerd S ffff88012ce65ee0 0 1450 2 0x00000000 2018-04-08 13:23:50 [44912.922988] Call Trace: 2018-04-08 13:23:50 [44912.925825] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44912.931176] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:50 [44912.937220] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:50 [44912.943610] [] kthread+0xcf/0xe0 2018-04-08 13:23:50 [44912.948874] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:50 [44912.955349] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:50 [44912.961128] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:50 [44912.967605] kworker/12:2 S ffff885ebd22dee0 0 2952 2 0x00000000 2018-04-08 13:23:50 [44912.975089] Call Trace: 2018-04-08 13:23:50 [44912.977926] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:50 [44912.984325] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44912.989682] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:50 [44912.995642] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:50 [44913.002558] [] kthread+0xcf/0xe0 2018-04-08 13:23:50 [44913.007830] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:50 [44913.014303] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:50 [44913.020083] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:50 [44913.026560] multipathd S ffff88012d3baf70 0 3103 1 0x00000000 2018-04-08 13:23:50 [44913.034038] Call Trace: 2018-04-08 13:23:50 [44913.036879] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.042229] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:23:50 [44913.048621] [] futex_wait+0x17b/0x280 2018-04-08 13:23:50 [44913.054325] [] do_futex+0x106/0x5a0 2018-04-08 13:23:50 [44913.059846] [] ? mntput+0x24/0x40 2018-04-08 13:23:50 [44913.065193] [] ? __fput+0x183/0x260 2018-04-08 13:23:50 [44913.070711] [] SyS_futex+0x80/0x180 2018-04-08 13:23:50 [44913.076225] [] ? task_work_run+0xac/0xf0 2018-04-08 13:23:50 [44913.082162] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.088533] multipathd S ffff88012d4f5ee0 0 3574 1 0x00000000 2018-04-08 13:23:50 [44913.095998] Call Trace: 2018-04-08 13:23:50 [44913.098820] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.104160] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:23:50 [44913.110545] [] futex_wait+0x17b/0x280 2018-04-08 13:23:50 [44913.116227] [] ? kern_path+0x60/0xb0 2018-04-08 13:23:50 [44913.121822] [] do_futex+0x106/0x5a0 2018-04-08 13:23:50 [44913.127324] [] SyS_futex+0x80/0x180 2018-04-08 13:23:50 [44913.132831] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.139199] multipathd S ffff88012d4f6eb0 0 3584 1 0x00000000 2018-04-08 13:23:50 [44913.146656] Call Trace: 2018-04-08 13:23:50 [44913.149479] [] ? __find_get_page+0x1e/0xa0 2018-04-08 13:23:50 [44913.155589] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.160920] [] schedule_timeout+0x239/0x2c0 2018-04-08 13:23:50 [44913.167119] [] ? __slab_free+0x81/0x2f0 2018-04-08 13:23:50 [44913.172972] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:23:50 [44913.179953] [] __skb_wait_for_more_packets+0x120/0x180 2018-04-08 13:23:50 [44913.187102] [] ? datagram_poll+0x100/0x100 2018-04-08 13:23:50 [44913.193210] [] __skb_recv_datagram+0x6f/0xd0 2018-04-08 13:23:50 [44913.199494] [] skb_recv_datagram+0x43/0x60 2018-04-08 13:23:50 [44913.205600] [] netlink_recvmsg+0x62/0x450 2018-04-08 13:23:50 [44913.211623] [] sock_recvmsg+0xbf/0x100 2018-04-08 13:23:50 [44913.217381] [] ? enqueue_pushable_task+0x6d/0x90 2018-04-08 13:23:50 [44913.224004] [] ? enqueue_task_rt+0x82/0x100 2018-04-08 13:23:50 [44913.230196] [] ___sys_recvmsg+0x11e/0x2b0 2018-04-08 13:23:50 [44913.236219] [] ? do_futex+0x17a/0x5a0 2018-04-08 13:23:50 [44913.241888] [] __sys_recvmsg+0x51/0x90 2018-04-08 13:23:50 [44913.247642] [] SyS_recvmsg+0x12/0x20 2018-04-08 13:23:50 [44913.253222] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.259573] multipathd S ffff885ebbc29fa0 0 3585 1 0x00000000 2018-04-08 13:23:50 [44913.267015] Call Trace: 2018-04-08 13:23:50 [44913.269823] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:50 [44913.276708] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.282027] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:50 [44913.289346] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:50 [44913.295449] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:50 [44913.302940] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:50 [44913.309654] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:50 [44913.316099] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:23:50 [44913.321857] [] ? mutex_lock_interruptible+0x12/0x3c 2018-04-08 13:23:50 [44913.328744] [] ? unix_stream_read_generic+0x6d2/0x8d0 2018-04-08 13:23:50 [44913.335801] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:50 [44913.343029] [] ? __slab_free+0x81/0x2f0 2018-04-08 13:23:50 [44913.348876] [] ? unix_state_double_lock+0x70/0x70 2018-04-08 13:23:50 [44913.355598] [] ? sock_aio_read.part.7+0x146/0x160 2018-04-08 13:23:50 [44913.362320] [] ? __inode_wait_for_writeback+0x7a/0xf0 2018-04-08 13:23:50 [44913.369390] [] ? fsnotify_destroy_marks+0x6e/0x90 2018-04-08 13:23:50 [44913.376118] [] ? sock_destroy_inode+0x2f/0x40 2018-04-08 13:23:50 [44913.382495] [] ? destroy_inode+0x38/0x60 2018-04-08 13:23:50 [44913.388432] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:50 [44913.394717] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:50 [44913.401086] [] SyS_ppoll+0xce/0x1d0 2018-04-08 13:23:50 [44913.406592] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.412959] multipathd S 0000000000000000 0 4257 1 0x00000000 2018-04-08 13:23:50 [44913.420427] Call Trace: 2018-04-08 13:23:50 [44913.423261] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.428629] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:50 [44913.435180] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:50 [44913.440607] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:50 [44913.446815] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:50 [44913.452937] [] ? security_capable+0x18/0x20 2018-04-08 13:23:50 [44913.459142] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:50 [44913.465789] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:50 [44913.472175] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:50 [44913.478636] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:50 [44913.484488] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:50 [44913.490775] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:50 [44913.497155] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:50 [44913.502570] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.508946] multipathd S ffff88606cc6eeb0 0 4258 1 0x00000000 2018-04-08 13:23:50 [44913.516413] Call Trace: 2018-04-08 13:23:50 [44913.519244] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.524588] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:50 [44913.531141] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:50 [44913.536570] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:50 [44913.542783] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:50 [44913.548911] [] ? security_capable+0x18/0x20 2018-04-08 13:23:50 [44913.555124] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:50 [44913.561770] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:50 [44913.568147] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:50 [44913.574611] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:50 [44913.580470] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:50 [44913.586756] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:50 [44913.593125] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:50 [44913.598542] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.604905] multipathd S ffff88606cc6af70 0 4259 1 0x00000000 2018-04-08 13:23:50 [44913.612362] Call Trace: 2018-04-08 13:23:50 [44913.615186] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.620530] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:50 [44913.627082] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:50 [44913.632496] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:50 [44913.638701] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:50 [44913.644810] [] ? security_capable+0x18/0x20 2018-04-08 13:23:50 [44913.651010] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:50 [44913.657639] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:50 [44913.664016] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:50 [44913.670474] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:50 [44913.676328] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:50 [44913.682614] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:50 [44913.688986] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:50 [44913.694404] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.700764] multipathd S ffff88606cc6bf40 0 4260 1 0x00000000 2018-04-08 13:23:50 [44913.708217] Call Trace: 2018-04-08 13:23:50 [44913.711031] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.716366] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:50 [44913.722908] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:50 [44913.728321] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:50 [44913.734513] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:50 [44913.740626] [] ? security_capable+0x18/0x20 2018-04-08 13:23:50 [44913.746825] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:50 [44913.753459] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:50 [44913.759833] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:50 [44913.766285] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:50 [44913.772129] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:50 [44913.778417] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:50 [44913.784788] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:50 [44913.790206] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.796566] multipathd S ffff88606cc6cf10 0 4264 1 0x00000000 2018-04-08 13:23:50 [44913.804022] Call Trace: 2018-04-08 13:23:50 [44913.806838] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.812167] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:50 [44913.818704] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:50 [44913.824123] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:50 [44913.830315] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:50 [44913.836428] [] ? security_capable+0x18/0x20 2018-04-08 13:23:50 [44913.842628] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:50 [44913.849264] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:50 [44913.855630] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:50 [44913.862089] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:50 [44913.867938] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:50 [44913.874220] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:50 [44913.880590] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:50 [44913.886010] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:50 [44913.892375] multipathd S 0000000000000004 0 4265 1 0x00000000 2018-04-08 13:23:50 [44913.899832] Call Trace: 2018-04-08 13:23:50 [44913.902643] [] schedule+0x29/0x70 2018-04-08 13:23:50 [44913.907970] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44913.914514] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44913.919932] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44913.926129] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44913.932237] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44913.938430] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44913.945061] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44913.951434] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44913.957889] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44913.963742] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44913.970027] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44913.976395] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44913.981811] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44913.988171] multipathd S 0000000000000008 0 4266 1 0x00000000 2018-04-08 13:23:51 [44913.995625] Call Trace: 2018-04-08 13:23:51 [44913.998438] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.003772] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.010316] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.015739] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.021936] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.028039] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.034232] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.040863] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.047238] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.053694] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.059543] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.065822] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.072193] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.077615] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.083984] multipathd S 000000000000000a 0 4267 1 0x00000000 2018-04-08 13:23:51 [44914.091428] Call Trace: 2018-04-08 13:23:51 [44914.094241] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.099574] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.106110] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.111529] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.117724] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.123834] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.130035] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.136669] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.143039] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.149496] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.155346] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.161624] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.167999] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.173416] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.179776] multipathd S 000000000000000c 0 4269 1 0x00000000 2018-04-08 13:23:51 [44914.187229] Call Trace: 2018-04-08 13:23:51 [44914.190044] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.195377] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.201922] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.207340] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.213535] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.219644] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.225837] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.232470] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.238843] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.245296] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.251148] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.257430] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.263802] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.269217] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.275578] multipathd S 000000000000000e 0 4271 1 0x00000000 2018-04-08 13:23:51 [44914.283032] Call Trace: 2018-04-08 13:23:51 [44914.285847] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.291181] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.297722] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.303133] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.309329] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.315439] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.321638] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.328270] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.334644] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.341100] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.346950] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.353230] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.359603] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.365019] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.371380] multipathd S 0000000000000001 0 4273 1 0x00000000 2018-04-08 13:23:51 [44914.378834] Call Trace: 2018-04-08 13:23:51 [44914.381650] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.386981] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.393526] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.398945] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.405138] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.411248] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.417441] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.424071] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.430447] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.436901] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.442752] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.449030] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.455393] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.460806] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.467172] multipathd S ffff88012d4f0fd0 0 4274 1 0x00000000 2018-04-08 13:23:51 [44914.474626] Call Trace: 2018-04-08 13:23:51 [44914.477441] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:51 [44914.484333] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.489666] [] do_nanosleep+0x86/0xf0 2018-04-08 13:23:51 [44914.495346] [] hrtimer_nanosleep+0xbb/0x180 2018-04-08 13:23:51 [44914.501543] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:51 [44914.507649] [] ? do_nanosleep+0x72/0xf0 2018-04-08 13:23:51 [44914.513500] [] SyS_nanosleep+0x7e/0x90 2018-04-08 13:23:51 [44914.519254] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.525623] multipathd S ffff88012d450fd0 0 4275 1 0x00000000 2018-04-08 13:23:51 [44914.533090] Call Trace: 2018-04-08 13:23:51 [44914.535910] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.541250] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:23:51 [44914.547626] [] futex_wait+0x17b/0x280 2018-04-08 13:23:51 [44914.553312] [] ? mntput+0x24/0x40 2018-04-08 13:23:51 [44914.558639] [] ? path_openat+0x166/0x490 2018-04-08 13:23:51 [44914.564567] [] do_futex+0x106/0x5a0 2018-04-08 13:23:51 [44914.570062] [] ? lockref_put_or_lock+0x48/0x80 2018-04-08 13:23:51 [44914.576516] [] ? mntput+0x24/0x40 2018-04-08 13:23:51 [44914.581835] [] ? __fput+0x183/0x260 2018-04-08 13:23:51 [44914.587325] [] SyS_futex+0x80/0x180 2018-04-08 13:23:51 [44914.592815] [] ? task_work_run+0xac/0xf0 2018-04-08 13:23:51 [44914.598737] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.605088] multipathd S 0000000000000000 0 9264 1 0x00000000 2018-04-08 13:23:51 [44914.612539] Call Trace: 2018-04-08 13:23:51 [44914.615354] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.620681] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.627221] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.632636] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.638830] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.644939] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.651127] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.657749] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.664111] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.670560] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.676400] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.682669] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.689023] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.694424] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.700780] multipathd S 0000000000000000 0 9320 1 0x00000000 2018-04-08 13:23:51 [44914.708227] Call Trace: 2018-04-08 13:23:51 [44914.711043] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.716369] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.722904] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.728318] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.734509] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.740619] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.746810] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.753430] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.759790] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.766234] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.772071] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.778338] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.784693] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.790099] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.796453] multipathd S ffff885e9c882f70 0 9395 1 0x00000000 2018-04-08 13:23:51 [44914.803902] Call Trace: 2018-04-08 13:23:51 [44914.806711] [] schedule+0x29/0x70 2018-04-08 13:23:51 [44914.812034] [] dm_wait_event+0xa1/0xf0 [dm_mod] 2018-04-08 13:23:51 [44914.818560] [] ? strlcpy+0x42/0x60 2018-04-08 13:23:51 [44914.823962] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:51 [44914.830150] [] dev_wait+0x4d/0xd0 [dm_mod] 2018-04-08 13:23:51 [44914.836252] [] ? security_capable+0x18/0x20 2018-04-08 13:23:51 [44914.842449] [] ? table_deps+0x1a0/0x1a0 [dm_mod] 2018-04-08 13:23:51 [44914.849069] [] ctl_ioctl+0x1e5/0x500 [dm_mod] 2018-04-08 13:23:51 [44914.855434] [] dm_ctl_ioctl+0x13/0x20 [dm_mod] 2018-04-08 13:23:51 [44914.861880] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:51 [44914.867728] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:51 [44914.874006] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:51 [44914.880380] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:51 [44914.885796] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:51 [44914.892155] kvm-irqfd-clean S 0000000000000004 0 3561 2 0x00000000 2018-04-08 13:23:51 [44914.899614] Call Trace: 2018-04-08 13:23:51 [44914.902435] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44914.907764] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44914.913784] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44914.920146] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44914.925384] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44914.931833] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44914.937591] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44914.944044] spl_system_task S ffff88012d6adee0 0 3582 2 0x00000000 2018-04-08 13:23:52 [44914.951509] Call Trace: 2018-04-08 13:23:52 [44914.954333] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44914.959679] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:52 [44914.966056] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:52 [44914.972010] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:52 [44914.978906] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44914.984155] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44914.990617] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44914.996386] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.002848] spl_delay_taskq S 0000000000000004 0 3610 2 0x00000000 2018-04-08 13:23:52 [44915.010304] Call Trace: 2018-04-08 13:23:52 [44915.013138] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.018479] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:52 [44915.024858] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:52 [44915.030810] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:52 [44915.037710] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.042964] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.049433] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.055209] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.061675] spl_dynamic_tas S ffff885ea3a85ee0 0 3615 2 0x00000000 2018-04-08 13:23:52 [44915.069150] Call Trace: 2018-04-08 13:23:52 [44915.071991] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.077350] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:52 [44915.083735] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:52 [44915.089698] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:52 [44915.096608] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.101872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.108349] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.114131] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.120610] spl_kmem_cache S ffff885ea3a86eb0 0 3644 2 0x00000000 2018-04-08 13:23:52 [44915.128084] Call Trace: 2018-04-08 13:23:52 [44915.130932] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.136291] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:52 [44915.142690] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:52 [44915.148658] [] ? __spl_cache_grow+0x2c0/0x2c0 [spl] 2018-04-08 13:23:52 [44915.155575] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:52 [44915.162491] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.167765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.174245] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.180033] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.186510] kdmflush S ffff88beb7aaaf70 0 3746 2 0x00000000 2018-04-08 13:23:52 [44915.193996] Call Trace: 2018-04-08 13:23:52 [44915.196843] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.202210] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.208263] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.214668] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.219939] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.226423] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.232210] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.238688] bioset S ffff88beb7aa8fd0 0 4005 2 0x00000000 2018-04-08 13:23:52 [44915.246169] Call Trace: 2018-04-08 13:23:52 [44915.249017] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.254371] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.260426] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.266822] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.272093] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.278574] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.284358] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.290831] kdmwork-253:0 S ffff885ea3a81fa0 0 4007 2 0x00000000 2018-04-08 13:23:52 [44915.298313] Call Trace: 2018-04-08 13:23:52 [44915.301157] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.306511] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:52 [44915.312728] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:52 [44915.318606] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.323866] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.330344] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.336125] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.342601] kdmflush S ffff885ea3a82f70 0 4019 2 0x00000000 2018-04-08 13:23:52 [44915.350081] Call Trace: 2018-04-08 13:23:52 [44915.352920] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.358268] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.364309] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.370697] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.375960] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.382431] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.388213] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.394689] lvmetad S ffff88012dbfaf70 0 4144 1 0x00000000 2018-04-08 13:23:52 [44915.402159] Call Trace: 2018-04-08 13:23:52 [44915.404999] [] ? __find_get_page+0x1e/0xa0 2018-04-08 13:23:52 [44915.411125] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.416475] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:52 [44915.423897] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:23:52 [44915.429941] [] ? __pollwait+0x7f/0xf0 2018-04-08 13:23:52 [44915.435633] [] ? list_del+0xd/0x30 2018-04-08 13:23:52 [44915.441060] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:52 [44915.447791] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:52 [44915.454265] [] do_select+0x6d1/0x7c0 2018-04-08 13:23:52 [44915.459869] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:52 [44915.467122] [] ? __inc_zone_page_state+0x32/0x60 2018-04-08 13:23:52 [44915.473767] [] ? shmem_add_to_page_cache.isra.23+0xd0/0x120 2018-04-08 13:23:52 [44915.481361] [] ? shmem_getpage_gfp.isra.26+0x6ca/0x880 2018-04-08 13:23:52 [44915.488527] [] ? radix_tree_lookup_slot+0x22/0x50 2018-04-08 13:23:52 [44915.495256] [] ? __find_get_page+0x1e/0xa0 2018-04-08 13:23:52 [44915.501383] [] ? __find_lock_page+0x30/0x70 2018-04-08 13:23:52 [44915.507590] [] ? shmem_getpage_gfp.isra.26+0xed/0x880 2018-04-08 13:23:52 [44915.514666] [] ? shmem_fault+0x8d/0x1f0 2018-04-08 13:23:52 [44915.520532] [] core_sys_select+0x1db/0x300 2018-04-08 13:23:52 [44915.526650] [] ? handle_mm_fault+0x691/0xfa0 2018-04-08 13:23:52 [44915.532943] [] ? enqueue_task+0x51/0x80 2018-04-08 13:23:52 [44915.538801] [] ? check_preempt_curr+0x78/0xa0 2018-04-08 13:23:52 [44915.545172] [] SyS_select+0xba/0x110 2018-04-08 13:23:52 [44915.550765] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:52 [44915.557136] bioset S ffff885ea3a84f10 0 4147 2 0x00000000 2018-04-08 13:23:52 [44915.564607] Call Trace: 2018-04-08 13:23:52 [44915.567434] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.572776] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.578804] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.585175] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.590420] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.596881] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.602648] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.609106] kdmwork-253:1 S ffff88be66371fa0 0 4149 2 0x00000000 2018-04-08 13:23:52 [44915.616574] Call Trace: 2018-04-08 13:23:52 [44915.619404] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.624745] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:52 [44915.630950] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:52 [44915.636808] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.642052] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.648515] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.654279] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.660742] kdmflush S ffff88be66375ee0 0 4157 2 0x00000000 2018-04-08 13:23:52 [44915.668214] Call Trace: 2018-04-08 13:23:52 [44915.671045] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.676383] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.682414] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.688783] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.694027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.700488] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.706257] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.712712] bioset S ffff88be66374f10 0 4163 2 0x00000000 2018-04-08 13:23:52 [44915.720180] Call Trace: 2018-04-08 13:23:52 [44915.723012] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.728353] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.734386] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.740765] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.746017] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.752479] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.758249] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.764708] kdmwork-253:2 S ffff88012da24f10 0 4165 2 0x00000000 2018-04-08 13:23:52 [44915.772175] Call Trace: 2018-04-08 13:23:52 [44915.775008] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.780346] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:52 [44915.786555] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:52 [44915.792414] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.797670] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.804141] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.809914] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.816385] kdmflush S ffff88012da23f40 0 4172 2 0x00000000 2018-04-08 13:23:52 [44915.823859] Call Trace: 2018-04-08 13:23:52 [44915.826696] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.832042] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.838074] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.844456] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.849710] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.856180] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:52 [44915.861951] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:52 [44915.868426] bioset S ffff88012da20fd0 0 4175 2 0x00000000 2018-04-08 13:23:52 [44915.875907] Call Trace: 2018-04-08 13:23:52 [44915.878742] [] schedule+0x29/0x70 2018-04-08 13:23:52 [44915.884089] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:52 [44915.890122] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:52 [44915.896502] [] kthread+0xcf/0xe0 2018-04-08 13:23:52 [44915.901758] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44915.908228] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44915.914001] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44915.920471] kdmwork-253:3 S ffff88012da20000 0 4176 2 0x00000000 2018-04-08 13:23:53 [44915.927944] Call Trace: 2018-04-08 13:23:53 [44915.930782] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44915.936125] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44915.942335] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44915.948193] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44915.953449] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44915.959918] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44915.965695] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44915.972160] kdmflush S ffff88012dbf9fa0 0 4183 2 0x00000000 2018-04-08 13:23:53 [44915.979636] Call Trace: 2018-04-08 13:23:53 [44915.982473] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44915.987818] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44915.993852] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.000234] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.005487] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.011956] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.017731] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.024201] bioset S ffff88012dbf8fd0 0 4185 2 0x00000000 2018-04-08 13:23:53 [44916.031676] Call Trace: 2018-04-08 13:23:53 [44916.034511] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.039858] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.045890] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.052268] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.057523] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.063991] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.069770] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.076238] kdmwork-253:4 S ffff88012dbfbf40 0 4186 2 0x00000000 2018-04-08 13:23:53 [44916.083710] Call Trace: 2018-04-08 13:23:53 [44916.086545] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.091885] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44916.098094] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44916.103952] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.109208] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.115678] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.121454] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.127920] kdmflush S ffff885ea5f68000 0 4194 2 0x00000000 2018-04-08 13:23:53 [44916.135396] Call Trace: 2018-04-08 13:23:53 [44916.138234] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.143581] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.149612] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.155991] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.161245] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.167716] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.173489] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.179957] bioset S ffff885ea5f6dee0 0 4197 2 0x00000000 2018-04-08 13:23:53 [44916.187432] Call Trace: 2018-04-08 13:23:53 [44916.190270] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.195616] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.201650] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.208029] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.213282] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.219756] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.225530] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.231997] kdmwork-253:5 S ffff885ea5f6eeb0 0 4198 2 0x00000000 2018-04-08 13:23:53 [44916.239471] Call Trace: 2018-04-08 13:23:53 [44916.242312] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.247657] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44916.253861] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44916.259723] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.264975] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.271453] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.277228] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.283695] kdmflush S ffff885ea5f69fa0 0 4204 2 0x00000000 2018-04-08 13:23:53 [44916.291171] Call Trace: 2018-04-08 13:23:53 [44916.294010] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.299356] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.305390] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.311770] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.317023] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.323492] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.329269] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.335736] bioset S ffff885ea5f68fd0 0 4206 2 0x00000000 2018-04-08 13:23:53 [44916.343211] Call Trace: 2018-04-08 13:23:53 [44916.346048] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.351393] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.357428] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.363805] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.369061] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.375530] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.381304] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.387774] kdmwork-253:6 S ffff885ea5f6cf10 0 4209 2 0x00000000 2018-04-08 13:23:53 [44916.395249] Call Trace: 2018-04-08 13:23:53 [44916.398088] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.403433] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44916.409640] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44916.415499] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.420754] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.427227] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.433007] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.439473] kdmflush S ffff885ea5f6bf40 0 4213 2 0x00000000 2018-04-08 13:23:53 [44916.446950] Call Trace: 2018-04-08 13:23:53 [44916.449789] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.455130] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.461165] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.467546] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.472799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.479267] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.485042] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.491510] bioset S ffff885ea5f6af70 0 4217 2 0x00000000 2018-04-08 13:23:53 [44916.498988] Call Trace: 2018-04-08 13:23:53 [44916.501825] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.507169] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.513204] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.519584] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.524836] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.531304] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.537082] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.543550] kdmwork-253:7 S ffff88bebd3fdee0 0 4218 2 0x00000000 2018-04-08 13:23:53 [44916.551025] Call Trace: 2018-04-08 13:23:53 [44916.553867] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.559209] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44916.565415] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44916.571275] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.576531] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.583003] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.588774] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.595241] kdmflush S ffff88bebd3fbf40 0 4227 2 0x00000000 2018-04-08 13:23:53 [44916.602717] Call Trace: 2018-04-08 13:23:53 [44916.605557] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.610899] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.616934] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.623313] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.628566] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.635037] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.640812] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.647280] bioset S ffff88bebd3f8fd0 0 4229 2 0x00000000 2018-04-08 13:23:53 [44916.654755] Call Trace: 2018-04-08 13:23:53 [44916.657593] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.662937] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.668973] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.675351] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.680605] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.687075] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.692850] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.699319] kdmwork-253:8 S ffff88bebd3fcf10 0 4230 2 0x00000000 2018-04-08 13:23:53 [44916.706791] Call Trace: 2018-04-08 13:23:53 [44916.709623] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.714968] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44916.721176] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44916.727035] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.732289] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.738757] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.744533] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.751000] kdmflush S ffff88bebd3faf70 0 4237 2 0x00000000 2018-04-08 13:23:53 [44916.758479] Call Trace: 2018-04-08 13:23:53 [44916.761314] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.766660] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.772694] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.779074] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.784328] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.790796] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.796573] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.803041] bioset S ffff88bebd3f9fa0 0 4238 2 0x00000000 2018-04-08 13:23:53 [44916.810515] Call Trace: 2018-04-08 13:23:53 [44916.813355] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.818698] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:53 [44916.824734] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:53 [44916.831111] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.836365] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.842838] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.848612] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.855080] kdmwork-253:9 S ffff88bebd3feeb0 0 4239 2 0x00000000 2018-04-08 13:23:53 [44916.862553] Call Trace: 2018-04-08 13:23:53 [44916.865394] [] schedule+0x29/0x70 2018-04-08 13:23:53 [44916.870735] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:53 [44916.876942] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:53 [44916.882803] [] kthread+0xcf/0xe0 2018-04-08 13:23:53 [44916.888060] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:53 [44916.894528] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:53 [44916.900301] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44916.906770] kworker/10:1H S ffff885eb590dee0 0 4241 2 0x00000000 2018-04-08 13:23:54 [44916.914245] Call Trace: 2018-04-08 13:23:54 [44916.917084] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44916.923472] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44916.928815] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44916.934764] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44916.941665] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44916.946923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44916.953388] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44916.959167] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44916.965642] kdmflush S ffff885eb590eeb0 0 4248 2 0x00000000 2018-04-08 13:23:54 [44916.973124] Call Trace: 2018-04-08 13:23:54 [44916.975961] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44916.981307] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44916.987339] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44916.993721] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44916.998975] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.005444] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.011222] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.017697] bioset S ffff885eb590cf10 0 4252 2 0x00000000 2018-04-08 13:23:54 [44917.025173] Call Trace: 2018-04-08 13:23:54 [44917.028006] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.033356] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44917.039399] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44917.045786] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.051041] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.057509] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.063286] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.069761] kdmwork-253:10 S ffff885ea4b93f40 0 4254 2 0x00000000 2018-04-08 13:23:54 [44917.077235] Call Trace: 2018-04-08 13:23:54 [44917.080069] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.085417] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:54 [44917.091627] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:54 [44917.097497] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.102761] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.109229] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.115009] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.121478] kworker/3:2 S ffff88beb7a3af70 0 4256 2 0x00000000 2018-04-08 13:23:54 [44917.128955] Call Trace: 2018-04-08 13:23:54 [44917.131789] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.138175] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.143524] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.149474] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.156383] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.161648] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.168125] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.173909] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.180383] ttm_swap S ffff88012cc3bf40 0 4461 2 0x00000000 2018-04-08 13:23:54 [44917.187865] Call Trace: 2018-04-08 13:23:54 [44917.190702] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.196046] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44917.202082] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44917.208473] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.213736] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.220201] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.225978] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.232444] kworker/13:1H S ffff88bebbb90000 0 6111 2 0x00000000 2018-04-08 13:23:54 [44917.239920] Call Trace: 2018-04-08 13:23:54 [44917.242758] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.249140] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.254482] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.260433] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.267342] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.272604] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.279074] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.284858] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.291334] kworker/15:1H S ffff88bebbb90fd0 0 6112 2 0x00000000 2018-04-08 13:23:54 [44917.298814] Call Trace: 2018-04-08 13:23:54 [44917.301650] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.308039] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.313392] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.319346] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.326255] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.331520] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.337997] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.343779] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.350252] kworker/4:1H S ffff885eba56af70 0 6116 2 0x00000000 2018-04-08 13:23:54 [44917.357733] Call Trace: 2018-04-08 13:23:54 [44917.360573] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.366961] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.372314] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.378279] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.385189] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.390461] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.396937] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.402717] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.409192] kworker/5:1H S ffff88beba830000 0 6146 2 0x00000000 2018-04-08 13:23:54 [44917.416675] Call Trace: 2018-04-08 13:23:54 [44917.419512] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.425910] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.431268] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.437227] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.444142] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.449415] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.455894] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.461680] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.468152] kworker/7:1H S ffff88beba830fd0 0 6162 2 0x00000000 2018-04-08 13:23:54 [44917.475631] Call Trace: 2018-04-08 13:23:54 [44917.478476] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.484875] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.490236] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.496199] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.503118] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.508388] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.514873] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.520660] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.527134] kworker/6:11 S ffff885ea3685ee0 0 6624 2 0x00000000 2018-04-08 13:23:54 [44917.534620] Call Trace: 2018-04-08 13:23:54 [44917.537468] [] ? start_worker+0x27/0x30 2018-04-08 13:23:54 [44917.543345] [] ? manage_workers.isra.24+0x189/0x2a0 2018-04-08 13:23:54 [44917.550263] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.555622] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.561589] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.568507] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.573775] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.580250] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.586038] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.592515] kworker/10:4 S ffff885ebd804f10 0 6846 2 0x00000000 2018-04-08 13:23:54 [44917.599998] Call Trace: 2018-04-08 13:23:54 [44917.602848] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.609247] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.614602] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.620568] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.627486] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.632755] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.639227] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.645008] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.651486] kworker/8:4 S ffff885ebd9bdee0 0 7062 2 0x00000000 2018-04-08 13:23:54 [44917.658973] Call Trace: 2018-04-08 13:23:54 [44917.661817] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:54 [44917.668215] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.673575] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:54 [44917.679541] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:54 [44917.686461] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.691726] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.698201] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.703982] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.710458] kdmflush S ffff885ebcf83f40 0 7784 2 0x00000000 2018-04-08 13:23:54 [44917.717943] Call Trace: 2018-04-08 13:23:54 [44917.720789] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.726147] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44917.732198] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44917.738596] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.743868] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.750342] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.756124] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.762596] bioset S ffff885ebcf84f10 0 7787 2 0x00000000 2018-04-08 13:23:54 [44917.770080] Call Trace: 2018-04-08 13:23:54 [44917.772920] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.778277] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44917.784318] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44917.790709] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.795971] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.802452] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.808227] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.814701] kdmflush S ffff885ebcf85ee0 0 7794 2 0x00000000 2018-04-08 13:23:54 [44917.822167] Call Trace: 2018-04-08 13:23:54 [44917.825006] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.830357] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44917.836399] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44917.842788] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.848050] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.854529] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:54 [44917.860313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:54 [44917.866787] bioset S ffff885ebcf86eb0 0 7799 2 0x00000000 2018-04-08 13:23:54 [44917.874269] Call Trace: 2018-04-08 13:23:54 [44917.877103] [] schedule+0x29/0x70 2018-04-08 13:23:54 [44917.882449] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:54 [44917.888486] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:54 [44917.894874] [] kthread+0xcf/0xe0 2018-04-08 13:23:54 [44917.900139] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44917.906616] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44917.912399] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44917.918876] kdmflush S ffff885ebcc40000 0 7813 2 0x00000000 2018-04-08 13:23:55 [44917.926360] Call Trace: 2018-04-08 13:23:55 [44917.929194] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44917.934538] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44917.940573] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44917.946952] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44917.952206] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44917.958677] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44917.964449] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44917.970917] bioset S ffff885ebcc40fd0 0 7815 2 0x00000000 2018-04-08 13:23:55 [44917.978393] Call Trace: 2018-04-08 13:23:55 [44917.981231] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44917.986576] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44917.992612] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44917.998989] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.004242] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.010716] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.016498] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.022965] kworker/11:1H S ffff88be61740000 0 7860 2 0x00000000 2018-04-08 13:23:55 [44918.030433] Call Trace: 2018-04-08 13:23:55 [44918.033272] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:55 [44918.039660] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.045005] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:55 [44918.050953] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:55 [44918.057861] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.063125] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.069594] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.075380] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.081852] kworker/9:1H S ffff88be61742f70 0 8178 2 0x00000000 2018-04-08 13:23:55 [44918.089330] Call Trace: 2018-04-08 13:23:55 [44918.092163] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:55 [44918.098550] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.103898] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:55 [44918.109850] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:55 [44918.116760] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.122026] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.128501] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.134282] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.140760] zvol S ffff88012cb96eb0 0 8230 2 0x00000000 2018-04-08 13:23:55 [44918.148237] Call Trace: 2018-04-08 13:23:55 [44918.151077] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.156435] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:55 [44918.162824] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:55 [44918.168784] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:55 [44918.175691] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.180954] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.187433] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.193221] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.199694] kworker/0:3 S ffff885e9cc9bf40 0 8476 2 0x00000000 2018-04-08 13:23:55 [44918.207179] Call Trace: 2018-04-08 13:23:55 [44918.210024] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:55 [44918.216424] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.221782] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:55 [44918.227748] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:55 [44918.234664] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.239937] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.246416] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.252203] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.258677] arc_prune S ffff885e9c8e2f70 0 8666 2 0x00000000 2018-04-08 13:23:55 [44918.266160] Call Trace: 2018-04-08 13:23:55 [44918.269011] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.274370] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:55 [44918.280768] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:55 [44918.286737] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:55 [44918.293661] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.298931] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.305413] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.311203] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.317676] arc_reclaim S ffff885e9c8e3f40 0 8667 2 0x00000000 2018-04-08 13:23:55 [44918.325160] Call Trace: 2018-04-08 13:23:55 [44918.328012] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:55 [44918.334935] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.340295] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:55 [44918.347646] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:55 [44918.353792] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:55 [44918.361329] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:55 [44918.368078] [] cv_timedwait_hires_common+0x132/0x230 [spl] 2018-04-08 13:23:55 [44918.375608] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:55 [44918.381844] [] cv_timedwait_sig_hires+0x14/0x20 [spl] 2018-04-08 13:23:55 [44918.388979] [] arc_reclaim_thread+0x145/0x290 [zfs] 2018-04-08 13:23:55 [44918.395937] [] ? arc_shrink+0xc0/0xc0 [zfs] 2018-04-08 13:23:55 [44918.402171] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:23:55 [44918.409270] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:23:55 [44918.415761] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.421041] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.427539] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.433340] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.439835] kworker/0:23 S ffff88012ca5dee0 0 8770 2 0x00000000 2018-04-08 13:23:55 [44918.447327] Call Trace: 2018-04-08 13:23:55 [44918.450181] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:55 [44918.456588] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.461954] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:55 [44918.467926] [] ? __kthread_parkme+0x64/0x80 2018-04-08 13:23:55 [44918.474161] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:55 [44918.481087] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.486368] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.492859] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.498658] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.505146] bioset S ffff885e9c8e1fa0 0 8850 2 0x00000000 2018-04-08 13:23:55 [44918.512641] Call Trace: 2018-04-08 13:23:55 [44918.515498] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.520861] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.526926] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.533332] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.538609] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.545094] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.550892] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.557374] xfsalloc S ffff885e9c8e0fd0 0 8851 2 0x00000000 2018-04-08 13:23:55 [44918.564871] Call Trace: 2018-04-08 13:23:55 [44918.567723] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.573089] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.579147] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.585545] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.590819] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.597303] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.603094] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.609576] xfs_mru_cache S ffff885e9c8e0000 0 8852 2 0x00000000 2018-04-08 13:23:55 [44918.617067] Call Trace: 2018-04-08 13:23:55 [44918.619911] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.625267] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.631320] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.637715] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.642988] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.649461] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.655243] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.661718] xfs-buf/dm-13 S ffff885ebd802f70 0 8853 2 0x00000000 2018-04-08 13:23:55 [44918.669198] Call Trace: 2018-04-08 13:23:55 [44918.672038] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.677396] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.683435] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.689823] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.695089] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.701563] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.707348] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.713823] xfs-data/dm-13 S ffff885ebd801fa0 0 8854 2 0x00000000 2018-04-08 13:23:55 [44918.721303] Call Trace: 2018-04-08 13:23:55 [44918.724142] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.729487] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.735520] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.741906] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.747165] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.753635] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.759420] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.765894] xfs-conv/dm-13 S ffff885ebd800000 0 8855 2 0x00000000 2018-04-08 13:23:55 [44918.773370] Call Trace: 2018-04-08 13:23:55 [44918.776209] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.781561] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.787605] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.793992] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.799246] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.805718] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.811503] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.817976] xfs-cil/dm-13 S ffff885ebd800fd0 0 8856 2 0x00000000 2018-04-08 13:23:55 [44918.825462] Call Trace: 2018-04-08 13:23:55 [44918.828299] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.833654] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.839694] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.846081] [] kthread+0xcf/0xe0 2018-04-08 13:23:55 [44918.851336] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.857806] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:55 [44918.863587] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:55 [44918.870059] xfs-reclaim/dm- S ffff885eac918fd0 0 8857 2 0x00000000 2018-04-08 13:23:55 [44918.877542] Call Trace: 2018-04-08 13:23:55 [44918.880381] [] schedule+0x29/0x70 2018-04-08 13:23:55 [44918.885735] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:55 [44918.891774] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:55 [44918.898155] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44918.903411] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44918.909879] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44918.915662] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44918.922130] xfs-log/dm-13 S ffff885eac919fa0 0 8858 2 0x00000000 2018-04-08 13:23:56 [44918.929614] Call Trace: 2018-04-08 13:23:56 [44918.932453] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44918.937806] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:56 [44918.943850] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:56 [44918.950237] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44918.955498] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44918.961967] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44918.967743] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44918.974213] xfs-eofblocks/d S ffff885eac91cf10 0 8859 2 0x00000000 2018-04-08 13:23:56 [44918.981696] Call Trace: 2018-04-08 13:23:56 [44918.984535] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44918.989886] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:56 [44918.995928] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:56 [44919.002316] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44919.007575] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.014050] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44919.019836] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.026314] xfsaild/dm-13 S ffff885eac91af70 0 8860 2 0x00000000 2018-04-08 13:23:56 [44919.033794] Call Trace: 2018-04-08 13:23:56 [44919.036632] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:23:56 [44919.043139] [] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs] 2018-04-08 13:23:56 [44919.050740] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.056107] [] xfsaild+0x62f/0x6f0 [xfs] 2018-04-08 13:23:56 [44919.062065] [] ? __schedule+0x424/0x9b0 2018-04-08 13:23:56 [44919.067943] [] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs] 2018-04-08 13:23:56 [44919.075549] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44919.080823] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.087305] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44919.093097] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.099581] dbu_evict S ffff885eac91bf40 0 8861 2 0x00000000 2018-04-08 13:23:56 [44919.107070] Call Trace: 2018-04-08 13:23:56 [44919.109917] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.115278] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:56 [44919.121675] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:56 [44919.127663] [] ? dnode_destroy+0x210/0x210 [zfs] 2018-04-08 13:23:56 [44919.134325] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:56 [44919.141245] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44919.146523] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.153003] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44919.158796] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.165276] dbuf_evict S ffff885e9c8e5ee0 0 8862 2 0x00000000 2018-04-08 13:23:56 [44919.172763] Call Trace: 2018-04-08 13:23:56 [44919.175612] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:56 [44919.182541] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.187904] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:56 [44919.195268] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:56 [44919.201412] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:56 [44919.208947] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:56 [44919.215694] [] cv_timedwait_hires_common+0x132/0x230 [spl] 2018-04-08 13:23:56 [44919.223228] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:56 [44919.229464] [] cv_timedwait_sig_hires+0x14/0x20 [spl] 2018-04-08 13:23:56 [44919.236579] [] dbuf_evict_thread+0x7a/0x1d0 [zfs] 2018-04-08 13:23:56 [44919.243345] [] ? dbuf_evict_one+0xe0/0xe0 [zfs] 2018-04-08 13:23:56 [44919.249934] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:23:56 [44919.257042] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:23:56 [44919.263541] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44919.268825] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.275315] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44919.281117] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.287610] rpciod S ffff885eb9a13f40 0 8899 2 0x00000000 2018-04-08 13:23:56 [44919.295105] Call Trace: 2018-04-08 13:23:56 [44919.297968] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.303343] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:56 [44919.309411] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:56 [44919.315828] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44919.321113] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.327605] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44919.333405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.339894] xprtiod S ffff885eb9a15ee0 0 8900 2 0x00000000 2018-04-08 13:23:56 [44919.347378] Call Trace: 2018-04-08 13:23:56 [44919.350236] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.355607] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:56 [44919.361667] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:56 [44919.368068] [] kthread+0xcf/0xe0 2018-04-08 13:23:56 [44919.373342] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.379827] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:56 [44919.385622] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:56 [44919.392109] rsyslogd S ffff885e9ce6cf10 0 8904 1 0x00000000 2018-04-08 13:23:56 [44919.399598] Call Trace: 2018-04-08 13:23:56 [44919.402447] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:56 [44919.409375] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.414743] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:56 [44919.422106] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:56 [44919.428253] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:56 [44919.435787] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:56 [44919.442543] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:56 [44919.449038] [] do_select+0x6d1/0x7c0 2018-04-08 13:23:56 [44919.454669] [] ? __sb_start_write+0x58/0x110 2018-04-08 13:23:56 [44919.460986] [] ? ep_poll_callback+0xee/0x210 2018-04-08 13:23:56 [44919.467306] [] ? __wake_up_sync_key+0x4f/0x60 2018-04-08 13:23:56 [44919.473707] [] ? sock_def_readable+0x3a/0x70 2018-04-08 13:23:56 [44919.480018] [] ? unix_dgram_sendmsg+0x3c6/0x770 2018-04-08 13:23:56 [44919.486585] [] ? sock_sendmsg+0xb0/0xf0 2018-04-08 13:23:56 [44919.492462] [] core_sys_select+0x1db/0x300 2018-04-08 13:23:56 [44919.498591] [] ? __d_free+0x35/0x40 2018-04-08 13:23:56 [44919.504113] [] ? d_free+0x60/0x70 2018-04-08 13:23:56 [44919.509461] [] ? dentry_kill+0x154/0x1b0 2018-04-08 13:23:56 [44919.515405] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:23:56 [44919.521438] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:23:56 [44919.527465] [] SyS_select+0xba/0x110 2018-04-08 13:23:56 [44919.533059] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:56 [44919.539426] in:imjournal S ffff885e9d370fd0 0 8906 1 0x00000000 2018-04-08 13:23:56 [44919.546883] Call Trace: 2018-04-08 13:23:56 [44919.549708] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:56 [44919.556606] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.561948] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:56 [44919.569274] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:56 [44919.575392] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:56 [44919.582890] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:56 [44919.589616] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:56 [44919.596082] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:23:56 [44919.601857] [] ? inode_permission+0x18/0x50 2018-04-08 13:23:56 [44919.608055] [] ? radix_tree_lookup_slot+0x22/0x50 2018-04-08 13:23:56 [44919.614775] [] ? __find_get_page+0x1e/0xa0 2018-04-08 13:23:56 [44919.620894] [] ? __inode_wait_for_writeback+0x7a/0xf0 2018-04-08 13:23:56 [44919.627961] [] ? fsnotify_destroy_marks+0x6e/0x90 2018-04-08 13:23:56 [44919.634684] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:23:56 [44919.641314] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:56 [44919.648551] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:23:56 [44919.654668] [] ? try_to_wake_up+0x183/0x340 2018-04-08 13:23:56 [44919.660870] [] ? wake_up_q+0x5b/0x80 2018-04-08 13:23:56 [44919.666464] [] ? futex_wake_op+0x485/0x5f0 2018-04-08 13:23:56 [44919.672575] [] ? do_futex+0x17a/0x5a0 2018-04-08 13:23:56 [44919.678254] [] ? abort_exclusive_wait+0xa0/0xa0 2018-04-08 13:23:56 [44919.684798] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:23:56 [44919.690820] [] SyS_poll+0x74/0x110 2018-04-08 13:23:56 [44919.696229] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:56 [44919.702588] rs:main Q:Reg S ffff885e9c8b9fa0 0 8907 1 0x00000000 2018-04-08 13:23:56 [44919.710045] Call Trace: 2018-04-08 13:23:56 [44919.712859] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.718191] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:23:56 [44919.724553] [] futex_wait+0x17b/0x280 2018-04-08 13:23:56 [44919.730218] [] ? physflat_send_IPI_mask+0xe/0x10 2018-04-08 13:23:56 [44919.736835] [] do_futex+0x106/0x5a0 2018-04-08 13:23:56 [44919.742333] [] SyS_futex+0x80/0x180 2018-04-08 13:23:56 [44919.747827] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:56 [44919.754186] dbus-daemon S ffff885e9ce6bf40 0 8915 1 0x00000000 2018-04-08 13:23:56 [44919.761633] Call Trace: 2018-04-08 13:23:56 [44919.764448] [] ? ___sys_sendmsg+0x3a9/0x3c0 2018-04-08 13:23:56 [44919.770648] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.775976] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:56 [44919.783383] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 2018-04-08 13:23:56 [44919.790536] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:56 [44919.797257] [] ep_poll+0x23e/0x360 2018-04-08 13:23:56 [44919.802687] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:56 [44919.808636] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:56 [44919.814590] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:56 [44919.820970] zed S ffff88012cd58fd0 0 8932 1 0x00000000 2018-04-08 13:23:56 [44919.828443] Call Trace: 2018-04-08 13:23:56 [44919.831283] [] schedule+0x29/0x70 2018-04-08 13:23:56 [44919.836628] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:23:56 [44919.843179] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:56 [44919.849387] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:23:56 [44919.855701] [] zfs_zevent_wait+0x8a/0xa0 [zfs] 2018-04-08 13:23:56 [44919.862193] [] zfs_ioc_events_next+0x66/0xe0 [zfs] 2018-04-08 13:23:56 [44919.869018] [] zfsdev_ioctl+0x606/0x650 [zfs] 2018-04-08 13:23:56 [44919.875393] [] ? handle_mm_fault+0x70c/0xfa0 2018-04-08 13:23:56 [44919.881681] [] do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:56 [44919.887531] [] ? __do_page_fault+0x171/0x450 2018-04-08 13:23:56 [44919.893818] [] SyS_ioctl+0xa1/0xc0 2018-04-08 13:23:57 [44919.899239] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44919.905607] zed S ffff885ebbc1cf10 0 9141 1 0x00000000 2018-04-08 13:23:57 [44919.913075] Call Trace: 2018-04-08 13:23:57 [44919.915906] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44919.921247] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:23:57 [44919.927624] [] futex_wait+0x17b/0x280 2018-04-08 13:23:57 [44919.933311] [] ? get_futex_key+0x1c8/0x2c0 2018-04-08 13:23:57 [44919.939423] [] ? unlock_page+0x2b/0x30 2018-04-08 13:23:57 [44919.945191] [] do_futex+0x106/0x5a0 2018-04-08 13:23:57 [44919.950704] [] ? do_vfs_ioctl+0x33d/0x540 2018-04-08 13:23:57 [44919.956732] [] SyS_futex+0x80/0x180 2018-04-08 13:23:57 [44919.962238] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44919.968612] zed S ffff885ebbc19fa0 0 9142 1 0x00000000 2018-04-08 13:23:57 [44919.976076] Call Trace: 2018-04-08 13:23:57 [44919.978910] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44919.984253] [] schedule_timeout+0x239/0x2c0 2018-04-08 13:23:57 [44919.990450] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:23:57 [44919.997429] [] __skb_wait_for_more_packets+0x120/0x180 2018-04-08 13:23:57 [44920.004590] [] ? datagram_poll+0x100/0x100 2018-04-08 13:23:57 [44920.010712] [] __skb_recv_datagram+0x6f/0xd0 2018-04-08 13:23:57 [44920.017004] [] skb_recv_datagram+0x43/0x60 2018-04-08 13:23:57 [44920.023127] [] netlink_recvmsg+0x62/0x450 2018-04-08 13:23:57 [44920.029161] [] ? mutex_lock+0x12/0x2f 2018-04-08 13:23:57 [44920.034852] [] sock_recvmsg+0xbf/0x100 2018-04-08 13:23:57 [44920.040619] [] ? __enqueue_entity+0x78/0x80 2018-04-08 13:23:57 [44920.046816] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:23:57 [44920.053271] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:23:57 [44920.059385] [] ___sys_recvmsg+0x11e/0x2b0 2018-04-08 13:23:57 [44920.065409] [] ? do_futex+0x17a/0x5a0 2018-04-08 13:23:57 [44920.071089] [] ? lockref_put_or_lock+0x48/0x80 2018-04-08 13:23:57 [44920.077537] [] ? mntput+0x24/0x40 2018-04-08 13:23:57 [44920.082860] [] __sys_recvmsg+0x51/0x90 2018-04-08 13:23:57 [44920.088617] [] SyS_recvmsg+0x12/0x20 2018-04-08 13:23:57 [44920.094200] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.100565] rdma-ndd S ffff88012cd5af70 0 8950 1 0x00000000 2018-04-08 13:23:57 [44920.108019] Call Trace: 2018-04-08 13:23:57 [44920.110839] [] ? kiblnd_cm_callback+0xdf9/0x2370 [ko2iblnd] 2018-04-08 13:23:57 [44920.118418] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.123747] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:57 [44920.131154] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:23:57 [44920.137176] [] ? __pollwait+0x7f/0xf0 2018-04-08 13:23:57 [44920.142847] [] ? _raw_spin_unlock_bh+0x1e/0x20 2018-04-08 13:23:57 [44920.149297] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:57 [44920.156011] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:57 [44920.162468] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:23:57 [44920.168235] [] ? __mem_cgroup_uncharge_common+0xcd/0x2f0 2018-04-08 13:23:57 [44920.175559] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:57 [44920.182798] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:57 [44920.190027] [] ? free_pages_and_swap_cache+0xad/0xd0 2018-04-08 13:23:57 [44920.196994] [] ? tlb_flush_mmu.part.63+0x6c/0xc0 2018-04-08 13:23:57 [44920.203612] [] ? tlb_finish_mmu+0x55/0x60 2018-04-08 13:23:57 [44920.209627] [] ? unmap_region+0xf4/0x140 2018-04-08 13:23:57 [44920.215559] [] ? __vma_rb_erase+0x121/0x220 2018-04-08 13:23:57 [44920.221750] [] ? do_munmap+0x317/0x470 2018-04-08 13:23:57 [44920.227509] [] SyS_poll+0x74/0x110 2018-04-08 13:23:57 [44920.232916] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.239272] sshd S ffff88012cd5cf10 0 8954 1 0x00000000 2018-04-08 13:23:57 [44920.246724] Call Trace: 2018-04-08 13:23:57 [44920.249538] [] ? inode_permission+0x18/0x50 2018-04-08 13:23:57 [44920.255735] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.261066] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:57 [44920.268472] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:23:57 [44920.274493] [] ? __pollwait+0x7f/0xf0 2018-04-08 13:23:57 [44920.280166] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:57 [44920.286874] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:57 [44920.293324] [] do_select+0x6d1/0x7c0 2018-04-08 13:23:57 [44920.298906] [] ? __rmqueue+0x8a/0x460 2018-04-08 13:23:57 [44920.304576] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:57 [44920.311810] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:57 [44920.319039] [] ? __alloc_pages_nodemask+0x176/0x420 2018-04-08 13:23:57 [44920.325924] [] ? __mem_cgroup_commit_charge+0xe2/0x2f0 2018-04-08 13:23:57 [44920.333071] [] ? cpumask_any_but+0x39/0x50 2018-04-08 13:23:57 [44920.339181] [] ? flush_tlb_page+0x38/0xa0 2018-04-08 13:23:57 [44920.345196] [] ? lru_cache_add+0xe/0x10 2018-04-08 13:23:57 [44920.351041] [] ? page_add_new_anon_rmap+0xb8/0x170 2018-04-08 13:23:57 [44920.357838] [] core_sys_select+0x1db/0x300 2018-04-08 13:23:57 [44920.363940] [] ? kmem_cache_free+0x1e2/0x200 2018-04-08 13:23:57 [44920.370217] [] ? handle_mm_fault+0x70c/0xfa0 2018-04-08 13:23:57 [44920.376494] [] ? dentry_kill+0x154/0x1b0 2018-04-08 13:23:57 [44920.382425] [] SyS_select+0xba/0x110 2018-04-08 13:23:57 [44920.388010] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.394374] systemd-logind S ffff88012ca32f70 0 9036 1 0x00000000 2018-04-08 13:23:57 [44920.401827] Call Trace: 2018-04-08 13:23:57 [44920.404639] [] ? ___sys_sendmsg+0x3a9/0x3c0 2018-04-08 13:23:57 [44920.410835] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.416154] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:57 [44920.423558] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 2018-04-08 13:23:57 [44920.430701] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:57 [44920.437413] [] ep_poll+0x23e/0x360 2018-04-08 13:23:57 [44920.442821] [] ? do_timerfd_settime+0x285/0x340 2018-04-08 13:23:57 [44920.449358] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:57 [44920.455289] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:57 [44920.461220] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.467581] agetty S ffff88012ca30000 0 9048 1 0x00000000 2018-04-08 13:23:57 [44920.475036] Call Trace: 2018-04-08 13:23:57 [44920.477858] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.483193] [] schedule_timeout+0x239/0x2c0 2018-04-08 13:23:57 [44920.489393] [] ? get_work_pool+0x3e/0x70 2018-04-08 13:23:57 [44920.495333] [] ? flush_work+0x13b/0x190 2018-04-08 13:23:57 [44920.501188] [] ? serial8250_start_tx+0xab/0xd0 2018-04-08 13:23:57 [44920.507648] [] ? set_room+0x68/0xc0 2018-04-08 13:23:57 [44920.513151] [] n_tty_read+0x27c/0x930 2018-04-08 13:23:57 [44920.518832] [] ? ldsem_down_read+0x3b/0x220 2018-04-08 13:23:57 [44920.525029] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:57 [44920.530963] [] tty_read+0x8d/0x100 2018-04-08 13:23:57 [44920.536374] [] vfs_read+0x9c/0x170 2018-04-08 13:23:57 [44920.541778] [] SyS_read+0x7f/0xe0 2018-04-08 13:23:57 [44920.547094] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.553448] agetty S ffff88012cf49fa0 0 9049 1 0x00000000 2018-04-08 13:23:57 [44920.560887] Call Trace: 2018-04-08 13:23:57 [44920.563694] [] ? list_del+0xd/0x30 2018-04-08 13:23:57 [44920.569101] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.574415] [] schedule_timeout+0x239/0x2c0 2018-04-08 13:23:57 [44920.580598] [] ? get_work_pool+0x3e/0x70 2018-04-08 13:23:57 [44920.586520] [] ? flush_work+0x13b/0x190 2018-04-08 13:23:57 [44920.592354] [] ? move_linked_works+0x90/0x90 2018-04-08 13:23:57 [44920.598628] [] ? set_room+0x68/0xc0 2018-04-08 13:23:57 [44920.604123] [] n_tty_read+0x27c/0x930 2018-04-08 13:23:57 [44920.609785] [] ? ldsem_down_read+0x3b/0x220 2018-04-08 13:23:57 [44920.615966] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:57 [44920.621887] [] tty_read+0x8d/0x100 2018-04-08 13:23:57 [44920.627290] [] vfs_read+0x9c/0x170 2018-04-08 13:23:57 [44920.632687] [] SyS_read+0x7f/0xe0 2018-04-08 13:23:57 [44920.637993] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.644340] mcelog S ffff88012cc3af70 0 9068 1 0x00000000 2018-04-08 13:23:57 [44920.651782] Call Trace: 2018-04-08 13:23:57 [44920.654588] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.659902] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:23:57 [44920.667298] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:23:57 [44920.673303] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:23:57 [44920.679304] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:57 [44920.685997] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:57 [44920.692426] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:23:57 [44920.698168] [] ? shmem_getpage_gfp.isra.26+0x6ca/0x880 2018-04-08 13:23:57 [44920.705295] [] ? radix_tree_lookup_slot+0x22/0x50 2018-04-08 13:23:57 [44920.711983] [] ? __find_get_page+0x1e/0xa0 2018-04-08 13:23:57 [44920.718070] [] ? __find_lock_page+0x30/0x70 2018-04-08 13:23:57 [44920.724238] [] ? shmem_getpage_gfp.isra.26+0xed/0x880 2018-04-08 13:23:57 [44920.731271] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:57 [44920.738484] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:57 [44920.745689] [] ? shmem_fault+0x8d/0x1f0 2018-04-08 13:23:57 [44920.751503] [] ? unlock_page+0x2b/0x30 2018-04-08 13:23:57 [44920.757229] [] ? do_read_fault.isra.44+0xe6/0x130 2018-04-08 13:23:57 [44920.763905] [] ? handle_mm_fault+0x691/0xfa0 2018-04-08 13:23:57 [44920.770149] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:23:57 [44920.776401] [] ? __set_task_blocked+0x41/0xa0 2018-04-08 13:23:57 [44920.782736] [] SyS_ppoll+0xce/0x1d0 2018-04-08 13:23:57 [44920.788201] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:57 [44920.794529] z_vdev_file S ffff88012cbbeeb0 0 9129 2 0x00000000 2018-04-08 13:23:57 [44920.801956] Call Trace: 2018-04-08 13:23:57 [44920.804745] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.810050] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:23:57 [44920.816398] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:57 [44920.822318] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:23:57 [44920.829195] [] kthread+0xcf/0xe0 2018-04-08 13:23:57 [44920.834421] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:57 [44920.840860] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:57 [44920.846600] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:57 [44920.853033] l2arc_feed S ffff88012cbbaf70 0 9131 2 0x00000000 2018-04-08 13:23:57 [44920.860474] Call Trace: 2018-04-08 13:23:57 [44920.863281] [] schedule+0x29/0x70 2018-04-08 13:23:57 [44920.868602] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:23:57 [44920.874787] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:23:57 [44920.881150] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:23:57 [44920.888124] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:23:58 [44920.895176] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:23:58 [44920.901393] [] ? l2arc_evict+0x310/0x310 [zfs] 2018-04-08 13:23:58 [44920.907846] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:23:58 [44920.914571] [] l2arc_feed_thread+0x90/0xb80 [zfs] 2018-04-08 13:23:58 [44920.921287] [] ? __slab_free+0x81/0x2f0 2018-04-08 13:23:58 [44920.927144] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:23:58 [44920.933267] [] ? l2arc_evict+0x310/0x310 [zfs] 2018-04-08 13:23:58 [44920.939729] [] ? spl_kmem_free+0x35/0x40 [spl] 2018-04-08 13:23:58 [44920.946184] [] ? kfree+0x103/0x140 2018-04-08 13:23:58 [44920.951613] [] ? l2arc_evict+0x310/0x310 [zfs] 2018-04-08 13:23:58 [44920.958072] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:23:58 [44920.965137] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:23:58 [44920.971600] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44920.976842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44920.983304] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44920.989070] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44920.995527] kworker/13:2 S ffff88be1e3c2f70 0 9145 2 0x00000000 2018-04-08 13:23:58 [44921.002996] Call Trace: 2018-04-08 13:23:58 [44921.005825] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:58 [44921.012205] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.017544] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:58 [44921.023493] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:58 [44921.030402] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.035662] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.042131] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.047905] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.054374] master S ffff88be60eb4f10 0 9169 1 0x00000000 2018-04-08 13:23:58 [44921.061841] Call Trace: 2018-04-08 13:23:58 [44921.064682] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:58 [44921.071598] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.076962] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:58 [44921.084306] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:58 [44921.090441] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:58 [44921.097959] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:58 [44921.104704] [] ep_poll+0x23e/0x360 2018-04-08 13:23:58 [44921.110145] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:58 [44921.116103] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:58 [44921.122060] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:58 [44921.128445] kdmflush S ffff88be60d0eeb0 0 9244 2 0x00000000 2018-04-08 13:23:58 [44921.135930] Call Trace: 2018-04-08 13:23:58 [44921.138778] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.144132] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:58 [44921.150172] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:58 [44921.156562] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.161827] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.168302] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.174084] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.180562] bioset S ffff88be60eb2f70 0 9257 2 0x00000000 2018-04-08 13:23:58 [44921.188042] Call Trace: 2018-04-08 13:23:58 [44921.190884] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.196236] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:58 [44921.202284] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:58 [44921.208679] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.213941] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.220419] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.226203] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.232679] kdmwork-253:14 S ffff885eb021cf10 0 9259 2 0x00000000 2018-04-08 13:23:58 [44921.240165] Call Trace: 2018-04-08 13:23:58 [44921.243009] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.248365] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:58 [44921.254592] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:58 [44921.260469] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.265742] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.272220] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.278004] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.284477] kdmflush S ffff885e9c975ee0 0 9305 2 0x00000000 2018-04-08 13:23:58 [44921.291953] Call Trace: 2018-04-08 13:23:58 [44921.294792] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.300147] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:58 [44921.306192] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:58 [44921.312582] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.317844] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.324322] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.330103] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.336577] bioset S ffff885ea473bf40 0 9315 2 0x00000000 2018-04-08 13:23:58 [44921.344061] Call Trace: 2018-04-08 13:23:58 [44921.346894] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.352242] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:58 [44921.358286] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:58 [44921.364675] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.369934] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.376400] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.382176] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.388641] kdmwork-253:15 S ffff885ea473eeb0 0 9316 2 0x00000000 2018-04-08 13:23:58 [44921.396112] Call Trace: 2018-04-08 13:23:58 [44921.398951] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.404298] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:58 [44921.410514] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:58 [44921.416380] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.421636] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.428103] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.433880] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.440347] kdmflush S ffff885ebd22af70 0 9375 2 0x00000000 2018-04-08 13:23:58 [44921.447823] Call Trace: 2018-04-08 13:23:58 [44921.450661] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.456006] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:58 [44921.462040] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:58 [44921.468419] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.473673] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.480142] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.485917] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.492385] bioset S ffff885ebd228000 0 9388 2 0x00000000 2018-04-08 13:23:58 [44921.499862] Call Trace: 2018-04-08 13:23:58 [44921.502698] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.508043] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:58 [44921.514073] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:58 [44921.520456] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.525710] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.532179] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.537954] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.544422] kdmwork-253:16 S ffff885ebd22bf40 0 9389 2 0x00000000 2018-04-08 13:23:58 [44921.551897] Call Trace: 2018-04-08 13:23:58 [44921.554739] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.560080] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:58 [44921.566288] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:58 [44921.572148] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.577400] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.583874] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.589644] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.596114] kworker/6:1H R running task 0 9586 2 0x00000000 2018-04-08 13:23:58 [44921.603592] Call Trace: 2018-04-08 13:23:58 [44921.606430] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:58 [44921.612812] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.618160] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:58 [44921.624109] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:58 [44921.631007] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.636263] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.642736] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.648518] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.654984] kworker/14:1H S ffff885ea4b94f10 0 9659 2 0x00000000 2018-04-08 13:23:58 [44921.662459] Call Trace: 2018-04-08 13:23:58 [44921.665295] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:58 [44921.671681] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.677031] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:58 [44921.682979] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:58 [44921.689878] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.695136] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.701612] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.707395] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.713866] kworker/8:1H S ffff885e9cd86eb0 0 9891 2 0x00000000 2018-04-08 13:23:58 [44921.721338] Call Trace: 2018-04-08 13:23:58 [44921.724171] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:58 [44921.730563] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.735912] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:58 [44921.741868] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:58 [44921.748778] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.754043] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.760521] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.766302] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.772777] kworker/12:4 S ffff885e9ce68000 0 12475 2 0x00000000 2018-04-08 13:23:58 [44921.780258] Call Trace: 2018-04-08 13:23:58 [44921.783098] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:58 [44921.789492] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.794843] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:58 [44921.800800] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:58 [44921.807712] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.812981] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.819458] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.825237] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.831710] kworker/4:16 S ffff885e9aaa0fd0 0 12501 2 0x00000000 2018-04-08 13:23:58 [44921.839189] Call Trace: 2018-04-08 13:23:58 [44921.842035] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:58 [44921.848434] [] schedule+0x29/0x70 2018-04-08 13:23:58 [44921.853793] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:58 [44921.859761] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:58 [44921.866680] [] kthread+0xcf/0xe0 2018-04-08 13:23:58 [44921.871950] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:58 [44921.878430] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:58 [44921.884211] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44921.890687] kworker/4:17 S ffff885e9aaa5ee0 0 12502 2 0x00000000 2018-04-08 13:23:59 [44921.898172] Call Trace: 2018-04-08 13:23:59 [44921.901022] [] ? process_one_work+0x215/0x440 2018-04-08 13:23:59 [44921.907418] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44921.912774] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:23:59 [44921.918742] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:23:59 [44921.925659] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44921.930929] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44921.937416] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44921.943204] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44921.949676] irq/99-hfi1_0 k S ffff885ebbc3af70 0 14361 2 0x00000000 2018-04-08 13:23:59 [44921.957159] Call Trace: 2018-04-08 13:23:59 [44921.960003] [] ? irq_finalize_oneshot.part.29+0xe0/0xe0 2018-04-08 13:23:59 [44921.967267] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44921.972634] [] irq_thread+0xd1/0x180 2018-04-08 13:23:59 [44921.978254] [] ? irq_forced_thread_fn+0x50/0x50 2018-04-08 13:23:59 [44921.984830] [] ? irq_thread_check_affinity+0xf0/0xf0 2018-04-08 13:23:59 [44921.991836] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44921.997111] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.003596] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.009384] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.015863] irq/100-hfi1_0 S ffff885ebbc38000 0 14362 2 0x00000000 2018-04-08 13:23:59 [44922.023354] Call Trace: 2018-04-08 13:23:59 [44922.026203] [] ? irq_finalize_oneshot.part.29+0xe0/0xe0 2018-04-08 13:23:59 [44922.033477] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.038845] [] irq_thread+0xd1/0x180 2018-04-08 13:23:59 [44922.044470] [] ? irq_forced_thread_fn+0x50/0x50 2018-04-08 13:23:59 [44922.051043] [] ? irq_thread_check_affinity+0xf0/0xf0 2018-04-08 13:23:59 [44922.058049] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.063319] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.069803] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.075596] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.082081] irq/101-hfi1_0 S ffff885ebbc3bf40 0 14363 2 0x00000000 2018-04-08 13:23:59 [44922.089570] Call Trace: 2018-04-08 13:23:59 [44922.092421] [] ? irq_finalize_oneshot.part.29+0xe0/0xe0 2018-04-08 13:23:59 [44922.099698] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.105060] [] irq_thread+0xd1/0x180 2018-04-08 13:23:59 [44922.110690] [] ? irq_forced_thread_fn+0x50/0x50 2018-04-08 13:23:59 [44922.117266] [] ? irq_thread_check_affinity+0xf0/0xf0 2018-04-08 13:23:59 [44922.124267] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.129537] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.136025] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.141814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.148297] irq/102-hfi1_0 S ffff885ebbc39fa0 0 14364 2 0x00000000 2018-04-08 13:23:59 [44922.155793] Call Trace: 2018-04-08 13:23:59 [44922.158648] [] ? irq_finalize_oneshot.part.29+0xe0/0xe0 2018-04-08 13:23:59 [44922.165925] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.171300] [] irq_thread+0xd1/0x180 2018-04-08 13:23:59 [44922.176922] [] ? irq_forced_thread_fn+0x50/0x50 2018-04-08 13:23:59 [44922.183500] [] ? irq_thread_check_affinity+0xf0/0xf0 2018-04-08 13:23:59 [44922.190502] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.195774] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.202259] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.208050] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.214536] irq/103-hfi1_0 S ffff885ebbc3cf10 0 14365 2 0x00000000 2018-04-08 13:23:59 [44922.222026] Call Trace: 2018-04-08 13:23:59 [44922.224886] [] ? irq_finalize_oneshot.part.29+0xe0/0xe0 2018-04-08 13:23:59 [44922.232159] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.237532] [] irq_thread+0xd1/0x180 2018-04-08 13:23:59 [44922.243154] [] ? irq_forced_thread_fn+0x50/0x50 2018-04-08 13:23:59 [44922.249722] [] ? irq_thread_check_affinity+0xf0/0xf0 2018-04-08 13:23:59 [44922.256725] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.262000] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.268485] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.274277] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.280759] ntpd S ffff88012cbc8fd0 0 14369 1 0x00000000 2018-04-08 13:23:59 [44922.288251] Call Trace: 2018-04-08 13:23:59 [44922.291102] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:59 [44922.298027] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.303391] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:59 [44922.310750] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:59 [44922.316890] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:59 [44922.324415] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:59 [44922.331162] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:59 [44922.337654] [] do_select+0x6d1/0x7c0 2018-04-08 13:23:59 [44922.343282] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.350556] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.357820] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.365078] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.372335] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.379578] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.386814] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.394040] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.401263] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.408477] [] core_sys_select+0x1db/0x300 2018-04-08 13:23:59 [44922.414565] [] ? SYSC_sendto+0x121/0x1c0 2018-04-08 13:23:59 [44922.420484] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:23:59 [44922.426483] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:23:59 [44922.432479] [] SyS_select+0xba/0x110 2018-04-08 13:23:59 [44922.438043] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:59 [44922.444380] hfi1_cq0 S ffff88beb7610fd0 0 14385 2 0x00000000 2018-04-08 13:23:59 [44922.451808] Call Trace: 2018-04-08 13:23:59 [44922.454596] [] ? __local_bh_enable_ip+0x9b/0xb0 2018-04-08 13:23:59 [44922.461113] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.466413] [] kthread_worker_fn+0xef/0x180 2018-04-08 13:23:59 [44922.472580] [] ? kthread_stop+0xe0/0xe0 2018-04-08 13:23:59 [44922.478399] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.483608] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.490038] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.495765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.502190] ib_mad1 S ffff88beafe0eeb0 0 14414 2 0x00000000 2018-04-08 13:23:59 [44922.509621] Call Trace: 2018-04-08 13:23:59 [44922.512405] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.517700] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:59 [44922.523687] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:59 [44922.530012] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.535220] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.541635] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.547358] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.553774] ipoib_wq S ffff88beafe0bf40 0 14419 2 0x00000000 2018-04-08 13:23:59 [44922.561198] Call Trace: 2018-04-08 13:23:59 [44922.563984] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.569281] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:23:59 [44922.575270] [] ? process_one_work+0x440/0x440 2018-04-08 13:23:59 [44922.581604] [] kthread+0xcf/0xe0 2018-04-08 13:23:59 [44922.586800] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.593210] [] ret_from_fork+0x58/0x90 2018-04-08 13:23:59 [44922.598931] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:23:59 [44922.605339] qmgr S ffff88beb44c5ee0 0 14453 9169 0x00000000 2018-04-08 13:23:59 [44922.612758] Call Trace: 2018-04-08 13:23:59 [44922.615537] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:59 [44922.622384] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.627673] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:59 [44922.634957] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:59 [44922.641031] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:59 [44922.648503] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:59 [44922.655202] [] ep_poll+0x23e/0x360 2018-04-08 13:23:59 [44922.660608] [] ? mntput+0x24/0x40 2018-04-08 13:23:59 [44922.665931] [] ? wake_up_state+0x20/0x20 2018-04-08 13:23:59 [44922.671868] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:23:59 [44922.677810] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:59 [44922.684188] irqbalance S ffff88beb4d44f10 0 14463 1 0x00000000 2018-04-08 13:23:59 [44922.691659] Call Trace: 2018-04-08 13:23:59 [44922.694494] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:59 [44922.701404] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.706759] [] do_nanosleep+0x86/0xf0 2018-04-08 13:23:59 [44922.712455] [] hrtimer_nanosleep+0xbb/0x180 2018-04-08 13:23:59 [44922.718674] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:59 [44922.724805] [] ? do_nanosleep+0x72/0xf0 2018-04-08 13:23:59 [44922.730672] [] SyS_nanosleep+0x7e/0x90 2018-04-08 13:23:59 [44922.736445] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:23:59 [44922.742825] sssd S ffff88beb4d40fd0 0 14466 1 0x00000000 2018-04-08 13:23:59 [44922.750300] Call Trace: 2018-04-08 13:23:59 [44922.753143] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:23:59 [44922.760052] [] schedule+0x29/0x70 2018-04-08 13:23:59 [44922.765411] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:23:59 [44922.772754] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:23:59 [44922.778893] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:23:59 [44922.786415] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:23:59 [44922.793156] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:23:59 [44922.799630] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:23:59 [44922.805415] [] ? sock_recvmsg+0xbf/0x100 2018-04-08 13:23:59 [44922.811374] [] ? process_measurement+0x8e/0x250 2018-04-08 13:23:59 [44922.817944] [] ? zone_statistics+0x88/0xa0 2018-04-08 13:23:59 [44922.824082] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.831344] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.838603] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.845845] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.853084] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.860311] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.867535] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:23:59 [44922.874758] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44922.881973] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:24:00 [44922.887978] [] SyS_poll+0x74/0x110 2018-04-08 13:24:00 [44922.893374] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44922.899719] sssd_be S ffff88be60f2bf40 0 14467 14466 0x00000000 2018-04-08 13:24:00 [44922.907155] Call Trace: 2018-04-08 13:24:00 [44922.909947] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44922.916811] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44922.922119] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:24:00 [44922.929417] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44922.935502] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:24:00 [44922.942977] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44922.949675] [] ep_poll+0x23e/0x360 2018-04-08 13:24:00 [44922.955068] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:00 [44922.961329] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:00 [44922.967242] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:24:00 [44922.973157] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44922.979501] sssd_nss S ffff88be60f28fd0 0 14468 14466 0x00000000 2018-04-08 13:24:00 [44922.986938] Call Trace: 2018-04-08 13:24:00 [44922.989735] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44922.996606] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.001922] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:24:00 [44923.009234] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.015325] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:24:00 [44923.022809] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44923.029512] [] ep_poll+0x23e/0x360 2018-04-08 13:24:00 [44923.034923] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:00 [44923.041201] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:00 [44923.047128] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:24:00 [44923.053046] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.059395] sssd_pam S ffff88be60f2dee0 0 14469 14466 0x00000000 2018-04-08 13:24:00 [44923.066835] Call Trace: 2018-04-08 13:24:00 [44923.069643] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.076513] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.081827] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:24:00 [44923.089137] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.095230] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:24:00 [44923.102713] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44923.109421] [] ep_poll+0x23e/0x360 2018-04-08 13:24:00 [44923.114825] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:00 [44923.121096] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:00 [44923.127022] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:24:00 [44923.132950] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.139319] pcsd S ffff88beb4d40000 0 14509 1 0x00000000 2018-04-08 13:24:00 [44923.146781] Call Trace: 2018-04-08 13:24:00 [44923.149620] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.156534] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.161900] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:24:00 [44923.169260] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.175411] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:24:00 [44923.182945] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44923.189706] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:00 [44923.196204] [] do_select+0x6d1/0x7c0 2018-04-08 13:24:00 [44923.201830] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.209102] [] ? handle_mm_fault+0x70c/0xfa0 2018-04-08 13:24:00 [44923.215422] [] ? unlock_page+0x2b/0x30 2018-04-08 13:24:00 [44923.221217] [] ? do_wp_page+0x185/0x5c0 2018-04-08 13:24:00 [44923.227094] [] ? do_page_fault+0x35/0x90 2018-04-08 13:24:00 [44923.233057] [] ? handle_mm_fault+0x70c/0xfa0 2018-04-08 13:24:00 [44923.239368] [] core_sys_select+0x1db/0x300 2018-04-08 13:24:00 [44923.245505] [] ? page_fault+0x28/0x30 2018-04-08 13:24:00 [44923.251210] [] ? handle_mm_fault+0x70c/0xfa0 2018-04-08 13:24:00 [44923.257523] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:24:00 [44923.263574] [] SyS_select+0xba/0x110 2018-04-08 13:24:00 [44923.269190] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.275578] pcsd S ffff88be60f46eb0 0 14515 1 0x00000000 2018-04-08 13:24:00 [44923.283056] Call Trace: 2018-04-08 13:24:00 [44923.285897] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.292813] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.298170] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:24:00 [44923.304560] [] futex_wait+0x17b/0x280 2018-04-08 13:24:00 [44923.310254] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.316381] [] ? futex_wait_queue_me+0xa4/0x130 2018-04-08 13:24:00 [44923.322944] [] do_futex+0x106/0x5a0 2018-04-08 13:24:00 [44923.328466] [] SyS_futex+0x80/0x180 2018-04-08 13:24:00 [44923.333980] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.340361] pcsd S ffff88be60f45ee0 0 14516 1 0x00000000 2018-04-08 13:24:00 [44923.347838] Call Trace: 2018-04-08 13:24:00 [44923.350674] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.357581] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.362928] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:24:00 [44923.369309] [] futex_wait+0x17b/0x280 2018-04-08 13:24:00 [44923.374993] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.381114] [] ? futex_wait_queue_me+0xa4/0x130 2018-04-08 13:24:00 [44923.387665] [] do_futex+0x106/0x5a0 2018-04-08 13:24:00 [44923.393179] [] SyS_futex+0x80/0x180 2018-04-08 13:24:00 [44923.398683] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.405055] ruby-timer-thr S ffff885e5dcdaf70 0 283692 1 0x00000000 2018-04-08 13:24:00 [44923.412607] Call Trace: 2018-04-08 13:24:00 [44923.415443] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.422351] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.427699] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:24:00 [44923.435117] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.441233] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:24:00 [44923.447266] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44923.453988] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:00 [44923.460453] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:24:00 [44923.466226] [] ? physflat_send_IPI_mask+0xe/0x10 2018-04-08 13:24:00 [44923.472867] [] ? native_send_call_func_single_ipi+0x3c/0x40 2018-04-08 13:24:00 [44923.480461] [] ? generic_exec_single+0x139/0x1a0 2018-04-08 13:24:00 [44923.487101] [] ? leave_mm+0x110/0x110 2018-04-08 13:24:00 [44923.492785] [] ? leave_mm+0x110/0x110 2018-04-08 13:24:00 [44923.498457] [] ? leave_mm+0x110/0x110 2018-04-08 13:24:00 [44923.504134] [] ? smp_call_function_single+0x5f/0xa0 2018-04-08 13:24:00 [44923.511023] [] ? cpumask_next_and+0x35/0x50 2018-04-08 13:24:00 [44923.517222] [] ? smp_call_function_many+0x223/0x260 2018-04-08 13:24:00 [44923.524110] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.531352] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.538584] [] ? touch_atime+0x116/0x240 2018-04-08 13:24:00 [44923.544522] [] ? mutex_lock+0x12/0x2f 2018-04-08 13:24:00 [44923.550200] [] ? pipe_read+0x282/0x3c0 2018-04-08 13:24:00 [44923.555956] [] ? do_sync_read+0x8d/0xd0 2018-04-08 13:24:00 [44923.561801] [] SyS_poll+0x74/0x110 2018-04-08 13:24:00 [44923.567206] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.573559] gmond S ffff88012cbb0000 0 14525 1 0x00000000 2018-04-08 13:24:00 [44923.580995] Call Trace: 2018-04-08 13:24:00 [44923.583799] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.590684] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.596007] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:24:00 [44923.603328] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.609430] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:24:00 [44923.616922] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44923.623644] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:00 [44923.630101] [] do_select+0x6d1/0x7c0 2018-04-08 13:24:00 [44923.635691] [] ? dev_queue_xmit+0x10/0x20 2018-04-08 13:24:00 [44923.641714] [] ? neigh_connected_output+0xb7/0x100 2018-04-08 13:24:00 [44923.648510] [] ? local_bh_enable+0x17/0x20 2018-04-08 13:24:00 [44923.654610] [] ? ip_output+0x73/0xe0 2018-04-08 13:24:00 [44923.660194] [] ? __ip_local_out_sk+0xf6/0x100 2018-04-08 13:24:00 [44923.666557] [] ? ip_make_skb+0x52/0x120 2018-04-08 13:24:00 [44923.672402] [] ? ip_local_out_sk+0x31/0x40 2018-04-08 13:24:00 [44923.678507] [] ? ip_send_skb+0x16/0x50 2018-04-08 13:24:00 [44923.684261] [] ? udp_send_skb+0x16c/0x2b0 2018-04-08 13:24:00 [44923.690281] [] ? ip_copy_metadata+0x170/0x170 2018-04-08 13:24:00 [44923.696644] [] ? udp_sendmsg+0x40f/0xa00 2018-04-08 13:24:00 [44923.702570] [] ? put_dec+0x72/0x90 2018-04-08 13:24:00 [44923.707967] [] ? number.isra.2+0x323/0x360 2018-04-08 13:24:00 [44923.714060] [] ? ima_file_check+0x63/0x1b0 2018-04-08 13:24:00 [44923.720142] [] ? inet_sendmsg+0x63/0xb0 2018-04-08 13:24:00 [44923.725969] [] ? vsnprintf+0x441/0x6a0 2018-04-08 13:24:00 [44923.731707] [] core_sys_select+0x1db/0x300 2018-04-08 13:24:00 [44923.737785] [] ? do_sync_write+0x8d/0xd0 2018-04-08 13:24:00 [44923.743686] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:24:00 [44923.749678] [] SyS_select+0xba/0x110 2018-04-08 13:24:00 [44923.755236] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:00 [44923.761574] rpcbind S ffff88012cf4eeb0 0 15248 1 0x00000000 2018-04-08 13:24:00 [44923.768995] Call Trace: 2018-04-08 13:24:00 [44923.771782] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:24:00 [44923.778646] [] schedule+0x29/0x70 2018-04-08 13:24:00 [44923.783958] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:24:00 [44923.791268] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:00 [44923.797369] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:24:00 [44923.804851] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:00 [44923.811560] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:00 [44923.818009] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:24:00 [44923.823772] [] ? __wake_up_sync_key+0x4f/0x60 2018-04-08 13:24:00 [44923.830136] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.837366] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.844588] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.851815] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.859038] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:00 [44923.866248] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44923.873451] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44923.880644] [] ? mntput+0x24/0x40 2018-04-08 13:24:01 [44923.885928] [] ? __fput+0x183/0x260 2018-04-08 13:24:01 [44923.891382] [] ? ktime_get_ts64+0x4c/0xf0 2018-04-08 13:24:01 [44923.897355] [] SyS_poll+0x74/0x110 2018-04-08 13:24:01 [44923.902723] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44923.909039] polkitd S ffff88beafe0af70 0 15449 1 0x00000000 2018-04-08 13:24:01 [44923.916452] Call Trace: 2018-04-08 13:24:01 [44923.919224] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44923.924512] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:24:01 [44923.931874] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:24:01 [44923.937854] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:01 [44923.944529] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:01 [44923.950950] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:24:01 [44923.956672] [] ? follow_managed+0x281/0x300 2018-04-08 13:24:01 [44923.962827] [] ? in_group_p+0x31/0x40 2018-04-08 13:24:01 [44923.968464] [] ? generic_permission+0x15e/0x1d0 2018-04-08 13:24:01 [44923.974968] [] ? security_inode_permission+0x1c/0x30 2018-04-08 13:24:01 [44923.981905] [] ? __inode_permission+0x52/0xc0 2018-04-08 13:24:01 [44923.988241] [] ? inode_permission+0x18/0x50 2018-04-08 13:24:01 [44923.994396] [] ? link_path_walk+0x27e/0x8b0 2018-04-08 13:24:01 [44924.000549] [] ? __d_lookup+0x7a/0x160 2018-04-08 13:24:01 [44924.006275] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.013473] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.020673] [] ? ttwu_do_wakeup+0x19/0xd0 2018-04-08 13:24:01 [44924.026662] [] ? ttwu_do_activate.constprop.91+0x5d/0x70 2018-04-08 13:24:01 [44924.033956] [] ? try_to_wake_up+0x183/0x340 2018-04-08 13:24:01 [44924.040117] [] ? putname+0x3d/0x60 2018-04-08 13:24:01 [44924.045503] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:01 [44924.052101] [] ? pollwake+0x73/0x90 2018-04-08 13:24:01 [44924.057571] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:01 [44924.063473] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:01 [44924.069625] [] ? vfs_write+0x160/0x1e0 2018-04-08 13:24:01 [44924.075345] [] SyS_poll+0x74/0x110 2018-04-08 13:24:01 [44924.080710] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44924.087031] gmain S ffff88012d456eb0 0 15450 1 0x00000000 2018-04-08 13:24:01 [44924.094441] Call Trace: 2018-04-08 13:24:01 [44924.097211] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.102501] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:24:01 [44924.109861] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:24:01 [44924.115840] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:01 [44924.122509] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:01 [44924.128924] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:24:01 [44924.134656] [] ? radix_tree_lookup_slot+0x22/0x50 2018-04-08 13:24:01 [44924.141344] [] ? zone_statistics+0x88/0xa0 2018-04-08 13:24:01 [44924.147425] [] ? get_page_from_freelist+0x4fa/0x9e0 2018-04-08 13:24:01 [44924.154299] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.161525] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.168754] [] ? __mem_cgroup_commit_charge+0xe2/0x2f0 2018-04-08 13:24:01 [44924.175895] [] ? lru_cache_add+0xe/0x10 2018-04-08 13:24:01 [44924.181740] [] ? eventfd_ctx_read+0x67/0x1e0 2018-04-08 13:24:01 [44924.188017] [] SyS_poll+0x74/0x110 2018-04-08 13:24:01 [44924.193429] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44924.199791] gdbus S ffff88012d455ee0 0 15451 1 0x00000000 2018-04-08 13:24:01 [44924.207246] Call Trace: 2018-04-08 13:24:01 [44924.210059] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.215379] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:24:01 [44924.222783] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:24:01 [44924.228798] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:24:01 [44924.234808] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:01 [44924.241512] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:01 [44924.247950] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:24:01 [44924.253702] [] ? sock_sendmsg+0xb0/0xf0 2018-04-08 13:24:01 [44924.259537] [] ? sock_recvmsg+0xbf/0x100 2018-04-08 13:24:01 [44924.265457] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.272678] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.279890] [] ? ___sys_sendmsg+0x3a9/0x3c0 2018-04-08 13:24:01 [44924.286065] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:01 [44924.292671] [] ? pollwake+0x73/0x90 2018-04-08 13:24:01 [44924.298160] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:01 [44924.304079] [] ? eventfd_ctx_read+0x67/0x1e0 2018-04-08 13:24:01 [44924.310347] [] ? __sys_sendmsg+0x85/0x90 2018-04-08 13:24:01 [44924.316265] [] SyS_poll+0x74/0x110 2018-04-08 13:24:01 [44924.321669] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44924.328024] JS GC Helper S ffff88012d453f40 0 15452 1 0x00000000 2018-04-08 13:24:01 [44924.335462] Call Trace: 2018-04-08 13:24:01 [44924.338269] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.343591] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:24:01 [44924.349953] [] futex_wait+0x17b/0x280 2018-04-08 13:24:01 [44924.355619] [] ? __alloc_pages_nodemask+0x176/0x420 2018-04-08 13:24:01 [44924.362501] [] ? mem_cgroup_update_page_stat+0x16/0x50 2018-04-08 13:24:01 [44924.369646] [] ? page_add_file_rmap+0x8c/0xc0 2018-04-08 13:24:01 [44924.376012] [] do_futex+0x106/0x5a0 2018-04-08 13:24:01 [44924.381507] [] SyS_futex+0x80/0x180 2018-04-08 13:24:01 [44924.386997] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44924.393354] JS Sour~ Thread S ffff88012d450000 0 15453 1 0x00000000 2018-04-08 13:24:01 [44924.400799] Call Trace: 2018-04-08 13:24:01 [44924.403606] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.408928] [] futex_wait_queue_me+0xc6/0x130 2018-04-08 13:24:01 [44924.415282] [] futex_wait+0x17b/0x280 2018-04-08 13:24:01 [44924.420943] [] ? __alloc_pages_nodemask+0x176/0x420 2018-04-08 13:24:01 [44924.427817] [] ? get_futex_key+0x1c8/0x2c0 2018-04-08 13:24:01 [44924.433914] [] ? __mem_cgroup_commit_charge+0xe2/0x2f0 2018-04-08 13:24:01 [44924.441056] [] do_futex+0x106/0x5a0 2018-04-08 13:24:01 [44924.446553] [] SyS_futex+0x80/0x180 2018-04-08 13:24:01 [44924.452045] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44924.458410] polkitd S ffff88012d451fa0 0 15454 1 0x00000000 2018-04-08 13:24:01 [44924.465863] Call Trace: 2018-04-08 13:24:01 [44924.468679] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.474011] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:24:01 [44924.481415] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:24:01 [44924.487522] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:24:01 [44924.493538] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:24:01 [44924.500246] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:24:01 [44924.506697] [] do_sys_poll+0x4cd/0x580 2018-04-08 13:24:01 [44924.512453] [] ? zone_statistics+0x88/0xa0 2018-04-08 13:24:01 [44924.518561] [] ? zone_statistics+0x88/0xa0 2018-04-08 13:24:01 [44924.524661] [] ? get_page_from_freelist+0x4fa/0x9e0 2018-04-08 13:24:01 [44924.531541] [] ? vsnprintf+0x441/0x6a0 2018-04-08 13:24:01 [44924.537296] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:24:01 [44924.544525] [] ? sched_clock+0x9/0x10 2018-04-08 13:24:01 [44924.550197] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:01 [44924.556295] [] ? try_to_wake_up+0x183/0x340 2018-04-08 13:24:01 [44924.562490] [] ? wake_up_q+0x5b/0x80 2018-04-08 13:24:01 [44924.568073] [] ? futex_wake+0x90/0x180 2018-04-08 13:24:01 [44924.573831] [] ? eventfd_ctx_read+0x67/0x1e0 2018-04-08 13:24:01 [44924.580105] [] SyS_poll+0x74/0x110 2018-04-08 13:24:01 [44924.585520] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:24:01 [44924.591882] kworker/2:0 S ffff885ebbfb4f10 0 15851 2 0x00000000 2018-04-08 13:24:01 [44924.599343] Call Trace: 2018-04-08 13:24:01 [44924.602167] [] ? process_one_work+0x215/0x440 2018-04-08 13:24:01 [44924.608544] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.613874] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:01 [44924.619809] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:01 [44924.626695] [] kthread+0xcf/0xe0 2018-04-08 13:24:01 [44924.631939] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.638393] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:01 [44924.644156] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.650606] kworker/2:4 S ffff885ebbfb0fd0 0 15854 2 0x00000000 2018-04-08 13:24:01 [44924.658065] Call Trace: 2018-04-08 13:24:01 [44924.660886] [] ? mod_timer+0x14a/0x220 2018-04-08 13:24:01 [44924.666651] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.671986] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:01 [44924.677922] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:01 [44924.684809] [] kthread+0xcf/0xe0 2018-04-08 13:24:01 [44924.690046] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.696500] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:01 [44924.702266] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.708723] kworker/1:1H S ffff88beb3f95ee0 0 17405 2 0x00000000 2018-04-08 13:24:01 [44924.716186] Call Trace: 2018-04-08 13:24:01 [44924.719013] [] ? process_one_work+0x215/0x440 2018-04-08 13:24:01 [44924.725391] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.730725] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:01 [44924.736668] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:01 [44924.743561] [] kthread+0xcf/0xe0 2018-04-08 13:24:01 [44924.748806] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.755266] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:01 [44924.761031] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.767489] kworker/6:0 R running task 0 17547 2 0x00000000 2018-04-08 13:24:01 [44924.774958] Call Trace: 2018-04-08 13:24:01 [44924.777779] [] ? process_one_work+0x215/0x440 2018-04-08 13:24:01 [44924.784157] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.789489] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:01 [44924.795430] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:01 [44924.802326] [] kthread+0xcf/0xe0 2018-04-08 13:24:01 [44924.807581] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.814050] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:01 [44924.819824] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.826291] kworker/7:1 S ffff88606d3dbf40 0 17606 2 0x00000000 2018-04-08 13:24:01 [44924.833772] Call Trace: 2018-04-08 13:24:01 [44924.836611] [] schedule+0x29/0x70 2018-04-08 13:24:01 [44924.841969] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:01 [44924.847928] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:01 [44924.854842] [] kthread+0xcf/0xe0 2018-04-08 13:24:01 [44924.860109] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.866595] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:01 [44924.872381] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:01 [44924.878853] kworker/1:0 S ffff88606cc18fd0 0 18711 2 0x00000000 2018-04-08 13:24:02 [44924.886339] Call Trace: 2018-04-08 13:24:02 [44924.889178] [] ? process_one_work+0x215/0x440 2018-04-08 13:24:02 [44924.895576] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44924.900934] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:02 [44924.906896] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:02 [44924.913809] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44924.919080] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44924.925557] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44924.931344] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44924.937818] z_null_iss S ffff88beba831fa0 0 18786 2 0x00000000 2018-04-08 13:24:02 [44924.945302] Call Trace: 2018-04-08 13:24:02 [44924.948141] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44924.953506] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44924.959900] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44924.965895] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44924.974374] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44924.981295] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44924.986576] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44924.993057] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44924.998846] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.005330] z_null_int S ffff88beb44c0fd0 0 18787 2 0x00000000 2018-04-08 13:24:02 [44925.012823] Call Trace: 2018-04-08 13:24:02 [44925.015674] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.021039] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.027443] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.033436] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.041929] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.048861] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.054145] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.060640] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.066436] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.072920] z_rd_iss S ffff88beb44c4f10 0 18788 2 0x00000000 2018-04-08 13:24:02 [44925.080416] Call Trace: 2018-04-08 13:24:02 [44925.083271] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.088648] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.095063] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.101047] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.107983] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.113266] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.119756] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.125559] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.132050] z_rd_int_0 S ffff88beb44c6eb0 0 18789 2 0x00000000 2018-04-08 13:24:02 [44925.139554] Call Trace: 2018-04-08 13:24:02 [44925.142418] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.147793] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.154208] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.160208] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.168706] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.175642] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.180934] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.187433] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.193243] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.199742] z_rd_int_1 S ffff88beb44c2f70 0 18790 2 0x00000000 2018-04-08 13:24:02 [44925.207245] Call Trace: 2018-04-08 13:24:02 [44925.210112] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.215496] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.221917] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.227917] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.236412] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.243351] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.248641] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.255143] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.260949] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.267448] z_rd_int_2 S ffff88beb44c0000 0 18791 2 0x00000000 2018-04-08 13:24:02 [44925.274958] Call Trace: 2018-04-08 13:24:02 [44925.277823] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.283210] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.289631] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.295625] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.304125] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.311063] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.316353] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.322857] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.328668] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.335169] z_rd_int_3 S ffff88beb44c1fa0 0 18792 2 0x00000000 2018-04-08 13:24:02 [44925.342677] Call Trace: 2018-04-08 13:24:02 [44925.345543] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.350927] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.357343] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.363339] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.371841] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.378775] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.384067] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.390568] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.396375] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.402875] z_rd_int_4 S ffff88beafe09fa0 0 18793 2 0x00000000 2018-04-08 13:24:02 [44925.410386] Call Trace: 2018-04-08 13:24:02 [44925.413261] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.418647] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.425067] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.431072] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.439572] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.446518] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.451815] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.458317] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.464132] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.470632] z_rd_int_5 S ffff88beafe08fd0 0 18794 2 0x00000000 2018-04-08 13:24:02 [44925.478142] Call Trace: 2018-04-08 13:24:02 [44925.481017] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.486403] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.492822] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.498824] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.507324] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.514267] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.519563] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.526073] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.531885] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.538387] z_rd_int_6 S ffff88beafe0dee0 0 18795 2 0x00000000 2018-04-08 13:24:02 [44925.545898] Call Trace: 2018-04-08 13:24:02 [44925.548772] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.554155] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.560574] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.566573] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.575077] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.582024] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.587319] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.593826] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.599634] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.606136] z_rd_int_7 S ffff88beafe0cf10 0 18796 2 0x00000000 2018-04-08 13:24:02 [44925.613637] Call Trace: 2018-04-08 13:24:02 [44925.616509] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.621898] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.628317] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.634319] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.642823] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.649769] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.655071] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.661576] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.667388] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.673891] z_wr_iss S ffff88beb7610000 0 18797 2 0x00000000 2018-04-08 13:24:02 [44925.681401] Call Trace: 2018-04-08 13:24:02 [44925.684273] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.689660] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.696078] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.702075] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.710575] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.717515] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.722814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.729323] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.735135] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.741639] z_wr_iss S ffff88beb7611fa0 0 18798 2 0x00000000 2018-04-08 13:24:02 [44925.749150] Call Trace: 2018-04-08 13:24:02 [44925.752023] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.757408] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.763827] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.769824] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.778324] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.785266] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.790564] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.797070] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.802885] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.809386] z_wr_iss S ffff88beb7612f70 0 18799 2 0x00000000 2018-04-08 13:24:02 [44925.816898] Call Trace: 2018-04-08 13:24:02 [44925.819770] [] schedule+0x29/0x70 2018-04-08 13:24:02 [44925.825157] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:02 [44925.831576] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:02 [44925.837580] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:02 [44925.846084] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:02 [44925.853030] [] kthread+0xcf/0xe0 2018-04-08 13:24:02 [44925.858326] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.864835] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:02 [44925.870651] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:02 [44925.877152] z_wr_iss S ffff885ea4b95ee0 0 18800 2 0x00000000 2018-04-08 13:24:02 [44925.884663] Call Trace: 2018-04-08 13:24:03 [44925.887535] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44925.892918] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44925.899339] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44925.905342] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44925.913845] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44925.920784] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44925.926084] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44925.932592] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44925.938405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44925.944907] z_wr_iss S ffff885ea4b92f70 0 18801 2 0x00000000 2018-04-08 13:24:03 [44925.952418] Call Trace: 2018-04-08 13:24:03 [44925.955291] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44925.960676] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44925.967092] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44925.973090] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44925.981592] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44925.988532] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44925.993832] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.000339] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.006152] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.012654] z_wr_iss S ffff885ea4b90fd0 0 18802 2 0x00000000 2018-04-08 13:24:03 [44926.020154] Call Trace: 2018-04-08 13:24:03 [44926.023030] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.028415] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.034833] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.040840] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.049338] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.056279] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.061580] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.068086] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.073901] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.080402] z_wr_iss S ffff885ea4b96eb0 0 18803 2 0x00000000 2018-04-08 13:24:03 [44926.087914] Call Trace: 2018-04-08 13:24:03 [44926.090787] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.096170] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.102589] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.108596] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.117097] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.124045] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.129342] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.135851] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.141663] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.148167] z_wr_iss S ffff885ea4b91fa0 0 18804 2 0x00000000 2018-04-08 13:24:03 [44926.155674] Call Trace: 2018-04-08 13:24:03 [44926.158551] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.163934] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.170354] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.176358] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.184861] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.191811] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.197109] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.203618] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.209428] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.215928] z_wr_iss S ffff885ea4b90000 0 18805 2 0x00000000 2018-04-08 13:24:03 [44926.223438] Call Trace: 2018-04-08 13:24:03 [44926.226313] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.231698] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.238119] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.244125] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.252624] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.259563] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.264862] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.271370] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.277184] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.283685] z_wr_iss S ffff88bddaeb8000 0 18806 2 0x00000000 2018-04-08 13:24:03 [44926.291194] Call Trace: 2018-04-08 13:24:03 [44926.294068] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.299457] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.305873] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.311879] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.320379] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.327319] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.332619] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.339126] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.344939] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.351442] z_wr_iss S ffff88bddaeb8fd0 0 18807 2 0x00000000 2018-04-08 13:24:03 [44926.358948] Call Trace: 2018-04-08 13:24:03 [44926.361817] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.367201] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.373619] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.379619] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.388116] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.395059] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.400353] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.406864] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.412677] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.419178] z_wr_iss S ffff88bddaeb9fa0 0 18808 2 0x00000000 2018-04-08 13:24:03 [44926.426689] Call Trace: 2018-04-08 13:24:03 [44926.429563] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.434949] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.441368] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.447372] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.455873] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.462812] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.468113] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.474620] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.480433] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.486938] z_wr_iss_h S ffff88bddaebaf70 0 18809 2 0x00000000 2018-04-08 13:24:03 [44926.494444] Call Trace: 2018-04-08 13:24:03 [44926.497319] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.502705] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.509122] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.515107] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.522053] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.527344] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.533853] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.539665] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.546162] z_wr_int_0 S ffff88bddaebbf40 0 18810 2 0x00000000 2018-04-08 13:24:03 [44926.553669] Call Trace: 2018-04-08 13:24:03 [44926.556536] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.561915] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.568336] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.574331] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.582834] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.589770] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.595065] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.601570] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.607376] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.613876] z_wr_int_1 S ffff88bddaebcf10 0 18811 2 0x00000000 2018-04-08 13:24:03 [44926.621383] Call Trace: 2018-04-08 13:24:03 [44926.624251] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.629636] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.636057] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.642050] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.650552] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.657489] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.662779] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.669283] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.675089] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.681588] z_wr_int_2 S ffff88bddaebdee0 0 18812 2 0x00000000 2018-04-08 13:24:03 [44926.689095] Call Trace: 2018-04-08 13:24:03 [44926.691961] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.697338] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.703752] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.709745] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.718241] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.725177] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.730466] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.736970] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.742781] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.749284] z_wr_int_3 S ffff88bddaebeeb0 0 18813 2 0x00000000 2018-04-08 13:24:03 [44926.756790] Call Trace: 2018-04-08 13:24:03 [44926.759656] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.765033] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.771449] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.777442] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.785944] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.792884] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.798177] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.804682] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.810491] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.816992] z_wr_int_4 S ffff885eb8cfeeb0 0 18814 2 0x00000000 2018-04-08 13:24:03 [44926.824501] Call Trace: 2018-04-08 13:24:03 [44926.827376] [] schedule+0x29/0x70 2018-04-08 13:24:03 [44926.832758] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:03 [44926.839181] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:03 [44926.845185] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:03 [44926.853686] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:03 [44926.860626] [] kthread+0xcf/0xe0 2018-04-08 13:24:03 [44926.865923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.872432] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:03 [44926.878247] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:03 [44926.884749] z_wr_int_5 S ffff885eb8cf8fd0 0 18815 2 0x00000000 2018-04-08 13:24:04 [44926.892254] Call Trace: 2018-04-08 13:24:04 [44926.895131] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44926.900516] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44926.906935] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44926.912941] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:04 [44926.921441] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44926.928383] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44926.933678] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44926.940190] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44926.946001] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44926.952501] z_wr_int_6 S ffff885eb97e0000 0 18816 2 0x00000000 2018-04-08 13:24:04 [44926.960013] Call Trace: 2018-04-08 13:24:04 [44926.962887] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44926.968272] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44926.974691] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44926.980698] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:04 [44926.989197] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44926.996145] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.001444] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.007952] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.013766] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.020265] z_wr_int_7 S ffff885eb97e6eb0 0 18817 2 0x00000000 2018-04-08 13:24:04 [44927.027774] Call Trace: 2018-04-08 13:24:04 [44927.030642] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.036028] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.042448] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.048451] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:04 [44927.056952] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.063896] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.069199] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.075711] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.081519] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.088023] z_wr_int_h S ffff885eb97e0fd0 0 18818 2 0x00000000 2018-04-08 13:24:04 [44927.095532] Call Trace: 2018-04-08 13:24:04 [44927.098408] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.103795] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.110211] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.116202] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.123145] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.128440] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.134946] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.140761] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.147258] z_fr_iss_0 S ffff885eb97e5ee0 0 18819 2 0x00000000 2018-04-08 13:24:04 [44927.154765] Call Trace: 2018-04-08 13:24:04 [44927.157633] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.163019] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.169442] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.175430] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.182361] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.187649] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.194144] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.199954] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.206450] z_fr_iss_1 S ffff885ebbc3dee0 0 18820 2 0x00000000 2018-04-08 13:24:04 [44927.213951] Call Trace: 2018-04-08 13:24:04 [44927.216814] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.222191] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.228606] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.234591] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.241521] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.246807] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.253302] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.259103] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.265596] z_fr_iss_2 S ffff885ebbc38fd0 0 18821 2 0x00000000 2018-04-08 13:24:04 [44927.273091] Call Trace: 2018-04-08 13:24:04 [44927.275946] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.281312] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.287719] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.293695] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.300620] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.305897] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.312388] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.318179] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.324664] z_fr_iss_3 S ffff885ebbc3eeb0 0 18822 2 0x00000000 2018-04-08 13:24:04 [44927.332155] Call Trace: 2018-04-08 13:24:04 [44927.335009] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.340374] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.346773] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.352750] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.359673] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.364953] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.371435] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.377222] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.383707] z_fr_iss_4 S ffff885ebd9bbf40 0 18823 2 0x00000000 2018-04-08 13:24:04 [44927.391199] Call Trace: 2018-04-08 13:24:04 [44927.394048] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.399415] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.405812] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.411782] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.418706] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.423984] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.430470] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.436257] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.442743] z_fr_iss_5 S ffff885ebd9b8000 0 18824 2 0x00000000 2018-04-08 13:24:04 [44927.450235] Call Trace: 2018-04-08 13:24:04 [44927.453089] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.458455] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.464853] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.470822] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.477746] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.483028] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.489517] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.495308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.501793] z_fr_iss_6 S ffff885ebd9b8fd0 0 18825 2 0x00000000 2018-04-08 13:24:04 [44927.509282] Call Trace: 2018-04-08 13:24:04 [44927.512131] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.517497] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.523895] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.529861] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.536784] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.542059] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.548549] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.554337] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.560823] z_fr_iss_7 S ffff885ebd9b9fa0 0 18826 2 0x00000000 2018-04-08 13:24:04 [44927.568315] Call Trace: 2018-04-08 13:24:04 [44927.571163] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.576530] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.582934] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.588902] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.595825] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.601099] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.607581] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.613373] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.619855] z_fr_int S ffff885ebd9bcf10 0 18827 2 0x00000000 2018-04-08 13:24:04 [44927.627348] Call Trace: 2018-04-08 13:24:04 [44927.630195] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.635560] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.641960] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.647935] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.654859] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.660141] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.666622] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.672414] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.678896] z_cl_iss S ffff885ebd9beeb0 0 18828 2 0x00000000 2018-04-08 13:24:04 [44927.686387] Call Trace: 2018-04-08 13:24:04 [44927.689235] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.694601] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.700999] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.706967] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.713891] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.719172] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.725656] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.731445] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.737929] z_cl_int S ffff885ebd9baf70 0 18829 2 0x00000000 2018-04-08 13:24:04 [44927.745421] Call Trace: 2018-04-08 13:24:04 [44927.748269] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.753634] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.760033] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.766009] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.772932] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.778213] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.784696] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.790483] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.796969] z_ioctl_iss S ffff88012e948fd0 0 18830 2 0x00000000 2018-04-08 13:24:04 [44927.804462] Call Trace: 2018-04-08 13:24:04 [44927.807311] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.812677] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.819082] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.825053] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:04 [44927.831976] [] kthread+0xcf/0xe0 2018-04-08 13:24:04 [44927.837257] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.843745] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:04 [44927.849537] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:04 [44927.856021] z_ioctl_int S ffff88012e94af70 0 18831 2 0x00000000 2018-04-08 13:24:04 [44927.863513] Call Trace: 2018-04-08 13:24:04 [44927.866368] [] schedule+0x29/0x70 2018-04-08 13:24:04 [44927.871735] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:04 [44927.878139] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:04 [44927.884124] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:05 [44927.892614] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44927.899548] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44927.904831] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44927.911323] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44927.917122] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44927.923609] z_zvol S ffff88012e94bf40 0 18832 2 0x00000000 2018-04-08 13:24:05 [44927.931110] Call Trace: 2018-04-08 13:24:05 [44927.933966] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44927.939341] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44927.945747] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44927.951725] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44927.958658] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44927.963941] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44927.970435] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44927.976234] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44927.982718] z_upgrade S ffff88012cb90fd0 0 18833 2 0x00000000 2018-04-08 13:24:05 [44927.990211] Call Trace: 2018-04-08 13:24:05 [44927.993065] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44927.998434] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.004839] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.010815] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.017741] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.023017] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.029510] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.035309] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.041794] metaslab_group_ S ffff88012cb93f40 0 18834 2 0x00000000 2018-04-08 13:24:05 [44928.049295] Call Trace: 2018-04-08 13:24:05 [44928.052151] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.057517] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.063928] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.069911] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.076843] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.082120] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:05 [44928.088611] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.095104] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.100905] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.107398] dp_sync_taskq S ffff88012cb91fa0 0 18840 2 0x00000000 2018-04-08 13:24:05 [44928.114899] Call Trace: 2018-04-08 13:24:05 [44928.117754] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.123119] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.129529] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.135504] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.142427] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.147702] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.154189] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.159987] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.166471] dp_sync_taskq S ffff88012cb90000 0 18841 2 0x00000000 2018-04-08 13:24:05 [44928.173963] Call Trace: 2018-04-08 13:24:05 [44928.176816] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.182184] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.188588] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.194565] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.201488] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.206768] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.213252] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.219040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.225525] dp_sync_taskq S ffff88012cb94f10 0 18842 2 0x00000000 2018-04-08 13:24:05 [44928.233018] Call Trace: 2018-04-08 13:24:05 [44928.235875] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.241239] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.247639] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.253616] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.260538] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.265814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.272298] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.278090] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.284574] dp_sync_taskq S ffff88be662b2f70 0 18843 2 0x00000000 2018-04-08 13:24:05 [44928.292058] Call Trace: 2018-04-08 13:24:05 [44928.294906] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.300271] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.306671] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.312645] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.319574] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.324850] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:05 [44928.331330] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.337815] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.343607] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.350089] dp_sync_taskq S ffff88be662b6eb0 0 18844 2 0x00000000 2018-04-08 13:24:05 [44928.357584] Call Trace: 2018-04-08 13:24:05 [44928.360439] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.365808] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.372211] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.378180] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.385109] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.390381] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.396865] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.402658] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.409140] dp_sync_taskq S ffff88be662b1fa0 0 18845 2 0x00000000 2018-04-08 13:24:05 [44928.416634] Call Trace: 2018-04-08 13:24:05 [44928.419490] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.424854] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.431253] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.437230] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.444155] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.449433] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.455914] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.461708] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.468190] dp_sync_taskq S ffff88be662b0fd0 0 18846 2 0x00000000 2018-04-08 13:24:05 [44928.475682] Call Trace: 2018-04-08 13:24:05 [44928.478533] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.483896] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.490293] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.496261] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.503186] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.508465] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.514946] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.520740] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.527222] dp_sync_taskq S ffff88be662b4f10 0 18847 2 0x00000000 2018-04-08 13:24:05 [44928.534717] Call Trace: 2018-04-08 13:24:05 [44928.537572] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.542936] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.549338] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.555311] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.562241] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.567512] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.573998] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.579789] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.586271] dp_sync_taskq S ffff88be662b0000 0 18848 2 0x00000000 2018-04-08 13:24:05 [44928.593774] Call Trace: 2018-04-08 13:24:05 [44928.596631] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.601996] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.608402] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.614380] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.621303] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.626587] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.633076] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.638863] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.645348] dp_sync_taskq S ffff88be662b5ee0 0 18849 2 0x00000000 2018-04-08 13:24:05 [44928.652844] Call Trace: 2018-04-08 13:24:05 [44928.655697] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.661064] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.667471] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.673445] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.680372] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.685651] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.692142] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.697933] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.704416] dp_sync_taskq S ffff88be662b3f40 0 18850 2 0x00000000 2018-04-08 13:24:05 [44928.711909] Call Trace: 2018-04-08 13:24:05 [44928.714767] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.720134] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.726540] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.732514] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.739439] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.744720] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.751209] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.756998] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.763484] dp_sync_taskq S ffff88606e3faf70 0 18851 2 0x00000000 2018-04-08 13:24:05 [44928.770977] Call Trace: 2018-04-08 13:24:05 [44928.773834] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.779197] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.785603] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.791573] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.798497] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.803777] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.810267] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.816057] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.822541] z_iput S ffff88606e3fdee0 0 18852 2 0x00000000 2018-04-08 13:24:05 [44928.830032] Call Trace: 2018-04-08 13:24:05 [44928.832884] [] schedule+0x29/0x70 2018-04-08 13:24:05 [44928.838248] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:05 [44928.844653] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:05 [44928.850628] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:05 [44928.857552] [] kthread+0xcf/0xe0 2018-04-08 13:24:05 [44928.862836] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.869324] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:05 [44928.875117] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:05 [44928.881598] txg_quiesce S ffff885eb9a4eeb0 0 18937 2 0x00000000 2018-04-08 13:24:06 [44928.889091] Call Trace: 2018-04-08 13:24:06 [44928.891948] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44928.897314] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:06 [44928.903891] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:06 [44928.910119] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:06 [44928.916458] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:06 [44928.923399] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:06 [44928.929631] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:06 [44928.936728] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:06 [44928.943208] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44928.948484] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44928.954966] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44928.960760] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44928.967242] txg_sync S ffff885eb9a4dee0 0 18938 2 0x00000000 2018-04-08 13:24:06 [44928.974737] Call Trace: 2018-04-08 13:24:06 [44928.977593] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44928.982960] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:06 [44928.989206] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:06 [44928.995858] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:06 [44929.002257] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:06 [44929.009265] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:06 [44929.016352] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:06 [44929.022580] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:06 [44929.029343] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:06 [44929.036021] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:06 [44929.042250] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:06 [44929.049348] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:06 [44929.055834] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.061103] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.067579] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.073364] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.079846] mmp S ffff885eb9a4af70 0 18939 2 0x00000000 2018-04-08 13:24:06 [44929.087332] Call Trace: 2018-04-08 13:24:06 [44929.090179] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.095534] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:06 [44929.101759] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:06 [44929.108159] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:06 [44929.115246] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:06 [44929.121470] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:06 [44929.128228] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:06 [44929.134462] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:06 [44929.141130] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:06 [44929.147873] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:06 [44929.154962] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:06 [44929.161445] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.166720] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.173203] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.178982] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.185456] z_null_iss S ffff88606d541fa0 0 19329 2 0x00000000 2018-04-08 13:24:06 [44929.192938] Call Trace: 2018-04-08 13:24:06 [44929.195779] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.201136] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.207525] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.213497] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.221969] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.228886] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.234158] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.240640] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.246435] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.252917] z_null_int S ffff88606d543f40 0 19330 2 0x00000000 2018-04-08 13:24:06 [44929.260411] Call Trace: 2018-04-08 13:24:06 [44929.263257] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.268621] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.275019] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.281001] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.289482] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.296406] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.301686] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.308178] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.313969] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.320456] z_rd_iss S ffff88606d540fd0 0 19331 2 0x00000000 2018-04-08 13:24:06 [44929.327954] Call Trace: 2018-04-08 13:24:06 [44929.330812] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.336177] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.342584] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.348572] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.357065] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.363996] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.369287] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.375786] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.381584] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.388079] z_rd_int_0 S ffff88606d542f70 0 19332 2 0x00000000 2018-04-08 13:24:06 [44929.395579] Call Trace: 2018-04-08 13:24:06 [44929.398445] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.403820] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.410233] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.416232] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.424731] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.431673] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.436963] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.443466] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.449285] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.455794] z_rd_int_1 S ffff88606d544f10 0 19333 2 0x00000000 2018-04-08 13:24:06 [44929.463302] Call Trace: 2018-04-08 13:24:06 [44929.466175] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.471560] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.477981] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.483985] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.492484] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.499425] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.504725] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.511232] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.517046] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.523547] z_rd_int_2 S ffff88bdd4fd4f10 0 19334 2 0x00000000 2018-04-08 13:24:06 [44929.531058] Call Trace: 2018-04-08 13:24:06 [44929.533932] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.539316] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.545737] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.551741] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.560242] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.567182] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.572480] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.578986] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.584802] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.591306] z_rd_int_3 S ffff88bdd4fd6eb0 0 19335 2 0x00000000 2018-04-08 13:24:06 [44929.598810] Call Trace: 2018-04-08 13:24:06 [44929.601679] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.607064] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.613480] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.619479] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.627979] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.634919] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.640217] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.646727] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.652543] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.659060] z_rd_int_4 S ffff88bdd4fd2f70 0 19336 2 0x00000000 2018-04-08 13:24:06 [44929.666568] Call Trace: 2018-04-08 13:24:06 [44929.669442] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.674827] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.681247] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.687252] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.695751] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.702691] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.707990] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.714500] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.720311] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.726813] z_rd_int_5 S ffff88bdd4fd5ee0 0 19337 2 0x00000000 2018-04-08 13:24:06 [44929.734323] Call Trace: 2018-04-08 13:24:06 [44929.737199] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.742582] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.749001] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.754998] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.763497] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.770440] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.775739] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.782245] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.788060] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.794562] z_rd_int_6 S ffff88bdd4fd1fa0 0 19338 2 0x00000000 2018-04-08 13:24:06 [44929.802072] Call Trace: 2018-04-08 13:24:06 [44929.804947] [] schedule+0x29/0x70 2018-04-08 13:24:06 [44929.810330] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:06 [44929.816749] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:06 [44929.822752] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:06 [44929.831255] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:06 [44929.838194] [] kthread+0xcf/0xe0 2018-04-08 13:24:06 [44929.843493] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.850000] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:06 [44929.855810] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:06 [44929.862310] z_rd_int_7 S ffff88bdd4fd0000 0 19339 2 0x00000000 2018-04-08 13:24:07 [44929.869818] Call Trace: 2018-04-08 13:24:07 [44929.872692] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44929.878076] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44929.884498] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44929.890501] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44929.899000] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44929.905943] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44929.911241] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44929.917747] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44929.923554] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44929.930055] z_wr_iss S ffff88bdd4fd3f40 0 19340 2 0x00000000 2018-04-08 13:24:07 [44929.937566] Call Trace: 2018-04-08 13:24:07 [44929.940442] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44929.945833] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44929.952252] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44929.958257] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44929.966757] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44929.973699] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44929.978996] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44929.985506] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44929.991317] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44929.997819] z_wr_iss S ffff88bdd4fd0fd0 0 19341 2 0x00000000 2018-04-08 13:24:07 [44930.005330] Call Trace: 2018-04-08 13:24:07 [44930.008207] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.013586] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.020010] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.026015] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.034514] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.041453] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.046754] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.053266] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.059077] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.065579] z_wr_iss S ffff88be6a631fa0 0 19342 2 0x00000000 2018-04-08 13:24:07 [44930.073085] Call Trace: 2018-04-08 13:24:07 [44930.075961] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.081343] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.087762] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.093759] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.102261] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.109203] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.114497] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.121009] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.126823] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.133324] z_wr_iss S ffff88be6a630fd0 0 19343 2 0x00000000 2018-04-08 13:24:07 [44930.140834] Call Trace: 2018-04-08 13:24:07 [44930.143708] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.149090] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.155509] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.161507] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.170008] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.176952] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.182256] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.188764] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.194580] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.201077] z_wr_iss S ffff88be6a630000 0 19344 2 0x00000000 2018-04-08 13:24:07 [44930.208589] Call Trace: 2018-04-08 13:24:07 [44930.211463] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.216847] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.223267] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.229271] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.237771] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.244715] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.250010] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.256519] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.262336] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.268843] z_wr_iss S ffff88be6a632f70 0 19345 2 0x00000000 2018-04-08 13:24:07 [44930.276356] Call Trace: 2018-04-08 13:24:07 [44930.279228] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.284610] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.291033] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.297035] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.305536] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.312477] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.317775] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.324284] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.330099] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.336600] z_wr_iss S ffff88be6a636eb0 0 19346 2 0x00000000 2018-04-08 13:24:07 [44930.344108] Call Trace: 2018-04-08 13:24:07 [44930.346983] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.352376] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.358794] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.364791] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.373294] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.380231] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.385530] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.392038] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.397853] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.404354] z_wr_iss S ffff88be6a635ee0 0 19347 2 0x00000000 2018-04-08 13:24:07 [44930.411865] Call Trace: 2018-04-08 13:24:07 [44930.414740] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.420125] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.426543] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.432551] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.441059] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.448007] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.453306] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.459816] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.465626] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.472129] z_wr_iss S ffff88be6a633f40 0 19348 2 0x00000000 2018-04-08 13:24:07 [44930.479628] Call Trace: 2018-04-08 13:24:07 [44930.482506] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.487898] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.494314] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.500311] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.508812] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.515754] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.521050] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.527558] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.533373] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.539876] z_wr_iss S ffff88be6a634f10 0 19349 2 0x00000000 2018-04-08 13:24:07 [44930.547386] Call Trace: 2018-04-08 13:24:07 [44930.550260] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.555645] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.562064] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.568067] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.576568] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.583511] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.588808] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.595314] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.601130] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.607631] z_wr_iss S ffff88be66372f70 0 19350 2 0x00000000 2018-04-08 13:24:07 [44930.615141] Call Trace: 2018-04-08 13:24:07 [44930.618015] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.623400] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.629819] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.635824] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.644324] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.651264] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.656560] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.663074] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.668884] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.675385] z_wr_iss S ffff88be66370000 0 19351 2 0x00000000 2018-04-08 13:24:07 [44930.682897] Call Trace: 2018-04-08 13:24:07 [44930.685770] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.691155] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.697574] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.703571] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.712073] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.719012] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.724309] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.730819] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.736631] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.743138] z_wr_iss_h S ffff88be66376eb0 0 19352 2 0x00000000 2018-04-08 13:24:07 [44930.750651] Call Trace: 2018-04-08 13:24:07 [44930.753528] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.758913] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.765330] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.771321] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.778253] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.783545] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.790047] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.795851] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.802350] z_wr_int_0 S ffff88be66373f40 0 19353 2 0x00000000 2018-04-08 13:24:07 [44930.809850] Call Trace: 2018-04-08 13:24:07 [44930.812718] [] schedule+0x29/0x70 2018-04-08 13:24:07 [44930.818100] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:07 [44930.824515] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:07 [44930.830511] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:07 [44930.839011] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:07 [44930.845950] [] kthread+0xcf/0xe0 2018-04-08 13:24:07 [44930.851240] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:07 [44930.857740] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:07 [44930.863550] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44930.870043] z_wr_int_1 S ffff88beb2561fa0 0 19354 2 0x00000000 2018-04-08 13:24:08 [44930.877545] Call Trace: 2018-04-08 13:24:08 [44930.880411] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44930.885788] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44930.892200] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44930.898195] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44930.906685] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44930.913619] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44930.918905] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44930.925410] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44930.931217] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44930.937714] z_wr_int_2 S ffff88beb2562f70 0 19355 2 0x00000000 2018-04-08 13:24:08 [44930.945214] Call Trace: 2018-04-08 13:24:08 [44930.948080] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44930.953454] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44930.959871] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44930.965863] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44930.974354] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44930.981288] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44930.986577] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44930.993080] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44930.998887] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.005383] z_wr_int_3 S ffff88beb2565ee0 0 19356 2 0x00000000 2018-04-08 13:24:08 [44931.012886] Call Trace: 2018-04-08 13:24:08 [44931.015750] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.021132] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.027551] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.033542] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44931.042036] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.048975] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.054263] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.060767] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.066574] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.073074] z_wr_int_4 S ffff88beb2564f10 0 19357 2 0x00000000 2018-04-08 13:24:08 [44931.080584] Call Trace: 2018-04-08 13:24:08 [44931.083448] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.088837] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.095255] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.101250] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44931.109755] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.116700] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.121998] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.128505] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.134313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.140816] z_wr_int_5 S ffff88beb2563f40 0 19358 2 0x00000000 2018-04-08 13:24:08 [44931.148325] Call Trace: 2018-04-08 13:24:08 [44931.151197] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.156584] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.163001] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.168998] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44931.177498] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.184441] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.189739] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.196245] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.202052] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.208553] z_wr_int_6 S ffff88beb2560fd0 0 19359 2 0x00000000 2018-04-08 13:24:08 [44931.216063] Call Trace: 2018-04-08 13:24:08 [44931.218935] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.224323] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.230740] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.236737] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44931.245238] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.252180] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.257477] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.263983] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.269792] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.276293] z_wr_int_7 S ffff88beb2566eb0 0 19360 2 0x00000000 2018-04-08 13:24:08 [44931.283799] Call Trace: 2018-04-08 13:24:08 [44931.286666] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.292053] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.298470] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.304466] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:08 [44931.312968] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.319907] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.325207] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.331715] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.337527] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.344030] z_wr_int_h S ffff88beb8ac2f70 0 19361 2 0x00000000 2018-04-08 13:24:08 [44931.351538] Call Trace: 2018-04-08 13:24:08 [44931.354406] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.359789] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.366209] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.372199] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.379133] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.384424] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.390928] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.396740] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.403239] z_fr_iss_0 S ffff88beb8ac5ee0 0 19362 2 0x00000000 2018-04-08 13:24:08 [44931.410747] Call Trace: 2018-04-08 13:24:08 [44931.413614] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.419001] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.425422] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.431400] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.438334] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.443624] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.450126] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.455935] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.462433] z_fr_iss_1 S ffff88beb8ac4f10 0 19363 2 0x00000000 2018-04-08 13:24:08 [44931.469930] Call Trace: 2018-04-08 13:24:08 [44931.472787] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.478163] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.484581] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.490564] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.497491] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.502771] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.509265] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.515066] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.521559] z_fr_iss_2 S ffff88beb8ac3f40 0 19364 2 0x00000000 2018-04-08 13:24:08 [44931.529055] Call Trace: 2018-04-08 13:24:08 [44931.531911] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.537274] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.543686] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.549662] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.556593] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.561866] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.568353] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.574150] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.580640] z_fr_iss_3 S ffff885eb5ab0fd0 0 19365 2 0x00000000 2018-04-08 13:24:08 [44931.588138] Call Trace: 2018-04-08 13:24:08 [44931.590991] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.596356] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.602751] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.608719] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.615636] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.620917] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.627398] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.633188] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.639672] z_fr_iss_4 S ffff885eb5ab2f70 0 19366 2 0x00000000 2018-04-08 13:24:08 [44931.647164] Call Trace: 2018-04-08 13:24:08 [44931.650010] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.655368] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.661766] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.667734] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.674662] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.679939] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.686420] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.692211] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.698694] z_fr_iss_5 S ffff885eb5ab1fa0 0 19367 2 0x00000000 2018-04-08 13:24:08 [44931.706177] Call Trace: 2018-04-08 13:24:08 [44931.709028] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.714392] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.720792] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.726760] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.733683] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.738969] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.745452] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.751246] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.757729] z_fr_iss_6 S ffff885eb5ab6eb0 0 19368 2 0x00000000 2018-04-08 13:24:08 [44931.765222] Call Trace: 2018-04-08 13:24:08 [44931.768068] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.773433] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.779834] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.785807] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.792726] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.798005] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.804485] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:08 [44931.810277] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.816761] z_fr_iss_7 S ffff885eb5ab3f40 0 19369 2 0x00000000 2018-04-08 13:24:08 [44931.824253] Call Trace: 2018-04-08 13:24:08 [44931.827102] [] schedule+0x29/0x70 2018-04-08 13:24:08 [44931.832470] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:08 [44931.838872] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:08 [44931.844839] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:08 [44931.851761] [] kthread+0xcf/0xe0 2018-04-08 13:24:08 [44931.857038] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:08 [44931.863517] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44931.869308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44931.875792] z_fr_int S ffff885ebd806eb0 0 19370 2 0x00000000 2018-04-08 13:24:09 [44931.883284] Call Trace: 2018-04-08 13:24:09 [44931.886136] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44931.891500] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44931.897898] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44931.903875] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44931.910799] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44931.916078] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44931.922562] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44931.928351] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44931.934836] z_cl_iss S ffff885ebd803f40 0 19371 2 0x00000000 2018-04-08 13:24:09 [44931.942325] Call Trace: 2018-04-08 13:24:09 [44931.945174] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44931.950542] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44931.956945] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44931.962915] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44931.969839] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44931.975120] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44931.981601] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44931.987390] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44931.993876] z_cl_int S ffff885ebd805ee0 0 19372 2 0x00000000 2018-04-08 13:24:09 [44932.001366] Call Trace: 2018-04-08 13:24:09 [44932.004216] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.009582] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.015988] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.021955] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.028881] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.034161] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.040643] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.046435] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.052914] z_ioctl_iss S ffff88012cb92f70 0 19373 2 0x00000000 2018-04-08 13:24:09 [44932.060408] Call Trace: 2018-04-08 13:24:09 [44932.063258] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.068622] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.075019] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.080989] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.087912] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.093194] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.099684] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.105475] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.111955] z_ioctl_int S ffff88012cb95ee0 0 19374 2 0x00000000 2018-04-08 13:24:09 [44932.119439] Call Trace: 2018-04-08 13:24:09 [44932.122289] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.127653] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.134050] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.140035] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:09 [44932.148516] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.155440] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.160717] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.167209] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.173009] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.179497] z_zvol S ffff88012cf4bf40 0 19375 2 0x00000000 2018-04-08 13:24:09 [44932.186991] Call Trace: 2018-04-08 13:24:09 [44932.189848] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.195215] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.201621] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.207597] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.214526] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.219799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.226286] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.232084] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.238568] z_upgrade S ffff88012cf48000 0 19376 2 0x00000000 2018-04-08 13:24:09 [44932.246058] Call Trace: 2018-04-08 13:24:09 [44932.248920] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.254291] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.260700] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.266675] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.273603] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.278883] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.285370] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.291170] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.297654] metaslab_group_ S ffff885ebcf82f70 0 19377 2 0x00000000 2018-04-08 13:24:09 [44932.305143] Call Trace: 2018-04-08 13:24:09 [44932.308002] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.313366] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.319775] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.325748] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.332675] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.337952] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.344443] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.350238] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.356728] dp_sync_taskq S ffff885ebcf80000 0 19381 2 0x00000000 2018-04-08 13:24:09 [44932.364220] Call Trace: 2018-04-08 13:24:09 [44932.367076] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.372443] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.378850] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.384825] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.391754] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.397037] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.403532] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.409329] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.415816] dp_sync_taskq S ffff885ebcf80fd0 0 19382 2 0x00000000 2018-04-08 13:24:09 [44932.423315] Call Trace: 2018-04-08 13:24:09 [44932.426168] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.431531] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.437928] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.443897] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.450823] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.456104] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.462594] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.468381] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.474867] dp_sync_taskq S ffff885ebcf81fa0 0 19383 2 0x00000000 2018-04-08 13:24:09 [44932.482349] Call Trace: 2018-04-08 13:24:09 [44932.485199] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.490564] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.496962] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.502930] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.509855] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.515135] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.521616] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.527406] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.533892] dp_sync_taskq S ffff88606d32af70 0 19384 2 0x00000000 2018-04-08 13:24:09 [44932.541373] Call Trace: 2018-04-08 13:24:09 [44932.544222] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.549588] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.555984] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.561952] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.568879] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.574158] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.580642] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.586431] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.592917] dp_sync_taskq S ffff88606d32eeb0 0 19385 2 0x00000000 2018-04-08 13:24:09 [44932.600406] Call Trace: 2018-04-08 13:24:09 [44932.603253] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.608623] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.615029] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.621003] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.627927] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.633208] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.639698] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.645489] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.651975] dp_sync_taskq S ffff88606d328000 0 19386 2 0x00000000 2018-04-08 13:24:09 [44932.659462] Call Trace: 2018-04-08 13:24:09 [44932.662315] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.667680] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.674084] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.680051] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.686978] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.692260] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.698748] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.704536] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.711023] dp_sync_taskq S ffff88bddee6cf10 0 19387 2 0x00000000 2018-04-08 13:24:09 [44932.718504] Call Trace: 2018-04-08 13:24:09 [44932.721353] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.726722] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.733126] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.739102] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.746026] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.751308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.757799] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.763591] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.770071] dp_sync_taskq S ffff88bddee69fa0 0 19388 2 0x00000000 2018-04-08 13:24:09 [44932.777564] Call Trace: 2018-04-08 13:24:09 [44932.780412] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.785779] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.792185] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.798162] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.805087] [] kthread+0xcf/0xe0 2018-04-08 13:24:09 [44932.810368] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.816857] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:09 [44932.822645] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:09 [44932.829130] dp_sync_taskq S ffff88bddee6eeb0 0 19389 2 0x00000000 2018-04-08 13:24:09 [44932.836631] Call Trace: 2018-04-08 13:24:09 [44932.839478] [] schedule+0x29/0x70 2018-04-08 13:24:09 [44932.844846] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:09 [44932.851250] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:09 [44932.857218] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:09 [44932.864143] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44932.869424] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44932.875907] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44932.881697] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44932.888180] dp_sync_taskq S ffff88bddee68000 0 19390 2 0x00000000 2018-04-08 13:24:10 [44932.895671] Call Trace: 2018-04-08 13:24:10 [44932.898522] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44932.903887] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44932.910294] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44932.916268] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44932.923193] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44932.928473] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44932.934957] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44932.940747] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44932.947231] dp_sync_taskq S ffff88bddee6af70 0 19391 2 0x00000000 2018-04-08 13:24:10 [44932.954721] Call Trace: 2018-04-08 13:24:10 [44932.957571] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44932.962938] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44932.969344] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44932.975320] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44932.982241] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44932.987525] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44932.994013] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44932.999802] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.006288] dp_sync_taskq S ffff88bddee6dee0 0 19392 2 0x00000000 2018-04-08 13:24:10 [44933.013782] Call Trace: 2018-04-08 13:24:10 [44933.016637] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.022005] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.028410] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.034388] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.041311] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.046590] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.053081] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.058872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.065353] z_iput S ffff88bddee68fd0 0 19393 2 0x00000000 2018-04-08 13:24:10 [44933.072847] Call Trace: 2018-04-08 13:24:10 [44933.075697] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.081065] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.087469] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.093446] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.100368] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.105650] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.112139] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.117934] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.124413] txg_quiesce S ffff88012ca5af70 0 19593 2 0x00000000 2018-04-08 13:24:10 [44933.131906] Call Trace: 2018-04-08 13:24:10 [44933.134764] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.140128] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:10 [44933.146707] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:10 [44933.152945] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:10 [44933.159280] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:10 [44933.166222] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:10 [44933.172454] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:10 [44933.179550] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:10 [44933.186035] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.191305] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.197792] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.203582] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.210064] txg_sync S ffff88012ca59fa0 0 19594 2 0x00000000 2018-04-08 13:24:10 [44933.217560] Call Trace: 2018-04-08 13:24:10 [44933.220417] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.225782] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:10 [44933.232028] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:10 [44933.238684] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:10 [44933.245083] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:10 [44933.252089] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:10 [44933.259187] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:10 [44933.265422] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:10 [44933.272186] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:10 [44933.278863] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:10 [44933.285087] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:10 [44933.292183] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:10 [44933.298666] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.303936] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.310419] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.316203] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.322681] mmp S ffff88012ca58000 0 19595 2 0x00000000 2018-04-08 13:24:10 [44933.330171] Call Trace: 2018-04-08 13:24:10 [44933.333018] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.338377] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:10 [44933.344598] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:10 [44933.351000] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:10 [44933.358084] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:10 [44933.364311] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:10 [44933.371070] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:10 [44933.377310] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:10 [44933.383975] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:10 [44933.390714] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:10 [44933.397801] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:10 [44933.404284] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.409548] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.416027] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.421814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.428289] z_null_iss S ffff885ebbc28000 0 19953 2 0x00000000 2018-04-08 13:24:10 [44933.435771] Call Trace: 2018-04-08 13:24:10 [44933.438609] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.443969] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.450356] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.456331] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:10 [44933.464806] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.471723] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.476997] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.483480] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.489276] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.495757] z_null_int S ffff885ebbc2af70 0 19954 2 0x00000000 2018-04-08 13:24:10 [44933.503252] Call Trace: 2018-04-08 13:24:10 [44933.506098] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.511462] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.517857] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.523841] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:10 [44933.532325] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.539245] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.544526] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.551021] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.556817] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.563305] z_rd_iss S ffff885ebbc2bf40 0 19955 2 0x00000000 2018-04-08 13:24:10 [44933.570805] Call Trace: 2018-04-08 13:24:10 [44933.573660] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.579026] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.585432] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.591422] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:10 [44933.599915] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.606843] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.612128] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.618626] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.624425] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.630918] z_rd_int_0 S ffff885ebbc2cf10 0 19956 2 0x00000000 2018-04-08 13:24:10 [44933.638420] Call Trace: 2018-04-08 13:24:10 [44933.641287] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.646661] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.653073] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.659073] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:10 [44933.667571] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.674512] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.679804] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.686303] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.692114] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.698613] z_rd_int_1 S ffff885ebbc2eeb0 0 19957 2 0x00000000 2018-04-08 13:24:10 [44933.706124] Call Trace: 2018-04-08 13:24:10 [44933.709000] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.714383] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.720803] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.726808] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:10 [44933.735311] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.742257] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.747555] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.754063] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.759878] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.766379] z_rd_int_2 S ffff88012ced2f70 0 19958 2 0x00000000 2018-04-08 13:24:10 [44933.773890] Call Trace: 2018-04-08 13:24:10 [44933.776763] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.782147] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.788565] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.794566] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:10 [44933.803064] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:10 [44933.810005] [] kthread+0xcf/0xe0 2018-04-08 13:24:10 [44933.815301] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.821809] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:10 [44933.827625] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:10 [44933.834126] z_rd_int_3 S ffff88012ced0000 0 19959 2 0x00000000 2018-04-08 13:24:10 [44933.841637] Call Trace: 2018-04-08 13:24:10 [44933.844512] [] schedule+0x29/0x70 2018-04-08 13:24:10 [44933.849896] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:10 [44933.856313] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:10 [44933.862311] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44933.870811] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44933.877752] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44933.883051] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44933.889560] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44933.895372] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44933.901873] z_rd_int_4 S ffff88012cd5bf40 0 19960 2 0x00000000 2018-04-08 13:24:11 [44933.909386] Call Trace: 2018-04-08 13:24:11 [44933.912258] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44933.917642] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44933.924062] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44933.930069] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44933.938567] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44933.945509] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44933.950807] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44933.957313] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44933.963129] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44933.969629] z_rd_int_5 S ffff88012cd5eeb0 0 19961 2 0x00000000 2018-04-08 13:24:11 [44933.977138] Call Trace: 2018-04-08 13:24:11 [44933.980014] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44933.985396] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44933.991817] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44933.997822] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.006322] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.013265] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.018560] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.025069] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.030887] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.037394] z_rd_int_6 S ffff88012cd58000 0 19962 2 0x00000000 2018-04-08 13:24:11 [44934.044904] Call Trace: 2018-04-08 13:24:11 [44934.047780] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.053172] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.059589] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.065585] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.074087] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.081029] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.086325] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.092836] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.098648] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.105147] z_rd_int_7 S ffff88012cd5dee0 0 19963 2 0x00000000 2018-04-08 13:24:11 [44934.112651] Call Trace: 2018-04-08 13:24:11 [44934.115526] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.120910] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.127329] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.133334] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.141834] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.148774] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.154074] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.160579] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.166398] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.172904] z_wr_iss S ffff88012cd59fa0 0 19964 2 0x00000000 2018-04-08 13:24:11 [44934.180415] Call Trace: 2018-04-08 13:24:11 [44934.183288] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.188672] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.195090] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.201089] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.209590] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.216531] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.221827] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.228338] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.234149] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.240650] z_wr_iss S ffff885e9c8bcf10 0 19965 2 0x00000000 2018-04-08 13:24:11 [44934.248161] Call Trace: 2018-04-08 13:24:11 [44934.251036] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.256420] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.262838] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.268835] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.277335] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.284277] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.289576] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.296082] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.301900] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.308398] z_wr_iss S ffff885e9c8bdee0 0 19966 2 0x00000000 2018-04-08 13:24:11 [44934.315909] Call Trace: 2018-04-08 13:24:11 [44934.318785] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.324168] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.330587] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.336596] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.345103] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.352052] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.357347] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.363858] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.369675] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.376183] z_wr_iss S ffff885e9c8b8fd0 0 19967 2 0x00000000 2018-04-08 13:24:11 [44934.383693] Call Trace: 2018-04-08 13:24:11 [44934.386566] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.391947] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.398370] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.404374] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.412875] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.419815] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.425112] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.431620] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.437436] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.443938] z_wr_iss S ffff885e9c8beeb0 0 19968 2 0x00000000 2018-04-08 13:24:11 [44934.451448] Call Trace: 2018-04-08 13:24:11 [44934.454320] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.459705] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.466126] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.472129] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.480631] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.487579] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.492880] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.499387] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.505202] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.511701] z_wr_iss S ffff885e9c8bbf40 0 19969 2 0x00000000 2018-04-08 13:24:11 [44934.519210] Call Trace: 2018-04-08 13:24:11 [44934.522085] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.527470] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.533889] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.539892] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.548395] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.555334] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.560633] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.567141] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.572957] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.579457] z_wr_iss S ffff885e9c8b8000 0 19970 2 0x00000000 2018-04-08 13:24:11 [44934.5fffff816ab8a9>] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.595233] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.601655] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.607659] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.616161] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.623108] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.628405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.634914] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.640728] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.647228] z_wr_iss S ffff885e9c8baf70 0 19971 2 0x00000000 2018-04-08 13:24:11 [44934.654738] Call Trace: 2018-04-08 13:24:11 [44934.657615] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.662998] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.669417] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.675414] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.683913] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.690857] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.696156] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.702661] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.708476] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.714977] z_wr_iss S ffff885ebd97eeb0 0 19972 2 0x00000000 2018-04-08 13:24:11 [44934.722485] Call Trace: 2018-04-08 13:24:11 [44934.725361] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.730745] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.737164] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.743158] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.751664] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.758613] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.763915] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.770426] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.776239] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.782741] z_wr_iss S ffff885ebd979fa0 0 19973 2 0x00000000 2018-04-08 13:24:11 [44934.790253] Call Trace: 2018-04-08 13:24:11 [44934.793125] [] schedule+0x29/0x70 2018-04-08 13:24:11 [44934.798512] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:11 [44934.804927] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:11 [44934.810927] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:11 [44934.819432] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:11 [44934.826375] [] kthread+0xcf/0xe0 2018-04-08 13:24:11 [44934.831674] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:11 [44934.838181] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:11 [44934.843994] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44934.850498] z_wr_iss S ffff885ebd978000 0 19974 2 0x00000000 2018-04-08 13:24:12 [44934.858004] Call Trace: 2018-04-08 13:24:12 [44934.860871] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44934.866260] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44934.872675] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44934.878672] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44934.887175] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44934.894124] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44934.899421] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44934.905931] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44934.911746] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44934.918248] z_wr_iss S ffff885ebd97dee0 0 19975 2 0x00000000 2018-04-08 13:24:12 [44934.925764] Call Trace: 2018-04-08 13:24:12 [44934.928639] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44934.934031] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44934.940448] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44934.946446] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44934.954945] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44934.961889] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44934.967186] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44934.973693] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44934.979507] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44934.986010] z_wr_iss_h S ffff885ebd97bf40 0 19976 2 0x00000000 2018-04-08 13:24:12 [44934.993516] Call Trace: 2018-04-08 13:24:12 [44934.996386] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.001779] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.008198] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.014188] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.021132] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.026426] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.032931] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.038744] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.045244] z_wr_int_0 S ffff885eb5908000 0 19977 2 0x00000000 2018-04-08 13:24:12 [44935.052750] Call Trace: 2018-04-08 13:24:12 [44935.055619] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.061003] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.067415] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.073411] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.081909] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.088853] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.094149] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.100652] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.106459] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.112957] z_wr_int_1 S ffff885eac918000 0 19978 2 0x00000000 2018-04-08 13:24:12 [44935.120464] Call Trace: 2018-04-08 13:24:12 [44935.123332] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.128714] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.135130] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.141123] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.149623] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.156563] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.161854] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.168358] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.174173] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.180671] z_wr_int_2 S ffff88012d452f70 0 19979 2 0x00000000 2018-04-08 13:24:12 [44935.188175] Call Trace: 2018-04-08 13:24:12 [44935.191043] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.196430] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.202851] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.208847] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.217346] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.224286] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.229584] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.236084] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.241890] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.248390] z_wr_int_3 S ffff88012d454f10 0 19980 2 0x00000000 2018-04-08 13:24:12 [44935.255895] Call Trace: 2018-04-08 13:24:12 [44935.258764] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.264150] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.270573] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.276567] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.285070] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.292006] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.297294] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.303798] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.309606] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.316106] z_wr_int_4 S ffff88bebc3f0000 0 19981 2 0x00000000 2018-04-08 13:24:12 [44935.323615] Call Trace: 2018-04-08 13:24:12 [44935.326489] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.331876] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.338296] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.344299] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.352803] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.359750] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.365045] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.371555] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.377369] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.383871] z_wr_int_5 S ffff88bebc3f0fd0 0 19982 2 0x00000000 2018-04-08 13:24:12 [44935.391380] Call Trace: 2018-04-08 13:24:12 [44935.394256] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.399639] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.406059] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.412065] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.420564] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.427510] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.432812] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.439320] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.445134] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.451636] z_wr_int_6 S ffff88bebc3f1fa0 0 19983 2 0x00000000 2018-04-08 13:24:12 [44935.459136] Call Trace: 2018-04-08 13:24:12 [44935.462012] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.467394] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.473813] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.479809] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.488313] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.495252] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.500549] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.507060] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.512872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.519374] z_wr_int_7 S ffff88bebc3f2f70 0 19984 2 0x00000000 2018-04-08 13:24:12 [44935.526875] Call Trace: 2018-04-08 13:24:12 [44935.529749] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.535134] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.541553] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.547548] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:12 [44935.556055] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.563000] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.568296] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.574807] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.580619] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.587121] z_wr_int_h S ffff88bebc3f3f40 0 19985 2 0x00000000 2018-04-08 13:24:12 [44935.594633] Call Trace: 2018-04-08 13:24:12 [44935.597507] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.602888] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.609309] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.615292] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.622228] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.627523] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.634028] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.639841] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.646339] z_fr_iss_0 S ffff88bebc3f4f10 0 19986 2 0x00000000 2018-04-08 13:24:12 [44935.653847] Call Trace: 2018-04-08 13:24:12 [44935.656715] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.662098] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.668516] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.674502] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.681435] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.686724] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.693227] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.699035] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.705535] z_fr_iss_1 S ffff88bebc3f5ee0 0 19987 2 0x00000000 2018-04-08 13:24:12 [44935.713038] Call Trace: 2018-04-08 13:24:12 [44935.715896] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.721272] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.727686] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.733672] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.740602] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.745879] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.752373] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.758175] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.764670] z_fr_iss_2 S ffff88bebc3f6eb0 0 19988 2 0x00000000 2018-04-08 13:24:12 [44935.772156] Call Trace: 2018-04-08 13:24:12 [44935.775010] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.780376] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.786783] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:12 [44935.792757] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:12 [44935.799687] [] kthread+0xcf/0xe0 2018-04-08 13:24:12 [44935.804967] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.811453] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:12 [44935.817252] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:12 [44935.823737] z_fr_iss_3 S ffff88be61388000 0 19989 2 0x00000000 2018-04-08 13:24:12 [44935.831229] Call Trace: 2018-04-08 13:24:12 [44935.834082] [] schedule+0x29/0x70 2018-04-08 13:24:12 [44935.839450] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:12 [44935.845854] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44935.851830] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44935.858752] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44935.864025] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44935.870507] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44935.876297] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44935.882780] z_fr_iss_4 S ffff88be61388fd0 0 19990 2 0x00000000 2018-04-08 13:24:13 [44935.890271] Call Trace: 2018-04-08 13:24:13 [44935.893119] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44935.898481] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44935.904884] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44935.910852] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44935.917776] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44935.923050] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44935.929529] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44935.935321] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44935.941803] z_fr_iss_5 S ffff88be61389fa0 0 19991 2 0x00000000 2018-04-08 13:24:13 [44935.949298] Call Trace: 2018-04-08 13:24:13 [44935.952144] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44935.957510] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44935.963906] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44935.969877] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44935.976801] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44935.982081] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44935.988566] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44935.994353] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.000837] z_fr_iss_6 S ffff88be6138af70 0 19992 2 0x00000000 2018-04-08 13:24:13 [44936.008329] Call Trace: 2018-04-08 13:24:13 [44936.011177] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.016545] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.022948] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.028918] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.035842] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.041121] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.047603] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.053392] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.059879] z_fr_iss_7 S ffff88be6138bf40 0 19993 2 0x00000000 2018-04-08 13:24:13 [44936.067368] Call Trace: 2018-04-08 13:24:13 [44936.070219] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.075585] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.081980] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.087948] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.094867] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.100148] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.106638] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.112427] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.118912] z_fr_int S ffff88be6138cf10 0 19994 2 0x00000000 2018-04-08 13:24:13 [44936.126402] Call Trace: 2018-04-08 13:24:13 [44936.129251] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.134618] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.141022] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.146991] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.153917] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.159198] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.165686] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.171478] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.177964] z_cl_iss S ffff88be6138dee0 0 19995 2 0x00000000 2018-04-08 13:24:13 [44936.185444] Call Trace: 2018-04-08 13:24:13 [44936.188292] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.193661] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.200064] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.206036] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.212959] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.218238] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.224729] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.230515] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.237001] z_cl_int S ffff88be6138eeb0 0 19996 2 0x00000000 2018-04-08 13:24:13 [44936.244493] Call Trace: 2018-04-08 13:24:13 [44936.247341] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.252708] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.259103] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.265071] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.271990] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.277268] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.283753] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.289541] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.296024] z_ioctl_iss S ffff88bdd7be8000 0 19997 2 0x00000000 2018-04-08 13:24:13 [44936.303515] Call Trace: 2018-04-08 13:24:13 [44936.306364] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.311732] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.318137] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.324103] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.331022] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.336302] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.342782] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.348573] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.355055] z_ioctl_int S ffff88bdd7be8fd0 0 19998 2 0x00000000 2018-04-08 13:24:13 [44936.362552] Call Trace: 2018-04-08 13:24:13 [44936.365409] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.370772] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.377168] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.383151] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:13 [44936.391634] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.398565] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.403843] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.410335] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.416127] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.422610] z_zvol S ffff88bdd7be9fa0 0 19999 2 0x00000000 2018-04-08 13:24:13 [44936.430103] Call Trace: 2018-04-08 13:24:13 [44936.432958] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.438325] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.444734] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.450710] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.457643] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.462918] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.469411] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.475209] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.481697] z_upgrade S ffff88bdd7beaf70 0 20000 2 0x00000000 2018-04-08 13:24:13 [44936.489195] Call Trace: 2018-04-08 13:24:13 [44936.492052] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.497418] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.503825] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.509803] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.516723] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.522001] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.528484] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.534276] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.540761] metaslab_group_ S ffff88bdd7bebf40 0 20001 2 0x00000000 2018-04-08 13:24:13 [44936.548255] Call Trace: 2018-04-08 13:24:13 [44936.551112] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.556486] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.562893] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.568868] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.575792] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.581071] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.587560] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.593354] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.599849] dp_sync_taskq S ffff88bdd7bedee0 0 20005 2 0x00000000 2018-04-08 13:24:13 [44936.607345] Call Trace: 2018-04-08 13:24:13 [44936.610204] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.615573] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.621976] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.627956] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.634886] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.640164] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:13 [44936.646656] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.653150] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.658950] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.665443] dp_sync_taskq S ffff88bdd7beeeb0 0 20006 2 0x00000000 2018-04-08 13:24:13 [44936.672939] Call Trace: 2018-04-08 13:24:13 [44936.675794] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.681159] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.687556] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.693524] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.700447] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.705715] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.712201] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.717994] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.724478] dp_sync_taskq S ffff88bdd7becf10 0 20007 2 0x00000000 2018-04-08 13:24:13 [44936.731969] Call Trace: 2018-04-08 13:24:13 [44936.734817] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.740183] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.746582] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.752559] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.759483] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.764760] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.771241] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.777035] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.783518] dp_sync_taskq S ffff88606e3f8fd0 0 20008 2 0x00000000 2018-04-08 13:24:13 [44936.791012] Call Trace: 2018-04-08 13:24:13 [44936.793868] [] schedule+0x29/0x70 2018-04-08 13:24:13 [44936.799232] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:13 [44936.805632] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:13 [44936.811611] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:13 [44936.818532] [] kthread+0xcf/0xe0 2018-04-08 13:24:13 [44936.823808] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.830293] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:13 [44936.836082] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:13 [44936.842569] dp_sync_taskq S ffff88beb46aeeb0 0 20009 2 0x00000000 2018-04-08 13:24:14 [44936.850059] Call Trace: 2018-04-08 13:24:14 [44936.852909] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44936.858274] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44936.864680] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44936.870649] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44936.877571] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44936.882847] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44936.889332] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44936.895124] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44936.901610] dp_sync_taskq S ffff88beb46a8fd0 0 20010 2 0x00000000 2018-04-08 13:24:14 [44936.909099] Call Trace: 2018-04-08 13:24:14 [44936.911947] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44936.917314] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44936.923712] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44936.929692] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44936.936614] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44936.941894] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44936.948377] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44936.954166] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44936.960650] dp_sync_taskq S ffff88beb46abf40 0 20011 2 0x00000000 2018-04-08 13:24:14 [44936.968141] Call Trace: 2018-04-08 13:24:14 [44936.970989] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44936.976357] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44936.982760] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44936.988728] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44936.995655] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.000935] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.007424] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.013215] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.019699] dp_sync_taskq S ffff88beb46acf10 0 20012 2 0x00000000 2018-04-08 13:24:14 [44937.027191] Call Trace: 2018-04-08 13:24:14 [44937.030038] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.035407] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.041811] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.047780] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.054703] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.059985] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.066473] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.072264] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.078747] dp_sync_taskq S ffff88beb46adee0 0 20013 2 0x00000000 2018-04-08 13:24:14 [44937.086240] Call Trace: 2018-04-08 13:24:14 [44937.089087] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.094455] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.100861] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.106826] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.113754] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.119032] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.125515] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.131306] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.137788] dp_sync_taskq S ffff88beb46a9fa0 0 20014 2 0x00000000 2018-04-08 13:24:14 [44937.145279] Call Trace: 2018-04-08 13:24:14 [44937.148130] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.153496] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.159902] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.165879] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.172804] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.178084] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.184576] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.190363] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.196846] dp_sync_taskq S ffff88beb46aaf70 0 20015 2 0x00000000 2018-04-08 13:24:14 [44937.204338] Call Trace: 2018-04-08 13:24:14 [44937.207190] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.212557] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.218959] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.224934] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.231852] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.237135] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:14 [44937.243627] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.250115] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.255906] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.262392] dp_sync_taskq S ffff88beb46a8000 0 20016 2 0x00000000 2018-04-08 13:24:14 [44937.269883] Call Trace: 2018-04-08 13:24:14 [44937.272740] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.278107] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.284512] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.290491] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.297411] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.302688] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.309173] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.314964] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.321449] z_iput S ffff88be60d08000 0 20017 2 0x00000000 2018-04-08 13:24:14 [44937.328931] Call Trace: 2018-04-08 13:24:14 [44937.331778] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.337144] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.343544] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.349519] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.356444] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.361722] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.368206] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.373996] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.380481] txg_quiesce S ffff88012da25ee0 0 20186 2 0x00000000 2018-04-08 13:24:14 [44937.387972] Call Trace: 2018-04-08 13:24:14 [44937.390819] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.396185] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:14 [44937.402758] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:14 [44937.408993] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:14 [44937.415328] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:14 [44937.422259] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:14 [44937.428484] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:14 [44937.435575] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:14 [44937.442054] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.447330] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.453815] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.459607] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.466091] txg_sync S ffff88012da26eb0 0 20187 2 0x00000000 2018-04-08 13:24:14 [44937.473581] Call Trace: 2018-04-08 13:24:14 [44937.476430] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.481792] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:14 [44937.488029] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:14 [44937.494682] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:14 [44937.501076] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:14 [44937.508085] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:14 [44937.515172] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:14 [44937.521399] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:14 [44937.528158] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:14 [44937.534834] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:14 [44937.541059] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:14 [44937.548153] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:14 [44937.554638] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.559908] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.566384] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.572166] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.578644] mmp S ffff88be5cc6bf40 0 20188 2 0x00000000 2018-04-08 13:24:14 [44937.586123] Call Trace: 2018-04-08 13:24:14 [44937.588972] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.594330] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:14 [44937.600555] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:14 [44937.606957] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:14 [44937.614040] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:14 [44937.620264] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:14 [44937.627023] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:14 [44937.633256] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:14 [44937.639920] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:14 [44937.646661] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:14 [44937.653749] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:14 [44937.660229] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.665494] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.671972] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.677751] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.684225] z_null_iss S ffff88bebeb78000 0 20534 2 0x00000000 2018-04-08 13:24:14 [44937.691706] Call Trace: 2018-04-08 13:24:14 [44937.694549] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.699905] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.706294] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.712267] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:14 [44937.720741] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.727654] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.732926] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.739413] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.745205] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.751687] z_null_int S ffff88bebeb7dee0 0 20535 2 0x00000000 2018-04-08 13:24:14 [44937.759179] Call Trace: 2018-04-08 13:24:14 [44937.762026] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.767381] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.773778] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:14 [44937.779763] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:14 [44937.788245] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:14 [44937.795167] [] kthread+0xcf/0xe0 2018-04-08 13:24:14 [44937.800448] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.806941] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:14 [44937.812741] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:14 [44937.819226] z_rd_iss S ffff88606df62f70 0 20536 2 0x00000000 2018-04-08 13:24:14 [44937.826715] Call Trace: 2018-04-08 13:24:14 [44937.829573] [] schedule+0x29/0x70 2018-04-08 13:24:14 [44937.834939] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:14 [44937.841343] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44937.847334] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44937.855831] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44937.862759] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44937.868046] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44937.874539] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44937.880335] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44937.886833] z_rd_int_0 S ffff88606df61fa0 0 20537 2 0x00000000 2018-04-08 13:24:15 [44937.894331] Call Trace: 2018-04-08 13:24:15 [44937.897197] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44937.902575] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44937.908987] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44937.914986] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44937.923485] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44937.930426] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44937.935723] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44937.942225] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44937.948034] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44937.954538] z_rd_int_1 S ffff88606df63f40 0 20538 2 0x00000000 2018-04-08 13:24:15 [44937.962045] Call Trace: 2018-04-08 13:24:15 [44937.964919] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44937.970306] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44937.976724] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44937.982728] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44937.991230] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44937.998179] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.003477] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.009987] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.015799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.022301] z_rd_int_2 S ffff88606df60fd0 0 20539 2 0x00000000 2018-04-08 13:24:15 [44938.029812] Call Trace: 2018-04-08 13:24:15 [44938.032686] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.038067] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.044488] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.050494] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.058994] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.065933] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.071231] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.077739] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.083549] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.090055] z_rd_int_3 S ffff88606df60000 0 20540 2 0x00000000 2018-04-08 13:24:15 [44938.097564] Call Trace: 2018-04-08 13:24:15 [44938.100438] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.105826] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.112246] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.118249] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.126750] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.133689] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.138989] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.145496] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.151311] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.157809] z_rd_int_4 S ffff88606df66eb0 0 20541 2 0x00000000 2018-04-08 13:24:15 [44938.165320] Call Trace: 2018-04-08 13:24:15 [44938.168194] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.173581] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.180000] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.186005] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.194505] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.201446] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.206741] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.213251] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.219067] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.225565] z_rd_int_5 S ffff88606df65ee0 0 20542 2 0x00000000 2018-04-08 13:24:15 [44938.233067] Call Trace: 2018-04-08 13:24:15 [44938.235943] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.241326] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.247747] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.253750] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.262251] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.269192] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.274490] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.280998] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.286814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.293316] z_rd_int_6 S ffff88606df64f10 0 20543 2 0x00000000 2018-04-08 13:24:15 [44938.300820] Call Trace: 2018-04-08 13:24:15 [44938.303689] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.309073] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.315493] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.321492] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.329989] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.336930] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.342229] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.348735] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.354541] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.361044] z_rd_int_7 S ffff88be666b0000 0 20544 2 0x00000000 2018-04-08 13:24:15 [44938.368553] Call Trace: 2018-04-08 13:24:15 [44938.371426] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.376814] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.383232] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.389235] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.397737] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.404677] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.409978] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.416485] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.422299] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.428800] z_wr_iss S ffff88be666b1fa0 0 20545 2 0x00000000 2018-04-08 13:24:15 [44938.436311] Call Trace: 2018-04-08 13:24:15 [44938.439184] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.444567] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.450987] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.456986] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.465486] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.472427] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.477721] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.484232] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.490044] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.496545] z_wr_iss S ffff88be666b0fd0 0 20546 2 0x00000000 2018-04-08 13:24:15 [44938.504059] Call Trace: 2018-04-08 13:24:15 [44938.506931] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.512317] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.518734] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.524732] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.533234] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.540183] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.545482] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.551987] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.557803] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.564303] z_wr_iss S ffff88be666b6eb0 0 20547 2 0x00000000 2018-04-08 13:24:15 [44938.571812] Call Trace: 2018-04-08 13:24:15 [44938.574687] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.580073] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.586490] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.592485] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.600988] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.607929] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.613226] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.619736] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.625546] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.632049] z_wr_iss S ffff88be666b5ee0 0 20548 2 0x00000000 2018-04-08 13:24:15 [44938.639559] Call Trace: 2018-04-08 13:24:15 [44938.642436] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.647819] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.654236] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.660234] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.668734] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.675675] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.680973] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.687482] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.693294] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.699796] z_wr_iss S ffff88be666b3f40 0 20549 2 0x00000000 2018-04-08 13:24:15 [44938.707306] Call Trace: 2018-04-08 13:24:15 [44938.710182] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.715566] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.721983] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.727978] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.736479] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.743427] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.748727] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.755236] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.761044] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.767543] z_wr_iss S ffff88be666b4f10 0 20550 2 0x00000000 2018-04-08 13:24:15 [44938.775052] Call Trace: 2018-04-08 13:24:15 [44938.777919] [] schedule+0x29/0x70 2018-04-08 13:24:15 [44938.783303] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:15 [44938.789722] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:15 [44938.795717] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:15 [44938.804223] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:15 [44938.811167] [] kthread+0xcf/0xe0 2018-04-08 13:24:15 [44938.816469] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.822974] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:15 [44938.828788] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:15 [44938.835291] z_wr_iss S ffff88be666b2f70 0 20551 2 0x00000000 2018-04-08 13:24:15 [44938.842800] Call Trace: 2018-04-08 13:24:15 [44938.845674] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44938.851061] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44938.857478] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44938.863473] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44938.871975] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44938.878916] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44938.884215] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44938.890722] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44938.896537] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44938.903039] z_wr_iss S ffff88beb2f29fa0 0 20552 2 0x00000000 2018-04-08 13:24:16 [44938.910546] Call Trace: 2018-04-08 13:24:16 [44938.913422] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44938.918807] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44938.925231] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44938.931230] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44938.939731] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44938.946673] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44938.951970] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44938.958481] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44938.964293] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44938.970795] z_wr_iss S ffff88beb2f2bf40 0 20553 2 0x00000000 2018-04-08 13:24:16 [44938.978306] Call Trace: 2018-04-08 13:24:16 [44938.981178] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44938.986562] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44938.992980] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44938.998980] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.007485] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.014429] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.019726] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.026236] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.032047] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.038549] z_wr_iss S ffff88beb2f28fd0 0 20554 2 0x00000000 2018-04-08 13:24:16 [44939.046060] Call Trace: 2018-04-08 13:24:16 [44939.048937] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.054327] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.060746] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.066751] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.075251] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.082196] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.087493] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.093997] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.099806] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.106306] z_wr_iss S ffff88beb2f2dee0 0 20555 2 0x00000000 2018-04-08 13:24:16 [44939.113814] Call Trace: 2018-04-08 13:24:16 [44939.116689] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.122073] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.128493] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.134488] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.142989] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.149933] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.155229] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.161736] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.167553] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.174051] z_wr_iss S ffff88beb2f2af70 0 20556 2 0x00000000 2018-04-08 13:24:16 [44939.181562] Call Trace: 2018-04-08 13:24:16 [44939.184436] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.189822] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.196238] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.202235] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.210738] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.217679] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.222975] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.229486] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.235298] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.241800] z_wr_iss_h S ffff88beb2f2cf10 0 20557 2 0x00000000 2018-04-08 13:24:16 [44939.249311] Call Trace: 2018-04-08 13:24:16 [44939.252184] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.257570] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.263988] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.269978] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.276912] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.282201] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.288705] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.294512] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.301013] z_wr_int_0 S ffff88be60e0eeb0 0 20558 2 0x00000000 2018-04-08 13:24:16 [44939.308517] Call Trace: 2018-04-08 13:24:16 [44939.311386] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.316769] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.323185] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.329187] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.337682] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.344616] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.349906] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.356409] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.362214] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.368712] z_wr_int_1 S ffff88be60e0dee0 0 20559 2 0x00000000 2018-04-08 13:24:16 [44939.376212] Call Trace: 2018-04-08 13:24:16 [44939.379080] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.384462] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.390877] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.396874] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.405373] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.412313] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.417610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.424114] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.429927] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.436425] z_wr_int_2 S ffff88be60e0bf40 0 20560 2 0x00000000 2018-04-08 13:24:16 [44939.443926] Call Trace: 2018-04-08 13:24:16 [44939.446792] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.452175] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.458590] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.464586] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.473087] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.480023] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.485314] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.491817] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.497632] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.504130] z_wr_int_3 S ffff88be60e0af70 0 20561 2 0x00000000 2018-04-08 13:24:16 [44939.511638] Call Trace: 2018-04-08 13:24:16 [44939.514505] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.519888] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.526301] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.532300] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.540796] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.547736] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.553027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.559528] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.565336] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.571839] z_wr_int_4 S ffff88be60e0cf10 0 20562 2 0x00000000 2018-04-08 13:24:16 [44939.579349] Call Trace: 2018-04-08 13:24:16 [44939.582223] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.587606] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.594024] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.600021] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.608521] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.615462] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.620763] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.627268] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.633085] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.639583] z_wr_int_5 S ffff88be60e08000 0 20563 2 0x00000000 2018-04-08 13:24:16 [44939.647095] Call Trace: 2018-04-08 13:24:16 [44939.649970] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.655354] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.661772] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.667769] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.676269] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.683210] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.688509] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.695020] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.700831] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.707332] z_wr_int_6 S ffff88be60e09fa0 0 20564 2 0x00000000 2018-04-08 13:24:16 [44939.714832] Call Trace: 2018-04-08 13:24:16 [44939.717708] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.723089] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.729510] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.735507] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.744009] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.750948] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.756246] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.762754] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.768571] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.775071] z_wr_int_7 S ffff88be60e08fd0 0 20565 2 0x00000000 2018-04-08 13:24:16 [44939.782581] Call Trace: 2018-04-08 13:24:16 [44939.785455] [] schedule+0x29/0x70 2018-04-08 13:24:16 [44939.790839] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:16 [44939.797260] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:16 [44939.803261] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:16 [44939.811766] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:16 [44939.818704] [] kthread+0xcf/0xe0 2018-04-08 13:24:16 [44939.824001] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.830510] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:16 [44939.836327] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:16 [44939.842826] z_wr_int_h S ffff88be3fc10000 0 20566 2 0x00000000 2018-04-08 13:24:17 [44939.850337] Call Trace: 2018-04-08 13:24:17 [44939.853211] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44939.858594] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44939.865013] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44939.870994] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44939.877931] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44939.883228] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44939.889730] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44939.895537] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44939.902035] z_fr_iss_0 S ffff88be3fc10fd0 0 20567 2 0x00000000 2018-04-08 13:24:17 [44939.909544] Call Trace: 2018-04-08 13:24:17 [44939.912409] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44939.917786] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44939.924202] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44939.930181] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44939.937111] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44939.942401] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44939.948906] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44939.954712] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44939.961205] z_fr_iss_1 S ffff88be3fc11fa0 0 20568 2 0x00000000 2018-04-08 13:24:17 [44939.968702] Call Trace: 2018-04-08 13:24:17 [44939.971567] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44939.976943] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44939.983356] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44939.989343] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44939.996270] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.001548] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.008045] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.013844] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.020340] z_fr_iss_2 S ffff88be3fc12f70 0 20569 2 0x00000000 2018-04-08 13:24:17 [44940.027823] Call Trace: 2018-04-08 13:24:17 [44940.030682] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.036055] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.042462] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.048440] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.055363] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.060640] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.067134] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.072930] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.079415] z_fr_iss_3 S ffff88be3fc13f40 0 20570 2 0x00000000 2018-04-08 13:24:17 [44940.086909] Call Trace: 2018-04-08 13:24:17 [44940.089765] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.095126] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.101522] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.107490] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.114413] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.119687] [] ? finish_task_switch+0x67/0x160 2018-04-08 13:24:17 [44940.126171] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.132652] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.138441] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.144926] z_fr_iss_4 S ffff88be3fc14f10 0 20571 2 0x00000000 2018-04-08 13:24:17 [44940.152410] Call Trace: 2018-04-08 13:24:17 [44940.155260] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.160625] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.167021] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.172991] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.179914] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.185190] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.191676] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.197469] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.203948] z_fr_iss_5 S ffff88be3fc15ee0 0 20572 2 0x00000000 2018-04-08 13:24:17 [44940.211435] Call Trace: 2018-04-08 13:24:17 [44940.214281] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.219648] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.226044] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.232013] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.238936] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.244208] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.250691] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.256481] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.262966] z_fr_iss_6 S ffff88be3fc16eb0 0 20573 2 0x00000000 2018-04-08 13:24:17 [44940.270458] Call Trace: 2018-04-08 13:24:17 [44940.273306] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.278672] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.285070] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.291036] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.297952] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.303223] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.309703] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.315497] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.321982] z_fr_iss_7 S ffff88be2f120000 0 20574 2 0x00000000 2018-04-08 13:24:17 [44940.329473] Call Trace: 2018-04-08 13:24:17 [44940.332321] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.337686] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.344082] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.350054] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.356977] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.362256] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.368737] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.374528] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.381013] z_fr_int S ffff88be2f120fd0 0 20575 2 0x00000000 2018-04-08 13:24:17 [44940.388496] Call Trace: 2018-04-08 13:24:17 [44940.391345] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.396712] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.403116] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.409085] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.416012] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.421290] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.427773] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.433564] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.440044] z_cl_iss S ffff88be2f121fa0 0 20576 2 0x00000000 2018-04-08 13:24:17 [44940.447538] Call Trace: 2018-04-08 13:24:17 [44940.450384] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.455753] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.462157] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.468125] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.475051] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.480329] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.486811] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.492600] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.499086] z_cl_int S ffff88be2f122f70 0 20577 2 0x00000000 2018-04-08 13:24:17 [44940.506579] Call Trace: 2018-04-08 13:24:17 [44940.509429] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.514793] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.521198] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.527167] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.534091] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.539372] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.545855] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.551642] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.558128] z_ioctl_iss S ffff88be2f123f40 0 20578 2 0x00000000 2018-04-08 13:24:17 [44940.565618] Call Trace: 2018-04-08 13:24:17 [44940.568469] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.573835] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.580240] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.586208] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.593130] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.598403] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.604884] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.610677] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.617159] z_ioctl_int S ffff88be2f124f10 0 20579 2 0x00000000 2018-04-08 13:24:17 [44940.624654] Call Trace: 2018-04-08 13:24:17 [44940.627510] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.632878] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.639280] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.645264] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:17 [44940.653747] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.660684] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.665963] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.672455] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.678256] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.684739] z_zvol S ffff88be2f125ee0 0 20580 2 0x00000000 2018-04-08 13:24:17 [44940.692230] Call Trace: 2018-04-08 13:24:17 [44940.695088] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.700453] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.706862] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.712837] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.719762] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.725040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.731533] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.737330] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.743819] z_upgrade S ffff88be2f126eb0 0 20581 2 0x00000000 2018-04-08 13:24:17 [44940.751314] Call Trace: 2018-04-08 13:24:17 [44940.754172] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.759539] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.765947] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.771919] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.778847] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.784123] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.790614] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:17 [44940.796407] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:17 [44940.802894] metaslab_group_ S ffff88be24f68000 0 20582 2 0x00000000 2018-04-08 13:24:17 [44940.810389] Call Trace: 2018-04-08 13:24:17 [44940.813250] [] schedule+0x29/0x70 2018-04-08 13:24:17 [44940.818624] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:17 [44940.825028] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:17 [44940.831007] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:17 [44940.837931] [] kthread+0xcf/0xe0 2018-04-08 13:24:17 [44940.843206] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44940.849701] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44940.855500] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44940.861985] dp_sync_taskq S ffff88be24f6bf40 0 20586 2 0x00000000 2018-04-08 13:24:18 [44940.869484] Call Trace: 2018-04-08 13:24:18 [44940.872339] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44940.877707] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44940.884115] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44940.890092] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44940.897026] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44940.902310] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44940.908802] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44940.914603] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44940.921094] dp_sync_taskq S ffff88be24f6cf10 0 20587 2 0x00000000 2018-04-08 13:24:18 [44940.928586] Call Trace: 2018-04-08 13:24:18 [44940.931441] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44940.936806] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44940.943208] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44940.949178] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44940.956101] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44940.961385] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44940.967873] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44940.973664] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44940.980146] dp_sync_taskq S ffff88be24f6dee0 0 20588 2 0x00000000 2018-04-08 13:24:18 [44940.987638] Call Trace: 2018-04-08 13:24:18 [44940.990487] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44940.995855] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.002258] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.008229] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.015151] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.020434] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.026922] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.032715] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.039199] dp_sync_taskq S ffff88be24f6eeb0 0 20589 2 0x00000000 2018-04-08 13:24:18 [44941.046687] Call Trace: 2018-04-08 13:24:18 [44941.049538] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.054907] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.061312] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.067287] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.074210] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.079489] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.085973] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.091764] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.098247] dp_sync_taskq S ffff88be24f68fd0 0 20590 2 0x00000000 2018-04-08 13:24:18 [44941.105737] Call Trace: 2018-04-08 13:24:18 [44941.108588] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.113953] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.120360] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.126337] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.133261] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.138539] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.145022] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.150812] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.157296] dp_sync_taskq S ffff88be24f6af70 0 20591 2 0x00000000 2018-04-08 13:24:18 [44941.164788] Call Trace: 2018-04-08 13:24:18 [44941.167639] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.173005] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.179411] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.185386] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.192309] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.197591] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.204081] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.209870] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.216353] dp_sync_taskq S ffff88be60eb0000 0 20592 2 0x00000000 2018-04-08 13:24:18 [44941.223845] Call Trace: 2018-04-08 13:24:18 [44941.226697] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.232059] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.238458] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.244433] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.251362] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.256640] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.263131] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.268923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.275406] dp_sync_taskq S ffff88be60eb1fa0 0 20593 2 0x00000000 2018-04-08 13:24:18 [44941.282896] Call Trace: 2018-04-08 13:24:18 [44941.285747] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.291110] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.297508] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.303482] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.310410] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.315689] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.322178] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.327970] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.334453] dp_sync_taskq S ffff88be60eb3f40 0 20594 2 0x00000000 2018-04-08 13:24:18 [44941.341945] Call Trace: 2018-04-08 13:24:18 [44941.344795] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.350163] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.356564] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.362535] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.369458] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.374737] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.381222] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.387012] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.393494] dp_sync_taskq S ffff88be60eb5ee0 0 20595 2 0x00000000 2018-04-08 13:24:18 [44941.400985] Call Trace: 2018-04-08 13:24:18 [44941.403834] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.409201] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.415609] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.421584] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.428509] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.433790] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.440279] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.446068] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.452555] dp_sync_taskq S ffff88be60eb6eb0 0 20596 2 0x00000000 2018-04-08 13:24:18 [44941.460044] Call Trace: 2018-04-08 13:24:18 [44941.462894] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.468261] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.474665] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.480633] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.487560] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.492837] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.499320] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.505110] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.511593] dp_sync_taskq S ffff88be60eb0fd0 0 20597 2 0x00000000 2018-04-08 13:24:18 [44941.519085] Call Trace: 2018-04-08 13:24:18 [44941.521935] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.527301] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.533705] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.539674] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.546598] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.551880] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.558371] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.564158] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.570641] z_iput S ffff88beb4c1af70 0 20598 2 0x00000000 2018-04-08 13:24:18 [44941.578133] Call Trace: 2018-04-08 13:24:18 [44941.580984] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.586348] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:18 [44941.592745] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:18 [44941.598714] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:18 [44941.605638] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.610922] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.617409] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.623200] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.629683] txg_quiesce S ffff88beaa2f4f10 0 20779 2 0x00000000 2018-04-08 13:24:18 [44941.637175] Call Trace: 2018-04-08 13:24:18 [44941.640023] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.645394] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:18 [44941.651971] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:18 [44941.658204] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:18 [44941.664543] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:18 [44941.671483] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:18 [44941.677716] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:18 [44941.684815] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:18 [44941.691303] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.696576] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.703062] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.708853] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.715336] txg_sync S ffff88beaa2f5ee0 0 20780 2 0x00000000 2018-04-08 13:24:18 [44941.722820] Call Trace: 2018-04-08 13:24:18 [44941.725667] [] schedule+0x29/0x70 2018-04-08 13:24:18 [44941.731033] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:18 [44941.737270] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:18 [44941.743928] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:18 [44941.750326] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:18 [44941.757331] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:18 [44941.764420] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:18 [44941.770646] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:18 [44941.777403] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:18 [44941.784078] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:18 [44941.790305] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:18 [44941.797399] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:18 [44941.803884] [] kthread+0xcf/0xe0 2018-04-08 13:24:18 [44941.809155] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:18 [44941.815631] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:18 [44941.821416] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44941.827899] mmp S ffff88beaa2f6eb0 0 20781 2 0x00000000 2018-04-08 13:24:19 [44941.835374] Call Trace: 2018-04-08 13:24:19 [44941.838221] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44941.843577] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:19 [44941.849800] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:19 [44941.856205] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:19 [44941.863293] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:19 [44941.869511] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:19 [44941.876272] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:19 [44941.882516] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:19 [44941.889189] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:19 [44941.895935] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:19 [44941.903024] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:19 [44941.909506] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44941.914777] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44941.921255] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44941.927041] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44941.933513] kworker/9:1 S ffff88beb2598000 0 21172 2 0x00000000 2018-04-08 13:24:19 [44941.940995] Call Trace: 2018-04-08 13:24:19 [44941.943839] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44941.949195] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:24:19 [44941.955152] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:24:19 [44941.962059] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44941.967325] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44941.973800] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44941.979582] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44941.986056] z_null_iss S ffff885e9c880000 0 21245 2 0x00000000 2018-04-08 13:24:19 [44941.993541] Call Trace: 2018-04-08 13:24:19 [44941.996382] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.001742] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.008132] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.014103] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.022579] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.029493] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.034766] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.041250] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.047044] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.053525] z_null_int S ffff885e9c884f10 0 21246 2 0x00000000 2018-04-08 13:24:19 [44942.061016] Call Trace: 2018-04-08 13:24:19 [44942.063863] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.069224] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.075620] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.081603] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.090083] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.097007] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.102286] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.108781] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.114582] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.121070] z_rd_iss S ffff885e9c883f40 0 21247 2 0x00000000 2018-04-08 13:24:19 [44942.128562] Call Trace: 2018-04-08 13:24:19 [44942.131417] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.136789] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.143194] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.149184] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.157671] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.164604] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.169894] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.176386] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.182187] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.188683] z_rd_int_0 S ffff885e9c8e4f10 0 21248 2 0x00000000 2018-04-08 13:24:19 [44942.196190] Call Trace: 2018-04-08 13:24:19 [44942.199057] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.204440] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.210853] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.216852] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.225351] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.232288] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.237577] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.244080] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.249894] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.256398] z_rd_int_1 S ffff885e9c8e6eb0 0 21249 2 0x00000000 2018-04-08 13:24:19 [44942.263909] Call Trace: 2018-04-08 13:24:19 [44942.266785] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.272168] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.278589] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.284594] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.293092] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.300034] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.305334] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.311840] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.317655] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.324153] z_rd_int_2 S ffff88012cfb9fa0 0 21250 2 0x00000000 2018-04-08 13:24:19 [44942.331666] Call Trace: 2018-04-08 13:24:19 [44942.334541] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.339924] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.346344] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.352350] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.360850] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.367797] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.373106] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.379610] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.385418] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.391921] z_rd_int_3 S ffff88012cfbeeb0 0 21251 2 0x00000000 2018-04-08 13:24:19 [44942.399429] Call Trace: 2018-04-08 13:24:19 [44942.402305] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.407690] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.414105] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.420105] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.428605] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.435545] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.440842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.447351] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.453163] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.459665] z_rd_int_4 S ffff88012cfbbf40 0 21252 2 0x00000000 2018-04-08 13:24:19 [44942.467178] Call Trace: 2018-04-08 13:24:19 [44942.470052] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.475434] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.481854] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.487853] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.496350] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.503291] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.508588] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.515102] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.520913] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.527413] z_rd_int_5 S ffff885ea3a83f40 0 21253 2 0x00000000 2018-04-08 13:24:19 [44942.534924] Call Trace: 2018-04-08 13:24:19 [44942.537799] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.543181] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.549601] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.555596] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.564096] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.571039] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.576336] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.582845] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.588659] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.595160] z_rd_int_6 S ffff885ea3a80fd0 0 21254 2 0x00000000 2018-04-08 13:24:19 [44942.602671] Call Trace: 2018-04-08 13:24:19 [44942.605543] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.610926] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.617347] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.623345] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.631843] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.638783] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.644085] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.650590] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.656398] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.662898] z_rd_int_7 S ffff885ea3a80000 0 21255 2 0x00000000 2018-04-08 13:24:19 [44942.670409] Call Trace: 2018-04-08 13:24:19 [44942.673285] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.678666] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.685085] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.691085] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.699582] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.706525] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.711821] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.718329] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.724135] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.730637] z_wr_iss S ffff88012cbb3f40 0 21256 2 0x00000000 2018-04-08 13:24:19 [44942.738146] Call Trace: 2018-04-08 13:24:19 [44942.741022] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.746406] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.752825] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:19 [44942.758821] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:19 [44942.767323] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:19 [44942.774262] [] kthread+0xcf/0xe0 2018-04-08 13:24:19 [44942.779558] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.786071] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:19 [44942.791885] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:19 [44942.798382] z_wr_iss S ffff88012cbb2f70 0 21257 2 0x00000000 2018-04-08 13:24:19 [44942.805894] Call Trace: 2018-04-08 13:24:19 [44942.808768] [] schedule+0x29/0x70 2018-04-08 13:24:19 [44942.814153] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:19 [44942.820572] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44942.826567] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44942.835069] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44942.842011] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44942.847310] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44942.853817] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44942.859631] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44942.866133] z_wr_iss S ffff88012cbb0fd0 0 21258 2 0x00000000 2018-04-08 13:24:20 [44942.873644] Call Trace: 2018-04-08 13:24:20 [44942.876516] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44942.881901] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44942.888321] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44942.894325] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44942.902825] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44942.909766] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44942.915062] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44942.921572] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44942.927388] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44942.933891] z_wr_iss S ffff88012cbb4f10 0 21259 2 0x00000000 2018-04-08 13:24:20 [44942.941406] Call Trace: 2018-04-08 13:24:20 [44942.944280] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44942.949664] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44942.956084] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44942.962080] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44942.970585] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44942.977530] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44942.982830] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44942.989334] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44942.995142] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.001642] z_wr_iss S ffff88012cbb1fa0 0 21260 2 0x00000000 2018-04-08 13:24:20 [44943.009154] Call Trace: 2018-04-08 13:24:20 [44943.012029] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.017412] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.023831] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.029837] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.038336] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.045278] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.050575] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.057087] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.062898] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.069403] z_wr_iss S ffff88012cbb5ee0 0 21261 2 0x00000000 2018-04-08 13:24:20 [44943.076909] Call Trace: 2018-04-08 13:24:20 [44943.079784] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.085168] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.091588] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.097590] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.106097] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.113043] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.118340] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.124847] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.130653] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.137157] z_wr_iss S ffff88012cbb6eb0 0 21262 2 0x00000000 2018-04-08 13:24:20 [44943.144664] Call Trace: 2018-04-08 13:24:20 [44943.147539] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.152925] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.159342] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.165339] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.173841] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.180779] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.186079] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.192586] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.198399] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.204904] z_wr_iss S ffff885e9ce6af70 0 21263 2 0x00000000 2018-04-08 13:24:20 [44943.212412] Call Trace: 2018-04-08 13:24:20 [44943.215289] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.220670] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.227091] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.233098] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.241594] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.248537] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.253834] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.260341] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.266149] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.272651] z_wr_iss S ffff885e9ce6dee0 0 21264 2 0x00000000 2018-04-08 13:24:20 [44943.280162] Call Trace: 2018-04-08 13:24:20 [44943.283034] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.288420] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.294837] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.300842] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.309342] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.316283] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.321583] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.328088] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.333894] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.340395] z_wr_iss S ffff885e9ce6eeb0 0 21265 2 0x00000000 2018-04-08 13:24:20 [44943.347899] Call Trace: 2018-04-08 13:24:20 [44943.350773] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.356156] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.362574] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.368572] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.377071] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.384014] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.389313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.395819] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.401634] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.408137] z_wr_iss S ffff885e9ce68fd0 0 21266 2 0x00000000 2018-04-08 13:24:20 [44943.415645] Call Trace: 2018-04-08 13:24:20 [44943.418521] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.423902] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.430321] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.436319] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.444819] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.451760] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.457058] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.463567] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.469384] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.475888] z_wr_iss S ffff885e9ce69fa0 0 21267 2 0x00000000 2018-04-08 13:24:20 [44943.483400] Call Trace: 2018-04-08 13:24:20 [44943.486275] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.491662] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.498081] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.504084] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.512585] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.519526] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.524822] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.531334] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.537145] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.543649] z_wr_iss_h S ffff88bebbb92f70 0 21268 2 0x00000000 2018-04-08 13:24:20 [44943.551158] Call Trace: 2018-04-08 13:24:20 [44943.554030] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.559413] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.565833] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.571816] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.578750] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.584040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.590543] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.596348] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.602848] z_wr_int_0 S ffff88bebbb91fa0 0 21269 2 0x00000000 2018-04-08 13:24:20 [44943.610348] Call Trace: 2018-04-08 13:24:20 [44943.613213] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.618599] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.625021] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.631012] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.639506] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.646445] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.651735] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.658239] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.664053] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.670550] z_wr_int_1 S ffff88bebbb94f10 0 21270 2 0x00000000 2018-04-08 13:24:20 [44943.678051] Call Trace: 2018-04-08 13:24:20 [44943.680917] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.686302] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.692714] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.698711] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.707209] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.714147] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.719437] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.725941] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.731748] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.738248] z_wr_int_2 S ffff88bebbb96eb0 0 21271 2 0x00000000 2018-04-08 13:24:20 [44943.745753] Call Trace: 2018-04-08 13:24:20 [44943.748623] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.754005] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:20 [44943.760421] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:20 [44943.766413] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:20 [44943.774913] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:20 [44943.781853] [] kthread+0xcf/0xe0 2018-04-08 13:24:20 [44943.787141] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.793646] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:20 [44943.799450] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:20 [44943.805949] z_wr_int_3 S ffff88bebbb95ee0 0 21272 2 0x00000000 2018-04-08 13:24:20 [44943.813450] Call Trace: 2018-04-08 13:24:20 [44943.816318] [] schedule+0x29/0x70 2018-04-08 13:24:20 [44943.821699] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44943.828114] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44943.834109] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:21 [44943.842608] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44943.849548] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44943.854837] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44943.861340] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44943.867147] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44943.873647] z_wr_int_4 S ffff88bebbb93f40 0 21273 2 0x00000000 2018-04-08 13:24:21 [44943.881159] Call Trace: 2018-04-08 13:24:21 [44943.884032] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44943.889416] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44943.895836] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44943.901835] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:21 [44943.910332] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44943.917274] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44943.922572] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44943.929080] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44943.934896] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44943.941395] z_wr_int_5 S ffff88be24f69fa0 0 21274 2 0x00000000 2018-04-08 13:24:21 [44943.948906] Call Trace: 2018-04-08 13:24:21 [44943.951780] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44943.957164] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44943.963582] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44943.969581] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:21 [44943.978081] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44943.985024] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44943.990321] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44943.996827] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.002634] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.009135] z_wr_int_6 S ffff88bddd485ee0 0 21275 2 0x00000000 2018-04-08 13:24:21 [44944.016636] Call Trace: 2018-04-08 13:24:21 [44944.019512] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.024895] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.031313] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.037311] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:21 [44944.045813] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.052753] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.058053] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.064557] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.070365] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.076864] z_wr_int_7 S ffff88bddd486eb0 0 21276 2 0x00000000 2018-04-08 13:24:21 [44944.084378] Call Trace: 2018-04-08 13:24:21 [44944.087250] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.092634] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.099052] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.105048] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:21 [44944.113552] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.120500] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.125798] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.132307] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.138120] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.144623] z_wr_int_h S ffff88bddd480000 0 21277 2 0x00000000 2018-04-08 13:24:21 [44944.152134] Call Trace: 2018-04-08 13:24:21 [44944.155007] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.160391] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.166808] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.172792] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.179736] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.185033] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.191538] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.197351] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.203847] z_fr_iss_0 S ffff88bddd483f40 0 21278 2 0x00000000 2018-04-08 13:24:21 [44944.211349] Call Trace: 2018-04-08 13:24:21 [44944.214215] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.219601] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.226019] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.232005] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.238934] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.244224] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.250724] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.256534] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.263032] z_fr_iss_1 S ffff88bddd480fd0 0 21279 2 0x00000000 2018-04-08 13:24:21 [44944.270532] Call Trace: 2018-04-08 13:24:21 [44944.273398] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.278772] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.285188] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.291171] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.298101] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.303378] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.309874] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.315675] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.322168] z_fr_iss_2 S ffff88bddd484f10 0 21280 2 0x00000000 2018-04-08 13:24:21 [44944.329664] Call Trace: 2018-04-08 13:24:21 [44944.332519] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.337885] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.344291] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.350268] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.357189] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.362468] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.368959] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.374751] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.381235] z_fr_iss_3 S ffff88bddd481fa0 0 21281 2 0x00000000 2018-04-08 13:24:21 [44944.388729] Call Trace: 2018-04-08 13:24:21 [44944.391585] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.396945] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.403342] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.409309] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.416226] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.421499] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:21 [44944.427980] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.434463] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.440254] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.446740] z_fr_iss_4 S ffff88bddd482f70 0 21282 2 0x00000000 2018-04-08 13:24:21 [44944.454232] Call Trace: 2018-04-08 13:24:21 [44944.457077] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.462444] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.468841] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.474809] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.481726] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.487001] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.493486] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.499278] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.505762] z_fr_iss_5 S ffff88bebd3f8000 0 21283 2 0x00000000 2018-04-08 13:24:21 [44944.513253] Call Trace: 2018-04-08 13:24:21 [44944.516103] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.521467] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.527866] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.533839] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.540758] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.546027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.552511] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.558302] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.564786] z_fr_iss_6 S ffff88be70269fa0 0 21284 2 0x00000000 2018-04-08 13:24:21 [44944.572286] Call Trace: 2018-04-08 13:24:21 [44944.575136] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.580502] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.586897] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.592867] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.599790] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.605058] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.611541] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.617335] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.623818] z_fr_iss_7 S ffff88be7026eeb0 0 21285 2 0x00000000 2018-04-08 13:24:21 [44944.631310] Call Trace: 2018-04-08 13:24:21 [44944.634158] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.639523] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.645923] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.651890] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.658814] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.664090] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.670579] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.676365] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.682852] z_fr_int S ffff88be70268000 0 21286 2 0x00000000 2018-04-08 13:24:21 [44944.690342] Call Trace: 2018-04-08 13:24:21 [44944.693190] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.698557] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.704953] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.710923] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.717846] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.723120] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.729602] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.735388] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.741866] z_cl_iss S ffff88be7026cf10 0 21287 2 0x00000000 2018-04-08 13:24:21 [44944.749350] Call Trace: 2018-04-08 13:24:21 [44944.752199] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.757564] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.763960] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:21 [44944.769929] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:21 [44944.776854] [] kthread+0xcf/0xe0 2018-04-08 13:24:21 [44944.782133] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.788616] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:21 [44944.794405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:21 [44944.800892] z_cl_int S ffff88be7026dee0 0 21288 2 0x00000000 2018-04-08 13:24:21 [44944.808382] Call Trace: 2018-04-08 13:24:21 [44944.811229] [] schedule+0x29/0x70 2018-04-08 13:24:21 [44944.816596] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:21 [44944.822990] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44944.828959] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44944.835876] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44944.841149] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44944.847630] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44944.853421] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44944.859904] z_ioctl_iss S ffff88be7026af70 0 21289 2 0x00000000 2018-04-08 13:24:22 [44944.867398] Call Trace: 2018-04-08 13:24:22 [44944.870247] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44944.875610] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44944.882008] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44944.887977] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44944.894902] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44944.900184] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44944.906672] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44944.912462] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44944.918946] z_ioctl_int S ffff88be7026bf40 0 21290 2 0x00000000 2018-04-08 13:24:22 [44944.926439] Call Trace: 2018-04-08 13:24:22 [44944.929286] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44944.934652] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44944.941050] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44944.947031] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:22 [44944.955515] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44944.962440] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44944.967725] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44944.974215] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44944.980008] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44944.986490] z_zvol S ffff88606d369fa0 0 21291 2 0x00000000 2018-04-08 13:24:22 [44944.993985] Call Trace: 2018-04-08 13:24:22 [44944.996838] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.002206] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.008612] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.014589] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.021514] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.026791] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.033282] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.039074] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.045557] z_upgrade S ffff88606d368000 0 21292 2 0x00000000 2018-04-08 13:24:22 [44945.053049] Call Trace: 2018-04-08 13:24:22 [44945.055908] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.061283] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.067690] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.073664] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.080592] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.085874] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.092368] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.098166] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.104653] metaslab_group_ S ffff88606d36eeb0 0 21293 2 0x00000000 2018-04-08 13:24:22 [44945.112153] Call Trace: 2018-04-08 13:24:22 [44945.115009] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.120376] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.126781] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.132758] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.139682] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.144958] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.151451] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.157251] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.163736] dp_sync_taskq S ffff88012d3bdee0 0 21298 2 0x00000000 2018-04-08 13:24:22 [44945.171218] Call Trace: 2018-04-08 13:24:22 [44945.174079] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.179452] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.185857] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.191834] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.198758] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.204035] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.210527] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.216327] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.222811] dp_sync_taskq S ffff88012d3b8000 0 21299 2 0x00000000 2018-04-08 13:24:22 [44945.230305] Call Trace: 2018-04-08 13:24:22 [44945.233157] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.238521] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.244927] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.250903] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.257827] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.263107] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.269590] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.275379] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.281864] dp_sync_taskq S ffff88012d3bcf10 0 21300 2 0x00000000 2018-04-08 13:24:22 [44945.289360] Call Trace: 2018-04-08 13:24:22 [44945.292215] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.297578] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.303975] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.309952] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.316878] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.322160] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.328651] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.334437] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.340923] dp_sync_taskq S ffff88012d3beeb0 0 21301 2 0x00000000 2018-04-08 13:24:22 [44945.348415] Call Trace: 2018-04-08 13:24:22 [44945.351274] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.356639] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.363042] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.369014] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.375938] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.381216] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.387698] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.393486] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.399971] dp_sync_taskq S ffff88012d3b9fa0 0 21302 2 0x00000000 2018-04-08 13:24:22 [44945.407465] Call Trace: 2018-04-08 13:24:22 [44945.410323] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.415688] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.422095] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.428070] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.434994] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.440276] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.446765] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.452555] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.459038] dp_sync_taskq S ffff88012c8a2f70 0 21303 2 0x00000000 2018-04-08 13:24:22 [44945.466534] Call Trace: 2018-04-08 13:24:22 [44945.469388] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.474755] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.481160] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.487138] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.494059] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.499335] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.505825] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.511614] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.518097] dp_sync_taskq S ffff88012c8a3f40 0 21304 2 0x00000000 2018-04-08 13:24:22 [44945.525590] Call Trace: 2018-04-08 13:24:22 [44945.528449] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.533816] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.540220] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.546196] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.553118] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.558402] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.564891] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.570682] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.577164] dp_sync_taskq S ffff88012c8a6eb0 0 21305 2 0x00000000 2018-04-08 13:24:22 [44945.584658] Call Trace: 2018-04-08 13:24:22 [44945.587513] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.592881] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.599288] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.605262] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.612188] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.617473] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.623960] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.629757] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.636240] dp_sync_taskq S ffff88012c8a5ee0 0 21306 2 0x00000000 2018-04-08 13:24:22 [44945.643733] Call Trace: 2018-04-08 13:24:22 [44945.646590] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.651956] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.658360] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.664330] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.671255] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.676535] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.683026] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.688815] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.695298] dp_sync_taskq S ffff88beb460cf10 0 21307 2 0x00000000 2018-04-08 13:24:22 [44945.702790] Call Trace: 2018-04-08 13:24:22 [44945.705639] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.711005] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.717411] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.723387] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.730311] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.735592] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.742074] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.747863] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.754349] dp_sync_taskq S ffff88be5ef18000 0 21308 2 0x00000000 2018-04-08 13:24:22 [44945.761844] Call Trace: 2018-04-08 13:24:22 [44945.764700] [] schedule+0x29/0x70 2018-04-08 13:24:22 [44945.770065] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:22 [44945.776470] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:22 [44945.782445] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:22 [44945.789373] [] kthread+0xcf/0xe0 2018-04-08 13:24:22 [44945.794651] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.801143] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:22 [44945.806931] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:22 [44945.813418] dp_sync_taskq S ffff885eb6215ee0 0 21309 2 0x00000000 2018-04-08 13:24:22 [44945.820909] Call Trace: 2018-04-08 13:24:22 [44945.823767] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44945.829131] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44945.835539] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44945.841514] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44945.848441] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44945.853721] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44945.860208] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44945.865999] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44945.872483] z_iput S ffff885eb6216eb0 0 21310 2 0x00000000 2018-04-08 13:24:23 [44945.879968] Call Trace: 2018-04-08 13:24:23 [44945.882823] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44945.888190] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44945.894596] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44945.900571] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44945.907498] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44945.912776] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44945.919258] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44945.925045] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44945.931532] txg_quiesce S ffff88be1e3c1fa0 0 21403 2 0x00000000 2018-04-08 13:24:23 [44945.939023] Call Trace: 2018-04-08 13:24:23 [44945.941871] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44945.947241] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:23 [44945.953818] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:23 [44945.960054] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:23 [44945.966388] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:23 [44945.973331] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:23 [44945.979565] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:23 [44945.986661] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:23 [44945.993144] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44945.998415] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.004899] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.010692] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.017178] txg_sync S ffff88be1e3c3f40 0 21404 2 0x00000000 2018-04-08 13:24:23 [44946.024669] Call Trace: 2018-04-08 13:24:23 [44946.027525] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.032889] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:23 [44946.039135] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:23 [44946.045792] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:23 [44946.052191] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:23 [44946.059196] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:23 [44946.066285] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:23 [44946.072510] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:23 [44946.079269] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:23 [44946.085943] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:23 [44946.092172] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:23 [44946.099264] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:23 [44946.105753] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.111018] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.117498] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.123286] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.129763] mmp S ffff88be1e3c4f10 0 21405 2 0x00000000 2018-04-08 13:24:23 [44946.137246] Call Trace: 2018-04-08 13:24:23 [44946.140094] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.145452] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:23 [44946.151676] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:23 [44946.158076] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:23 [44946.165163] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:23 [44946.171385] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:23 [44946.178142] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:23 [44946.184376] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:23 [44946.191041] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:23 [44946.197781] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:23 [44946.204867] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:23 [44946.211342] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.216609] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.223082] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.228863] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.235335] z_null_iss S ffff88bdd5e40000 0 21849 2 0x00000000 2018-04-08 13:24:23 [44946.242811] Call Trace: 2018-04-08 13:24:23 [44946.245652] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.251009] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.257398] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.263371] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.271844] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.278762] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.284040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.290523] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.296314] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.302799] z_null_int S ffff88bdd5e40fd0 0 21850 2 0x00000000 2018-04-08 13:24:23 [44946.310281] Call Trace: 2018-04-08 13:24:23 [44946.313127] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.318482] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.324880] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.330863] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.339346] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.346268] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.351548] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.358034] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.363830] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.370317] z_rd_iss S ffff88bdd5e41fa0 0 21851 2 0x00000000 2018-04-08 13:24:23 [44946.377809] Call Trace: 2018-04-08 13:24:23 [44946.380667] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.386032] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.392438] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.398428] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.406920] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.413851] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.419141] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.425630] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.431430] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.437920] z_rd_int_0 S ffff88bdd5e42f70 0 21852 2 0x00000000 2018-04-08 13:24:23 [44946.445424] Call Trace: 2018-04-08 13:24:23 [44946.448281] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.453656] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.460071] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.466071] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.474569] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.481511] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.486799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.493301] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.499108] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.505611] z_rd_int_1 S ffff88bdd5e43f40 0 21853 2 0x00000000 2018-04-08 13:24:23 [44946.513129] Call Trace: 2018-04-08 13:24:23 [44946.516007] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.521395] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.527816] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.533815] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.542313] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.549257] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.554555] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.561061] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.566877] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.573375] z_rd_int_2 S ffff88bdd5e44f10 0 21854 2 0x00000000 2018-04-08 13:24:23 [44946.580884] Call Trace: 2018-04-08 13:24:23 [44946.583755] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.589144] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.595561] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.601561] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.610063] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.617010] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.622307] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.628818] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.634630] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.641131] z_rd_int_3 S ffff88bdd5e45ee0 0 21855 2 0x00000000 2018-04-08 13:24:23 [44946.648634] Call Trace: 2018-04-08 13:24:23 [44946.651505] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.656890] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.663310] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.669306] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.677810] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.684756] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.690054] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.696562] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.702378] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.708879] z_rd_int_4 S ffff88bdd5e46eb0 0 21856 2 0x00000000 2018-04-08 13:24:23 [44946.716387] Call Trace: 2018-04-08 13:24:23 [44946.719262] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.724649] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.731067] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.737071] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.745573] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.752515] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.757810] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.764321] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:23 [44946.770133] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:23 [44946.776637] z_rd_int_5 S ffff88bdd2bd0000 0 21857 2 0x00000000 2018-04-08 13:24:23 [44946.784145] Call Trace: 2018-04-08 13:24:23 [44946.787021] [] schedule+0x29/0x70 2018-04-08 13:24:23 [44946.792402] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:23 [44946.798825] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:23 [44946.804827] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:23 [44946.813329] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:23 [44946.820272] [] kthread+0xcf/0xe0 2018-04-08 13:24:23 [44946.825567] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44946.832077] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44946.837888] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44946.844390] z_rd_int_6 S ffff88bdd2bd0fd0 0 21858 2 0x00000000 2018-04-08 13:24:24 [44946.851899] Call Trace: 2018-04-08 13:24:24 [44946.854775] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44946.860158] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44946.866577] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44946.872575] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44946.881076] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44946.888016] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44946.893313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44946.899823] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44946.905636] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44946.912137] z_rd_int_7 S ffff88bdd2bd1fa0 0 21859 2 0x00000000 2018-04-08 13:24:24 [44946.919640] Call Trace: 2018-04-08 13:24:24 [44946.922514] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44946.927897] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44946.934317] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44946.940325] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44946.948822] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44946.955763] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44946.961059] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44946.967569] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44946.973382] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44946.979883] z_wr_iss S ffff88bdd2bd2f70 0 21860 2 0x00000000 2018-04-08 13:24:24 [44946.987395] Call Trace: 2018-04-08 13:24:24 [44946.990268] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44946.995653] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.002072] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.008070] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.016573] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.023522] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.028827] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.035335] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.041148] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.047650] z_wr_iss S ffff88bdd2bd3f40 0 21861 2 0x00000000 2018-04-08 13:24:24 [44947.055159] Call Trace: 2018-04-08 13:24:24 [44947.058034] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.063418] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.069838] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.075841] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.084342] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.091287] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.096594] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.103097] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.108916] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.115422] z_wr_iss S ffff88bdd2bd4f10 0 21862 2 0x00000000 2018-04-08 13:24:24 [44947.122933] Call Trace: 2018-04-08 13:24:24 [44947.125808] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.131192] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.137610] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.143615] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.152118] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.159066] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.164365] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.170873] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.176687] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.183188] z_wr_iss S ffff88bdd2bd5ee0 0 21863 2 0x00000000 2018-04-08 13:24:24 [44947.190696] Call Trace: 2018-04-08 13:24:24 [44947.193571] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.198955] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.205382] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.211380] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.219880] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.226823] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.232118] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.238628] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.244441] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.250945] z_wr_iss S ffff88bdd2bd6eb0 0 21864 2 0x00000000 2018-04-08 13:24:24 [44947.258452] Call Trace: 2018-04-08 13:24:24 [44947.261327] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.266711] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.273133] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.279135] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.287637] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.294586] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.299882] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.306391] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.312207] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.318707] z_wr_iss S ffff88bdd4fe8000 0 21865 2 0x00000000 2018-04-08 13:24:24 [44947.326214] Call Trace: 2018-04-08 13:24:24 [44947.329089] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.334476] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.340895] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.346900] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.355399] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.362343] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.367636] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.374147] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.379961] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.386462] z_wr_iss S ffff88bdd4fe8fd0 0 21866 2 0x00000000 2018-04-08 13:24:24 [44947.393974] Call Trace: 2018-04-08 13:24:24 [44947.396846] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.402231] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.408651] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.414656] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.423160] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.430105] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.435405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.441909] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.447716] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.454216] z_wr_iss S ffff88bdd4fe9fa0 0 21867 2 0x00000000 2018-04-08 13:24:24 [44947.461729] Call Trace: 2018-04-08 13:24:24 [44947.464604] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.469987] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.476405] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.482402] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.490903] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.497841] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.503142] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.509652] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.515463] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.521965] z_wr_iss S ffff88bdd4feaf70 0 21868 2 0x00000000 2018-04-08 13:24:24 [44947.529475] Call Trace: 2018-04-08 13:24:24 [44947.532349] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.537735] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.544154] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.550158] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.558658] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.565600] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.570898] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.577403] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.583212] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.589711] z_wr_iss S ffff88bdd4febf40 0 21869 2 0x00000000 2018-04-08 13:24:24 [44947.597224] Call Trace: 2018-04-08 13:24:24 [44947.600095] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.605481] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.611900] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.617907] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.626409] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.633357] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.638652] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.645162] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.650973] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.657474] z_wr_iss S ffff88bdd4fecf10 0 21870 2 0x00000000 2018-04-08 13:24:24 [44947.664986] Call Trace: 2018-04-08 13:24:24 [44947.667860] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.673243] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.679664] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.685660] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.694159] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.701102] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.706400] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.712907] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.718715] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.725215] z_wr_iss S ffff88bdd4fedee0 0 21871 2 0x00000000 2018-04-08 13:24:24 [44947.732722] Call Trace: 2018-04-08 13:24:24 [44947.735591] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.740976] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.747392] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.753392] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:24 [44947.761890] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:24 [44947.768831] [] kthread+0xcf/0xe0 2018-04-08 13:24:24 [44947.774130] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.780638] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:24 [44947.786455] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:24 [44947.792956] z_wr_iss_h S ffff88bdd4feeeb0 0 21872 2 0x00000000 2018-04-08 13:24:24 [44947.800464] Call Trace: 2018-04-08 13:24:24 [44947.803339] [] schedule+0x29/0x70 2018-04-08 13:24:24 [44947.808721] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:24 [44947.815141] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:24 [44947.821124] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44947.828057] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44947.833347] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44947.839849] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44947.845656] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44947.852154] z_wr_int_0 S ffff88bdd6af8000 0 21873 2 0x00000000 2018-04-08 13:24:25 [44947.859653] Call Trace: 2018-04-08 13:24:25 [44947.862522] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44947.867904] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44947.874317] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44947.880314] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44947.888811] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44947.895752] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44947.901041] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44947.907545] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44947.913351] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44947.919851] z_wr_int_1 S ffff88bdd6af8fd0 0 21874 2 0x00000000 2018-04-08 13:24:25 [44947.927359] Call Trace: 2018-04-08 13:24:25 [44947.930226] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44947.935609] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44947.942023] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44947.948016] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44947.956508] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44947.963448] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44947.968736] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44947.975238] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44947.981048] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44947.987544] z_wr_int_2 S ffff88bdd6af9fa0 0 21875 2 0x00000000 2018-04-08 13:24:25 [44947.995045] Call Trace: 2018-04-08 13:24:25 [44947.997909] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.003287] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.009702] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.015693] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44948.024185] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.031126] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.036414] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.042919] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.048723] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.055223] z_wr_int_3 S ffff88bdd6afaf70 0 21876 2 0x00000000 2018-04-08 13:24:25 [44948.062733] Call Trace: 2018-04-08 13:24:25 [44948.065598] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.070982] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.077398] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.083398] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44948.091889] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.098830] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.104117] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.110621] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.116431] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.122930] z_wr_int_4 S ffff88bdd6afbf40 0 21877 2 0x00000000 2018-04-08 13:24:25 [44948.130440] Call Trace: 2018-04-08 13:24:25 [44948.133315] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.138698] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.145120] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.151124] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44948.159626] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.166566] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.171861] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.178371] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.184187] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.190686] z_wr_int_5 S ffff88bdd6afcf10 0 21878 2 0x00000000 2018-04-08 13:24:25 [44948.198199] Call Trace: 2018-04-08 13:24:25 [44948.201072] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.206456] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.212875] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.218871] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44948.227371] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.234312] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.239610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.246117] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.251927] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.258427] z_wr_int_6 S ffff88bdd6afdee0 0 21879 2 0x00000000 2018-04-08 13:24:25 [44948.265937] Call Trace: 2018-04-08 13:24:25 [44948.268809] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.274195] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.280613] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.286610] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44948.295110] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.302050] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.307349] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.313858] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.319670] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.326172] z_wr_int_7 S ffff88bdd6afeeb0 0 21880 2 0x00000000 2018-04-08 13:24:25 [44948.333672] Call Trace: 2018-04-08 13:24:25 [44948.336546] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.341931] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.348350] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.354347] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:25 [44948.362848] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.369793] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.375094] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.381602] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.387407] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.393908] z_wr_int_h S ffff88bdd77d8000 0 21881 2 0x00000000 2018-04-08 13:24:25 [44948.401421] Call Trace: 2018-04-08 13:24:25 [44948.404295] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.409680] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.416099] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.422081] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.429016] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.434313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.440814] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.446621] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.453124] z_fr_iss_0 S ffff88bdd77d8fd0 0 21882 2 0x00000000 2018-04-08 13:24:25 [44948.460629] Call Trace: 2018-04-08 13:24:25 [44948.463498] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.468877] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.475295] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.481275] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.488207] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.493496] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.499996] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.505797] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.512296] z_fr_iss_1 S ffff88bdd77d9fa0 0 21883 2 0x00000000 2018-04-08 13:24:25 [44948.519786] Call Trace: 2018-04-08 13:24:25 [44948.522641] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.528019] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.534433] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.540417] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.547346] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.552625] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.559119] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.564920] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.571414] z_fr_iss_2 S ffff88bdd77daf70 0 21884 2 0x00000000 2018-04-08 13:24:25 [44948.578901] Call Trace: 2018-04-08 13:24:25 [44948.581757] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.587122] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.593528] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.599506] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.606429] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.611707] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.618196] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.623992] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.630481] z_fr_iss_3 S ffff88bdd77dbf40 0 21885 2 0x00000000 2018-04-08 13:24:25 [44948.637978] Call Trace: 2018-04-08 13:24:25 [44948.640832] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.646194] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.652597] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.658565] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.665485] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.670768] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.677252] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.683044] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.689528] z_fr_iss_4 S ffff88bdd77dcf10 0 21886 2 0x00000000 2018-04-08 13:24:25 [44948.697020] Call Trace: 2018-04-08 13:24:25 [44948.699867] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.705234] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.711631] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.717600] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.724522] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.729796] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.736277] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.742073] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.748549] z_fr_iss_5 S ffff88bdd77ddee0 0 21887 2 0x00000000 2018-04-08 13:24:25 [44948.756035] Call Trace: 2018-04-08 13:24:25 [44948.758884] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.764249] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:25 [44948.770644] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:25 [44948.776613] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:25 [44948.783531] [] kthread+0xcf/0xe0 2018-04-08 13:24:25 [44948.788817] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.795302] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:25 [44948.801091] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:25 [44948.807576] z_fr_iss_6 S ffff88bdd77deeb0 0 21888 2 0x00000000 2018-04-08 13:24:25 [44948.815070] Call Trace: 2018-04-08 13:24:25 [44948.817926] [] schedule+0x29/0x70 2018-04-08 13:24:25 [44948.823289] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44948.829686] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44948.835656] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44948.842582] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44948.847860] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44948.854342] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44948.860133] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44948.866615] z_fr_iss_7 S ffff88bdd9e58000 0 21889 2 0x00000000 2018-04-08 13:24:26 [44948.874110] Call Trace: 2018-04-08 13:24:26 [44948.876966] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44948.882330] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44948.888728] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44948.894697] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44948.901619] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44948.906894] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44948.913383] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44948.919177] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44948.925658] z_fr_int S ffff88bdd9e58fd0 0 21890 2 0x00000000 2018-04-08 13:24:26 [44948.933150] Call Trace: 2018-04-08 13:24:26 [44948.936000] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44948.941364] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44948.947761] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44948.953729] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44948.960653] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44948.965935] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44948.972415] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44948.978207] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44948.984690] z_cl_iss S ffff88bdd9e59fa0 0 21891 2 0x00000000 2018-04-08 13:24:26 [44948.992182] Call Trace: 2018-04-08 13:24:26 [44948.995030] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.000398] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.006800] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.012772] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.019692] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.024968] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.031457] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.037250] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.043729] z_cl_int S ffff88bdd9e5af70 0 21892 2 0x00000000 2018-04-08 13:24:26 [44949.051215] Call Trace: 2018-04-08 13:24:26 [44949.054064] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.059429] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.065835] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.071810] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.078736] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.084015] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.090497] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.096288] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.102771] z_ioctl_iss S ffff88bdd9e5bf40 0 21893 2 0x00000000 2018-04-08 13:24:26 [44949.110263] Call Trace: 2018-04-08 13:24:26 [44949.113114] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.118476] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.124876] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.130843] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.137767] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.143046] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.149529] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.155322] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.161805] z_ioctl_int S ffff88bdd9e5cf10 0 21894 2 0x00000000 2018-04-08 13:24:26 [44949.169295] Call Trace: 2018-04-08 13:24:26 [44949.172144] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.177511] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.183918] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.189907] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:26 [44949.198389] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.205313] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.210587] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.217072] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.222866] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.229356] z_zvol S ffff88bdd9e5dee0 0 21895 2 0x00000000 2018-04-08 13:24:26 [44949.236849] Call Trace: 2018-04-08 13:24:26 [44949.239707] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.245070] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.251478] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.257456] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.264380] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.269656] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.276151] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.281949] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.288433] z_upgrade S ffff88bdd9e5eeb0 0 21896 2 0x00000000 2018-04-08 13:24:26 [44949.295924] Call Trace: 2018-04-08 13:24:26 [44949.298782] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.304147] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.310554] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.316532] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.323453] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.328730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.335217] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.341017] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.347511] metaslab_group_ S ffff88bddaf20000 0 21897 2 0x00000000 2018-04-08 13:24:26 [44949.355006] Call Trace: 2018-04-08 13:24:26 [44949.357865] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.363233] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.369640] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.375612] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.382540] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.387816] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.394307] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.400099] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.406586] dp_sync_taskq S ffff88bddaf23f40 0 21901 2 0x00000000 2018-04-08 13:24:26 [44949.414085] Call Trace: 2018-04-08 13:24:26 [44949.416943] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.422317] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.428723] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.434700] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.441624] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.446901] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.453392] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.459185] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.465668] dp_sync_taskq S ffff88bddaf24f10 0 21902 2 0x00000000 2018-04-08 13:24:26 [44949.473164] Call Trace: 2018-04-08 13:24:26 [44949.476016] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.481380] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.487786] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.493761] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.500688] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.505972] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.512459] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.518248] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.524733] dp_sync_taskq S ffff88bddaf25ee0 0 21903 2 0x00000000 2018-04-08 13:24:26 [44949.532225] Call Trace: 2018-04-08 13:24:26 [44949.535081] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.540451] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.546853] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.552829] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.559753] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.565035] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.571524] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.577313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.583801] dp_sync_taskq S ffff88bddaf26eb0 0 21904 2 0x00000000 2018-04-08 13:24:26 [44949.591291] Call Trace: 2018-04-08 13:24:26 [44949.594149] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.599513] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.605919] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.611897] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.618821] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.624104] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.630593] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.636381] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.642864] dp_sync_taskq S ffff88bddaf22f70 0 21905 2 0x00000000 2018-04-08 13:24:26 [44949.650359] Call Trace: 2018-04-08 13:24:26 [44949.653217] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.658582] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.664986] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.670961] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.677887] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.683168] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.689659] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.695450] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.701931] dp_sync_taskq S ffff88bdde92eeb0 0 21906 2 0x00000000 2018-04-08 13:24:26 [44949.709426] Call Trace: 2018-04-08 13:24:26 [44949.712282] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.717647] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.724053] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.730029] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.736954] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.742236] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.748726] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.754516] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.760997] dp_sync_taskq S ffff88bdde92bf40 0 21907 2 0x00000000 2018-04-08 13:24:26 [44949.768491] Call Trace: 2018-04-08 13:24:26 [44949.771349] [] schedule+0x29/0x70 2018-04-08 13:24:26 [44949.776716] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:26 [44949.783121] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:26 [44949.789095] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:26 [44949.796023] [] kthread+0xcf/0xe0 2018-04-08 13:24:26 [44949.801302] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:26 [44949.807792] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.814272] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:26 [44949.820064] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:26 [44949.826551] dp_sync_taskq S ffff88bdde92cf10 0 21908 2 0x00000000 2018-04-08 13:24:27 [44949.834034] Call Trace: 2018-04-08 13:24:27 [44949.836891] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44949.842256] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44949.848662] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44949.854632] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44949.861554] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44949.866832] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44949.873315] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44949.879105] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44949.885591] dp_sync_taskq S ffff88bdde92af70 0 21909 2 0x00000000 2018-04-08 13:24:27 [44949.893076] Call Trace: 2018-04-08 13:24:27 [44949.895932] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44949.901299] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44949.907703] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44949.913681] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44949.920603] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44949.925882] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44949.932366] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44949.938156] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44949.944640] dp_sync_taskq S ffff88bdde929fa0 0 21910 2 0x00000000 2018-04-08 13:24:27 [44949.952135] Call Trace: 2018-04-08 13:24:27 [44949.954992] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44949.960356] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44949.966764] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44949.972736] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44949.979665] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44949.984937] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44949.991423] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44949.997216] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.003697] dp_sync_taskq S ffff88bdde825ee0 0 21911 2 0x00000000 2018-04-08 13:24:27 [44950.011192] Call Trace: 2018-04-08 13:24:27 [44950.014049] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.019415] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.025820] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.031798] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.038722] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.043999] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.050480] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.056275] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.062758] dp_sync_taskq S ffff88bdde823f40 0 21912 2 0x00000000 2018-04-08 13:24:27 [44950.070251] Call Trace: 2018-04-08 13:24:27 [44950.073108] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.078473] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.084878] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.090855] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.097782] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.103060] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.109553] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.115351] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.121835] z_iput S ffff88bdde821fa0 0 21913 2 0x00000000 2018-04-08 13:24:27 [44950.129328] Call Trace: 2018-04-08 13:24:27 [44950.132184] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.137550] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.143956] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.149931] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.156859] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.162138] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.168626] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.174416] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.180904] txg_quiesce S ffff88beb2bceeb0 0 22014 2 0x00000000 2018-04-08 13:24:27 [44950.188384] Call Trace: 2018-04-08 13:24:27 [44950.191240] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.196607] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:27 [44950.203184] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:27 [44950.209414] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:27 [44950.215749] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:27 [44950.222693] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:27 [44950.228922] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:27 [44950.236020] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:27 [44950.242505] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.247786] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.254270] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.260060] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.266542] txg_sync S ffff88bddcfb8000 0 22015 2 0x00000000 2018-04-08 13:24:27 [44950.274037] Call Trace: 2018-04-08 13:24:27 [44950.276894] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.282257] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:27 [44950.288495] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:27 [44950.295151] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:27 [44950.301549] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:27 [44950.308555] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:27 [44950.315645] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:27 [44950.321868] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:27 [44950.328626] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:27 [44950.335302] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:27 [44950.341530] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:27 [44950.348622] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:27 [44950.355108] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.360377] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.366852] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.372640] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.379121] mmp S ffff88bddcfb8fd0 0 22016 2 0x00000000 2018-04-08 13:24:27 [44950.386605] Call Trace: 2018-04-08 13:24:27 [44950.389452] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.394809] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:27 [44950.401034] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:27 [44950.407436] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:27 [44950.414518] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:27 [44950.420734] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:27 [44950.427489] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:27 [44950.433724] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:27 [44950.440393] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:27 [44950.447131] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:27 [44950.454222] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:27 [44950.460700] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.465965] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.472441] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.478221] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.484696] z_null_iss S ffff88be5eefeeb0 0 22427 2 0x00000000 2018-04-08 13:24:27 [44950.492181] Call Trace: 2018-04-08 13:24:27 [44950.495018] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.500377] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.506764] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.512741] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:27 [44950.521210] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.528123] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.533400] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.539881] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.545675] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.552158] z_null_int S ffff88be5eefaf70 0 22428 2 0x00000000 2018-04-08 13:24:27 [44950.559643] Call Trace: 2018-04-08 13:24:27 [44950.562488] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.567842] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.574240] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.580225] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:27 [44950.588706] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.595628] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.600910] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.607403] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.613203] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.619683] z_rd_iss S ffff88be5eefcf10 0 22429 2 0x00000000 2018-04-08 13:24:27 [44950.627169] Call Trace: 2018-04-08 13:24:27 [44950.630025] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.635390] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.641796] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.647789] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:27 [44950.656279] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.663211] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.668501] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.674999] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.680799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.687290] z_rd_int_0 S ffff88be5eefbf40 0 22430 2 0x00000000 2018-04-08 13:24:27 [44950.694786] Call Trace: 2018-04-08 13:24:27 [44950.697650] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.703025] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.709439] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.715435] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:27 [44950.723929] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.730868] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.736161] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.742668] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.748478] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.754979] z_rd_int_1 S ffff88be5eefdee0 0 22431 2 0x00000000 2018-04-08 13:24:27 [44950.762490] Call Trace: 2018-04-08 13:24:27 [44950.765365] [] schedule+0x29/0x70 2018-04-08 13:24:27 [44950.770747] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:27 [44950.777170] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:27 [44950.783175] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:27 [44950.791673] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:27 [44950.798612] [] kthread+0xcf/0xe0 2018-04-08 13:24:27 [44950.803912] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.810418] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:27 [44950.816228] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:27 [44950.822735] z_rd_int_2 S ffff88be5eef8000 0 22432 2 0x00000000 2018-04-08 13:24:28 [44950.830247] Call Trace: 2018-04-08 13:24:28 [44950.833121] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44950.838503] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44950.844924] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44950.850926] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44950.859427] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44950.866366] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44950.871669] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44950.878174] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44950.883993] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44950.890489] z_rd_int_3 S ffff88be5eef9fa0 0 22433 2 0x00000000 2018-04-08 13:24:28 [44950.898000] Call Trace: 2018-04-08 13:24:28 [44950.900875] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44950.906260] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44950.912677] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44950.918676] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44950.927178] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44950.934127] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44950.939422] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44950.945930] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44950.951745] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44950.958246] z_rd_int_4 S ffff88be5eef8fd0 0 22434 2 0x00000000 2018-04-08 13:24:28 [44950.965757] Call Trace: 2018-04-08 13:24:28 [44950.968633] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44950.974026] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44950.980449] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44950.986450] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44950.994952] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.001900] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.007197] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.013706] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.019522] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.026030] z_rd_int_5 S ffff88be65f9eeb0 0 22435 2 0x00000000 2018-04-08 13:24:28 [44951.033542] Call Trace: 2018-04-08 13:24:28 [44951.036416] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.041804] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.048226] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.054231] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.062731] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.069674] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.074971] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.081479] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.087295] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.093806] z_rd_int_6 S ffff88be65f99fa0 0 22436 2 0x00000000 2018-04-08 13:24:28 [44951.101322] Call Trace: 2018-04-08 13:24:28 [44951.104198] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.109590] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.116006] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.122005] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.130504] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.137446] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.142749] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.149259] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.155077] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.161583] z_rd_int_7 S ffff88be65f98fd0 0 22437 2 0x00000000 2018-04-08 13:24:28 [44951.169086] Call Trace: 2018-04-08 13:24:28 [44951.171962] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.177354] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.183772] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.189778] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.198278] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.205217] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.210515] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.217027] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.222838] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.229341] z_wr_iss S ffff88be65f98000 0 22438 2 0x00000000 2018-04-08 13:24:28 [44951.236851] Call Trace: 2018-04-08 13:24:28 [44951.239724] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.245108] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.251527] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.257533] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.266030] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.272975] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.278270] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.284781] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.290593] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.297093] z_wr_iss S ffff88be65f9cf10 0 22439 2 0x00000000 2018-04-08 13:24:28 [44951.304604] Call Trace: 2018-04-08 13:24:28 [44951.307478] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.312862] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.319284] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.325287] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.333789] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.340726] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.346029] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.352536] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.358348] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.364851] z_wr_iss S ffff88012d3b8fd0 0 22440 2 0x00000000 2018-04-08 13:24:28 [44951.372361] Call Trace: 2018-04-08 13:24:28 [44951.375236] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.380617] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.387038] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.393033] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.401538] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.408485] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.413785] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.420289] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.426096] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.432597] z_wr_iss S ffff88012c81bf40 0 22441 2 0x00000000 2018-04-08 13:24:28 [44951.440106] Call Trace: 2018-04-08 13:24:28 [44951.442983] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.448367] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.454785] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.460783] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.469283] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.476222] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.481521] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.488030] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.493842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.500347] z_wr_iss S ffff88012c818fd0 0 22442 2 0x00000000 2018-04-08 13:24:28 [44951.507855] Call Trace: 2018-04-08 13:24:28 [44951.510729] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.516112] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.522531] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.528529] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.537030] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.543970] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.549268] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.555774] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.561583] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.568083] z_wr_iss S ffff88012c81eeb0 0 22443 2 0x00000000 2018-04-08 13:24:28 [44951.575593] Call Trace: 2018-04-08 13:24:28 [44951.578467] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.583849] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.590272] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.596278] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.604775] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.611717] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.617015] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.623524] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.629338] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.635840] z_wr_iss S ffff885e9d371fa0 0 22444 2 0x00000000 2018-04-08 13:24:28 [44951.643341] Call Trace: 2018-04-08 13:24:28 [44951.646216] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.651597] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.658016] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.664013] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.672522] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.679465] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.684763] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.691270] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.697085] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.703583] z_wr_iss S ffff885e9d376eb0 0 22445 2 0x00000000 2018-04-08 13:24:28 [44951.711086] Call Trace: 2018-04-08 13:24:28 [44951.713964] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.719355] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.725774] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.731780] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.740279] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.747221] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.752519] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.759028] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:28 [44951.764842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.771342] z_wr_iss S ffff885e9d375ee0 0 22446 2 0x00000000 2018-04-08 13:24:28 [44951.778854] Call Trace: 2018-04-08 13:24:28 [44951.781728] [] schedule+0x29/0x70 2018-04-08 13:24:28 [44951.787119] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:28 [44951.793538] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:28 [44951.799535] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:28 [44951.808035] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:28 [44951.814977] [] kthread+0xcf/0xe0 2018-04-08 13:24:28 [44951.820275] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:28 [44951.826781] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44951.832599] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44951.839112] z_wr_iss S ffff885e9d374f10 0 22447 2 0x00000000 2018-04-08 13:24:29 [44951.846624] Call Trace: 2018-04-08 13:24:29 [44951.849498] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44951.854885] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44951.861301] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44951.867299] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44951.875801] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44951.882743] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44951.888039] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44951.894548] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44951.900361] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44951.906860] z_wr_iss S ffff885e9d372f70 0 22448 2 0x00000000 2018-04-08 13:24:29 [44951.914362] Call Trace: 2018-04-08 13:24:29 [44951.917237] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44951.922624] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44951.929040] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44951.935036] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44951.943539] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44951.950480] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44951.955777] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44951.962285] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44951.968101] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44951.974605] z_wr_iss S ffff885e9d370000 0 22449 2 0x00000000 2018-04-08 13:24:29 [44951.982120] Call Trace: 2018-04-08 13:24:29 [44951.984995] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44951.990379] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44951.996798] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.002808] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.011311] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.018252] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.023549] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.030061] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.035872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.042373] z_wr_iss_h S ffff885e9d373f40 0 22450 2 0x00000000 2018-04-08 13:24:29 [44952.049885] Call Trace: 2018-04-08 13:24:29 [44952.052759] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.058143] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.064561] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.070544] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.077477] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.082766] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.089271] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.095085] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.101585] z_wr_int_0 S ffff88be5a140000 0 22451 2 0x00000000 2018-04-08 13:24:29 [44952.109092] Call Trace: 2018-04-08 13:24:29 [44952.111957] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.117343] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.123758] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.129762] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.138260] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.145200] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.150497] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.157003] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.162815] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.169316] z_wr_int_1 S ffff88be5a140fd0 0 22452 2 0x00000000 2018-04-08 13:24:29 [44952.176821] Call Trace: 2018-04-08 13:24:29 [44952.179690] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.185074] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.191494] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.197491] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.205987] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.212930] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.218229] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.224739] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.230553] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.237051] z_wr_int_2 S ffff88be5a141fa0 0 22453 2 0x00000000 2018-04-08 13:24:29 [44952.244549] Call Trace: 2018-04-08 13:24:29 [44952.247417] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.252803] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.259214] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.265212] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.273711] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.280651] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.285950] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.292461] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.298274] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.304771] z_wr_int_3 S ffff88be5a142f70 0 22454 2 0x00000000 2018-04-08 13:24:29 [44952.312274] Call Trace: 2018-04-08 13:24:29 [44952.315137] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.320524] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.326937] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.332929] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.341423] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.348366] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.353662] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.360171] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.365982] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.372482] z_wr_int_4 S ffff88be5a143f40 0 22455 2 0x00000000 2018-04-08 13:24:29 [44952.379992] Call Trace: 2018-04-08 13:24:29 [44952.382867] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.388250] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.394668] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.400662] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.409170] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.416115] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.421414] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.427920] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.433726] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.440230] z_wr_int_5 S ffff88be5a144f10 0 22456 2 0x00000000 2018-04-08 13:24:29 [44952.447739] Call Trace: 2018-04-08 13:24:29 [44952.450612] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.455997] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.462416] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.468421] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.476921] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.483863] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.489160] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.495668] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.501483] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.507982] z_wr_int_6 S ffff88be5a145ee0 0 22457 2 0x00000000 2018-04-08 13:24:29 [44952.515486] Call Trace: 2018-04-08 13:24:29 [44952.518360] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.523744] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.530162] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.536161] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.544663] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.551609] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.556907] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.563417] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.569229] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.575734] z_wr_int_7 S ffff88be5a146eb0 0 22458 2 0x00000000 2018-04-08 13:24:29 [44952.583240] Call Trace: 2018-04-08 13:24:29 [44952.586116] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.591500] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.597918] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.603914] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:29 [44952.612417] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.619358] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.624655] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.631163] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.636978] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.643478] z_wr_int_h S ffff88beb4e88000 0 22459 2 0x00000000 2018-04-08 13:24:29 [44952.650989] Call Trace: 2018-04-08 13:24:29 [44952.653862] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.659247] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.665665] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.671650] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.678593] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.683888] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.690394] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.696206] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.702705] z_fr_iss_0 S ffff88beb4e88fd0 0 22460 2 0x00000000 2018-04-08 13:24:29 [44952.710214] Call Trace: 2018-04-08 13:24:29 [44952.713078] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.718455] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.724868] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.730850] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.737785] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.743070] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.749574] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.755384] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.761880] z_fr_iss_1 S ffff88beb4e89fa0 0 22461 2 0x00000000 2018-04-08 13:24:29 [44952.769372] Call Trace: 2018-04-08 13:24:29 [44952.772235] [] schedule+0x29/0x70 2018-04-08 13:24:29 [44952.777614] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:29 [44952.784029] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:29 [44952.790010] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:29 [44952.796939] [] kthread+0xcf/0xe0 2018-04-08 13:24:29 [44952.802220] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.808712] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:29 [44952.814512] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:29 [44952.821006] z_fr_iss_2 S ffff88beb4e8af70 0 22462 2 0x00000000 2018-04-08 13:24:29 [44952.828504] Call Trace: 2018-04-08 13:24:30 [44952.831360] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44952.836733] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44952.843140] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44952.849117] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44952.856037] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44952.861318] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44952.867809] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44952.873610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44952.880093] z_fr_iss_3 S ffff88beb4e8bf40 0 22463 2 0x00000000 2018-04-08 13:24:30 [44952.887585] Call Trace: 2018-04-08 13:24:30 [44952.890439] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44952.895805] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44952.902208] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44952.908176] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44952.915103] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44952.920383] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44952.926863] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44952.932655] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44952.939138] z_fr_iss_4 S ffff88beb4e8cf10 0 22464 2 0x00000000 2018-04-08 13:24:30 [44952.946630] Call Trace: 2018-04-08 13:24:30 [44952.949478] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44952.954844] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44952.961241] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44952.967209] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44952.974137] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44952.979415] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44952.985896] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44952.991682] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44952.998162] z_fr_iss_5 S ffff88beb4e8dee0 0 22465 2 0x00000000 2018-04-08 13:24:30 [44953.005652] Call Trace: 2018-04-08 13:24:30 [44953.008502] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.013868] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.020264] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.026233] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.033156] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.038430] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.044913] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.050700] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.057184] z_fr_iss_6 S ffff88beb4e8eeb0 0 22466 2 0x00000000 2018-04-08 13:24:30 [44953.064679] Call Trace: 2018-04-08 13:24:30 [44953.067526] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.072890] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.079286] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.085259] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.092181] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.097463] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.103944] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.109737] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.116218] z_fr_iss_7 S ffff88be5ef98000 0 22467 2 0x00000000 2018-04-08 13:24:30 [44953.123712] Call Trace: 2018-04-08 13:24:30 [44953.126566] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.131932] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.138328] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.144299] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.151222] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.156503] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.162987] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.168775] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.175258] z_fr_int S ffff88be5ef98fd0 0 22468 2 0x00000000 2018-04-08 13:24:30 [44953.182753] Call Trace: 2018-04-08 13:24:30 [44953.185607] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.190973] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.197373] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.203347] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.210277] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.215555] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.222043] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.227835] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.234318] z_cl_iss S ffff88be5ef99fa0 0 22469 2 0x00000000 2018-04-08 13:24:30 [44953.241809] Call Trace: 2018-04-08 13:24:30 [44953.244658] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.250024] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.256430] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.262406] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.269331] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.274612] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.281104] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.286893] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.293377] z_cl_int S ffff88be5ef9af70 0 22470 2 0x00000000 2018-04-08 13:24:30 [44953.300868] Call Trace: 2018-04-08 13:24:30 [44953.303716] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.309084] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.315487] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.321456] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.328381] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.333661] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.340151] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.345942] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.352425] z_ioctl_iss S ffff88be5ef9bf40 0 22471 2 0x00000000 2018-04-08 13:24:30 [44953.359910] Call Trace: 2018-04-08 13:24:30 [44953.362765] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.368133] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.374535] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.380505] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.387431] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.392709] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.399190] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.404980] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.411465] z_ioctl_int S ffff88be5ef9cf10 0 22472 2 0x00000000 2018-04-08 13:24:30 [44953.418959] Call Trace: 2018-04-08 13:24:30 [44953.421814] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.427181] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.433589] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.439579] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:30 [44953.448061] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.454994] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.460269] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.466761] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.472562] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.479046] z_zvol S ffff88be5ef9dee0 0 22473 2 0x00000000 2018-04-08 13:24:30 [44953.486547] Call Trace: 2018-04-08 13:24:30 [44953.489404] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.494777] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.501182] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.507160] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.514083] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.519363] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.525852] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.531646] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.538138] z_upgrade S ffff88be5ef9eeb0 0 22474 2 0x00000000 2018-04-08 13:24:30 [44953.545632] Call Trace: 2018-04-08 13:24:30 [44953.548488] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.553863] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.560269] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.566245] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.573169] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.578448] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.584937] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.590729] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.597215] metaslab_group_ S ffff88be60950000 0 22475 2 0x00000000 2018-04-08 13:24:30 [44953.604715] Call Trace: 2018-04-08 13:24:30 [44953.607572] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.612945] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.619355] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.625329] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.632255] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.637531] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.644022] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.649824] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.656316] dp_sync_taskq S ffff88be60954f10 0 22480 2 0x00000000 2018-04-08 13:24:30 [44953.663809] Call Trace: 2018-04-08 13:24:30 [44953.666664] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.672031] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.678436] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.684416] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.691346] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.696624] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.703117] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.708916] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.715408] dp_sync_taskq S ffff88be60955ee0 0 22481 2 0x00000000 2018-04-08 13:24:30 [44953.722900] Call Trace: 2018-04-08 13:24:30 [44953.725758] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.731121] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.737525] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.743501] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:30 [44953.750425] [] kthread+0xcf/0xe0 2018-04-08 13:24:30 [44953.755706] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.762197] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:30 [44953.767988] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:30 [44953.774470] dp_sync_taskq S ffff88be60956eb0 0 22482 2 0x00000000 2018-04-08 13:24:30 [44953.781956] Call Trace: 2018-04-08 13:24:30 [44953.784813] [] schedule+0x29/0x70 2018-04-08 13:24:30 [44953.790175] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:30 [44953.796572] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:30 [44953.802540] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44953.809470] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44953.814748] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.821238] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44953.827027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.833512] dp_sync_taskq S ffff88be60950fd0 0 22483 2 0x00000000 2018-04-08 13:24:31 [44953.841004] Call Trace: 2018-04-08 13:24:31 [44953.843862] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44953.849228] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44953.855632] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44953.861610] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44953.868533] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44953.873814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.880294] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44953.886083] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.892568] dp_sync_taskq S ffff88be1e3c5ee0 0 22484 2 0x00000000 2018-04-08 13:24:31 [44953.900064] Call Trace: 2018-04-08 13:24:31 [44953.902919] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44953.908287] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44953.914692] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44953.920667] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44953.927594] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44953.932872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.939354] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44953.945145] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.951626] dp_sync_taskq S ffff88be1e3c6eb0 0 22485 2 0x00000000 2018-04-08 13:24:31 [44953.959120] Call Trace: 2018-04-08 13:24:31 [44953.961970] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44953.967337] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44953.973739] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44953.979706] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44953.986633] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44953.991913] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44953.998395] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.004183] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.010670] dp_sync_taskq S ffff88bddae16eb0 0 22486 2 0x00000000 2018-04-08 13:24:31 [44954.018153] Call Trace: 2018-04-08 13:24:31 [44954.021003] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.026368] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.032771] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.038744] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.045664] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.050948] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.057436] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.063229] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.069711] dp_sync_taskq S ffff88bddae11fa0 0 22487 2 0x00000000 2018-04-08 13:24:31 [44954.077201] Call Trace: 2018-04-08 13:24:31 [44954.080052] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.085416] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.091813] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.097781] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.104707] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.109986] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.116470] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.122259] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.128743] dp_sync_taskq S ffff88bddae14f10 0 22488 2 0x00000000 2018-04-08 13:24:31 [44954.136225] Call Trace: 2018-04-08 13:24:31 [44954.139075] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.144440] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.150847] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.156822] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.163747] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.169028] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.175520] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.181313] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.187800] dp_sync_taskq S ffff88bddae13f40 0 22489 2 0x00000000 2018-04-08 13:24:31 [44954.195293] Call Trace: 2018-04-08 13:24:31 [44954.198151] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.203516] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.209923] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.215898] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.222822] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.228106] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.234595] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.240384] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.246870] dp_sync_taskq S ffff88bddae10fd0 0 22490 2 0x00000000 2018-04-08 13:24:31 [44954.254352] Call Trace: 2018-04-08 13:24:31 [44954.257210] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.262575] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.268979] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.274949] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.281872] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.287153] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.293645] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.299435] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.305918] dp_sync_taskq S ffff88bddae10000 0 22491 2 0x00000000 2018-04-08 13:24:31 [44954.313411] Call Trace: 2018-04-08 13:24:31 [44954.316267] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.321635] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.328039] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.334015] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.340941] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.346221] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.352710] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.358500] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.364982] z_iput S ffff88bddae15ee0 0 22492 2 0x00000000 2018-04-08 13:24:31 [44954.372473] Call Trace: 2018-04-08 13:24:31 [44954.375324] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.380691] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:31 [44954.387098] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:31 [44954.393072] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:31 [44954.399998] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.405276] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.411759] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.417549] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.424033] txg_quiesce S ffff88be5a116eb0 0 22583 2 0x00000000 2018-04-08 13:24:31 [44954.431525] Call Trace: 2018-04-08 13:24:31 [44954.434374] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.439742] [] cv_wait_common+0x125/0x150 [spl] 2018-04-08 13:24:31 [44954.446317] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:31 [44954.452546] [] __cv_wait_sig+0x15/0x20 [spl] 2018-04-08 13:24:31 [44954.458880] [] txg_quiesce_thread+0x403/0x410 [zfs] 2018-04-08 13:24:31 [44954.465822] [] ? txg_init+0x2b0/0x2b0 [zfs] 2018-04-08 13:24:31 [44954.472050] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:31 [44954.479147] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:31 [44954.485636] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.490908] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.497392] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.503184] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.509669] txg_sync S ffff88be5b030000 0 22584 2 0x00000000 2018-04-08 13:24:31 [44954.517154] Call Trace: 2018-04-08 13:24:31 [44954.520009] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.525372] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:31 [44954.531613] [] ? spa_config_exit+0x82/0xc0 [zfs] 2018-04-08 13:24:31 [44954.538268] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:31 [44954.544666] [] ? prepare_to_wait_exclusive+0x56/0x90 2018-04-08 13:24:31 [44954.551675] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:31 [44954.558769] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:31 [44954.564995] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:31 [44954.571756] [] txg_sync_thread+0x19d/0x510 [zfs] 2018-04-08 13:24:31 [44954.578427] [] ? txg_fini+0x2a0/0x2a0 [zfs] 2018-04-08 13:24:31 [44954.584655] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:31 [44954.591748] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:31 [44954.598234] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.603505] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.609989] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.615781] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.622258] mmp S ffff88be5b030fd0 0 22585 2 0x00000000 2018-04-08 13:24:31 [44954.629748] Call Trace: 2018-04-08 13:24:31 [44954.632595] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.637952] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:31 [44954.644177] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:31 [44954.650578] [] __cv_timedwait_common+0xc5/0x170 [spl] 2018-04-08 13:24:31 [44954.657663] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:31 [44954.663886] [] __cv_timedwait_sig+0x13/0x20 [spl] 2018-04-08 13:24:31 [44954.670647] [] mmp_thread+0x45f/0x760 [zfs] 2018-04-08 13:24:31 [44954.676884] [] ? mmp_random_leaf+0xb0/0xb0 [zfs] 2018-04-08 13:24:31 [44954.683553] [] ? mmp_write_done+0x170/0x170 [zfs] 2018-04-08 13:24:31 [44954.690290] [] thread_generic_wrapper+0x71/0x80 [spl] 2018-04-08 13:24:31 [44954.697382] [] ? __thread_exit+0x20/0x20 [spl] 2018-04-08 13:24:31 [44954.703863] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.709124] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.715607] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.721390] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.727863] cfs_rh_00 S ffff88beb2bccf10 0 23033 2 0x00000000 2018-04-08 13:24:31 [44954.735338] Call Trace: 2018-04-08 13:24:31 [44954.738180] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.743545] [] cfs_wi_scheduler+0x304/0x450 [libcfs] 2018-04-08 13:24:31 [44954.750543] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:31 [44954.756771] [] ? cfs_wi_sched_create+0x680/0x680 [libcfs] 2018-04-08 13:24:31 [44954.764202] [] kthread+0xcf/0xe0 2018-04-08 13:24:31 [44954.769475] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.775963] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:31 [44954.781750] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:31 [44954.788228] cfs_rh_01 S ffff88beb2bc9fa0 0 23034 2 0x00000000 2018-04-08 13:24:31 [44954.795721] Call Trace: 2018-04-08 13:24:31 [44954.798570] [] schedule+0x29/0x70 2018-04-08 13:24:31 [44954.803934] [] cfs_wi_scheduler+0x304/0x450 [libcfs] 2018-04-08 13:24:32 [44954.810934] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:32 [44954.817162] [] ? cfs_wi_sched_create+0x680/0x680 [libcfs] 2018-04-08 13:24:32 [44954.824599] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44954.829871] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44954.836361] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44954.842158] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44954.848639] cfs_rh_02 S ffff88beb2bc8000 0 23035 2 0x00000000 2018-04-08 13:24:32 [44954.856131] Call Trace: 2018-04-08 13:24:32 [44954.858989] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44954.864354] [] cfs_wi_scheduler+0x304/0x450 [libcfs] 2018-04-08 13:24:32 [44954.871369] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:32 [44954.877603] [] ? cfs_wi_sched_create+0x680/0x680 [libcfs] 2018-04-08 13:24:32 [44954.885048] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44954.890328] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44954.896820] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44954.902622] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44954.909115] cfs_rh_03 S ffff88beb2bcbf40 0 23036 2 0x00000000 2018-04-08 13:24:32 [44954.916614] Call Trace: 2018-04-08 13:24:32 [44954.919469] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44954.924843] [] cfs_wi_scheduler+0x304/0x450 [libcfs] 2018-04-08 13:24:32 [44954.931858] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:32 [44954.938104] [] ? cfs_wi_sched_create+0x680/0x680 [libcfs] 2018-04-08 13:24:32 [44954.945556] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44954.950844] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44954.957345] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44954.963155] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44954.969657] obd_zombid S ffff88beb2bcdee0 0 23042 2 0x00000000 2018-04-08 13:24:32 [44954.977166] Call Trace: 2018-04-08 13:24:32 [44954.980032] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44954.985456] [] obd_zombie_impexp_thread+0xd5/0x1c0 [obdclass] 2018-04-08 13:24:32 [44954.993263] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44954.999275] [] ? obd_zombie_impexp_cull+0x540/0x540 [obdclass] 2018-04-08 13:24:32 [44955.007171] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.012478] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.018997] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.024819] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.031330] clio S ffff88beb2bc8fd0 0 23045 2 0x00000000 2018-04-08 13:24:32 [44955.038848] Call Trace: 2018-04-08 13:24:32 [44955.041728] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.047117] [] rescuer_thread+0x31e/0x3c0 2018-04-08 13:24:32 [44955.053193] [] ? process_one_work+0x440/0x440 2018-04-08 13:24:32 [44955.059617] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.064912] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.071415] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.077233] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.083731] ptlrpc_hr00_000 S ffff88be1e3c0000 0 23048 2 0x00000000 2018-04-08 13:24:32 [44955.091231] Call Trace: 2018-04-08 13:24:32 [44955.094103] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.100440] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.105891] [] pt+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.112743] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.118769] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.125970] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.131270] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.137777] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.143583] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.150084] ptlrpc_hr00_001 S ffff88be1e3c0fd0 0 23049 2 0x00000000 2018-04-08 13:24:32 [44955.157592] Call Trace: 2018-04-08 13:24:32 [44955.160459] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.166793] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.172185] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.179037] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.185042] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.192240] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.197533] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.204033] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.209843] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.216344] ptlrpc_hr00_002 S ffff88be61743f40 0 23050 2 0x00000000 2018-04-08 13:24:32 [44955.223851] Call Trace: 2018-04-08 13:24:32 [44955.226716] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.233041] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.238436] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.245286] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.251284] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.258477] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.263764] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.270267] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.276076] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.282573] ptlrpc_hr00_003 S ffff88be61745ee0 0 23051 2 0x00000000 2018-04-08 13:24:32 [44955.290073] Call Trace: 2018-04-08 13:24:32 [44955.292936] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.299262] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.304654] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.311497] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.317492] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.324681] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.329971] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.336475] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.342281] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.348779] ptlrpc_hr00_004 S ffff88be61746eb0 0 23052 2 0x00000000 2018-04-08 13:24:32 [44955.356286] Call Trace: 2018-04-08 13:24:32 [44955.359150] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.365488] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.370885] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.377734] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.383731] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.390930] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.396218] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.402719] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.408525] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.415027] ptlrpc_hr00_005 S ffff88be61741fa0 0 23053 2 0x00000000 2018-04-08 13:24:32 [44955.422538] Call Trace: 2018-04-08 13:24:32 [44955.425404] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.431740] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.437135] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.443986] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.449981] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.457180] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.462469] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.468970] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.474779] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.481280] ptlrpc_hr00_006 S ffff88be61744f10 0 23054 2 0x00000000 2018-04-08 13:24:32 [44955.488787] Call Trace: 2018-04-08 13:24:32 [44955.491655] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.497993] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.503388] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.510238] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.516234] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.523431] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.528720] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.535223] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.541030] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.547530] ptlrpc_hr00_007 S ffff88be61740fd0 0 23055 2 0x00000000 2018-04-08 13:24:32 [44955.555039] Call Trace: 2018-04-08 13:24:32 [44955.557907] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.564243] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.569641] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.576489] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.582484] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.589683] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.594972] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.601475] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.607283] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.613780] ptlrpc_hr01_000 S ffff88606cc1eeb0 0 23056 2 0x00000000 2018-04-08 13:24:32 [44955.621282] Call Trace: 2018-04-08 13:24:32 [44955.624150] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.630487] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.635881] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.642736] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.648735] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.655936] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.661223] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.667730] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.673543] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.680044] ptlrpc_hr01_001 S ffff88be5e3e9fa0 0 23057 2 0x00000000 2018-04-08 13:24:32 [44955.687554] Call Trace: 2018-04-08 13:24:32 [44955.690426] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.696763] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.702161] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.709009] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.715005] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.722204] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.727493] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.733992] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.739801] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.746301] ptlrpc_hr01_002 S ffff88be5e3ebf40 0 23058 2 0x00000000 2018-04-08 13:24:32 [44955.753810] Call Trace: 2018-04-08 13:24:32 [44955.756677] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:32 [44955.763015] [] schedule+0x29/0x70 2018-04-08 13:24:32 [44955.768410] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:32 [44955.775260] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:32 [44955.781257] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:32 [44955.788454] [] kthread+0xcf/0xe0 2018-04-08 13:24:32 [44955.793741] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:32 [44955.800244] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:32 [44955.806053] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44955.812552] ptlrpc_hr01_003 S ffff88be5e3eeeb0 0 23059 2 0x00000000 2018-04-08 13:24:33 [44955.820053] Call Trace: 2018-04-08 13:24:33 [44955.822923] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:33 [44955.829259] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44955.834653] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:33 [44955.841504] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44955.847498] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:33 [44955.854689] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44955.859978] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44955.866481] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44955.872286] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44955.878787] ptlrpc_hr01_004 S ffff88be5e3ecf10 0 23060 2 0x00000000 2018-04-08 13:24:33 [44955.886287] Call Trace: 2018-04-08 13:24:33 [44955.889155] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:33 [44955.895491] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44955.900886] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:33 [44955.907736] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44955.913734] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:33 [44955.920931] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44955.926219] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44955.932722] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44955.938530] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44955.945034] ptlrpc_hr01_005 S ffff88be5e3eaf70 0 23061 2 0x00000000 2018-04-08 13:24:33 [44955.952541] Call Trace: 2018-04-08 13:24:33 [44955.955406] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:33 [44955.961743] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44955.967136] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:33 [44955.973988] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44955.979986] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:33 [44955.987183] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44955.992472] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44955.998972] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.004781] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.011281] ptlrpc_hr01_006 S ffff88be5e3edee0 0 23062 2 0x00000000 2018-04-08 13:24:33 [44956.018790] Call Trace: 2018-04-08 13:24:33 [44956.021657] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:33 [44956.027995] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.033390] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:33 [44956.040241] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.046237] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:33 [44956.053436] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.058724] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.065227] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.071034] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.077537] ptlrpc_hr01_007 S ffff88be5e3e8000 0 23063 2 0x00000000 2018-04-08 13:24:33 [44956.085042] Call Trace: 2018-04-08 13:24:33 [44956.087911] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:33 [44956.094245] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.099641] [] ptlrpc_hr_main+0x135/0x2c0 [ptlrpc] 2018-04-08 13:24:33 [44956.106492] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.112486] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] 2018-04-08 13:24:33 [44956.119688] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.124981] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.131486] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.137294] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.143794] kiblnd_connd S ffff88be5e3e8fd0 0 23073 2 0x00000000 2018-04-08 13:24:33 [44956.151305] Call Trace: 2018-04-08 13:24:33 [44956.154171] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.159551] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:33 [44956.165789] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:33 [44956.172208] [] kiblnd_connd+0x60c/0x900 [ko2iblnd] 2018-04-08 13:24:33 [44956.179047] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.185029] [] ? kiblnd_check_conns+0x860/0x860 [ko2iblnd] 2018-04-08 13:24:33 [44956.192565] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.197854] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.204355] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.210162] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.216657] kiblnd_sd_00_00 S ffff88be5a9e4f10 0 23074 2 0x00000000 2018-04-08 13:24:33 [44956.224157] Call Trace: 2018-04-08 13:24:33 [44956.227022] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.232395] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.239677] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.245829] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.251724] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.257707] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.264805] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.270094] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.276587] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.282386] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.288881] kiblnd_sd_00_01 S ffff88be5a9e0000 0 23075 2 0x00000000 2018-04-08 13:24:33 [44956.296381] Call Trace: 2018-04-08 13:24:33 [44956.299245] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.304617] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.311889] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.318035] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.323921] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.329896] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.336992] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.342271] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.348769] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.354566] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.361060] kiblnd_sd_00_02 S ffff88be5a9e2f70 0 23076 2 0x00000000 2018-04-08 13:24:33 [44956.368555] Call Trace: 2018-04-08 13:24:33 [44956.371411] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.376775] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.384050] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.390197] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.396083] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.402056] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.409155] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.414436] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.420930] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.426730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.433219] kiblnd_sd_00_03 S ffff88be5a9e1fa0 0 23077 2 0x00000000 2018-04-08 13:24:33 [44956.440700] Call Trace: 2018-04-08 13:24:33 [44956.443552] [] ? kiblnd_handle_rx+0x213/0x6b0 [ko2iblnd] 2018-04-08 13:24:33 [44956.450910] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.456279] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.463554] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.469709] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.475602] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.481574] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.488673] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.493955] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.500448] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.506245] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.512734] kiblnd_sd_01_00 S ffff88be5a9e6eb0 0 23078 2 0x00000000 2018-04-08 13:24:33 [44956.520227] Call Trace: 2018-04-08 13:24:33 [44956.523083] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.528449] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.535723] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.541871] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.547758] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.553730] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.560829] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.566110] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.572604] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.578405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.584893] kiblnd_sd_01_01 S ffff88be5a9e3f40 0 23079 2 0x00000000 2018-04-08 13:24:33 [44956.592392] Call Trace: 2018-04-08 13:24:33 [44956.595249] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.600624] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.607899] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.614055] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.619952] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.625932] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.633031] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.638320] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.644813] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.650610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.657100] kiblnd_sd_01_02 S ffff88be5a9e5ee0 0 23080 2 0x00000000 2018-04-08 13:24:33 [44956.664584] Call Trace: 2018-04-08 13:24:33 [44956.667440] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.672813] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.680088] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.686237] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.692131] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.698105] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.705205] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.710494] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.716987] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.722782] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.729273] kiblnd_sd_01_03 S ffff88be5a9e0fd0 0 23081 2 0x00000000 2018-04-08 13:24:33 [44956.736761] Call Trace: 2018-04-08 13:24:33 [44956.739617] [] schedule+0x29/0x70 2018-04-08 13:24:33 [44956.744982] [] kiblnd_scheduler+0x32c/0x1150 [ko2iblnd] 2018-04-08 13:24:33 [44956.752248] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:33 [44956.758394] [] ? __switch_to+0xcd/0x500 2018-04-08 13:24:33 [44956.764283] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:33 [44956.770256] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] 2018-04-08 13:24:33 [44956.777355] [] kthread+0xcf/0xe0 2018-04-08 13:24:33 [44956.782636] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.789129] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:33 [44956.794928] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:33 [44956.801413] ib_fmr(hfi1_0) S ffff88beb5434f10 0 23082 2 0x00000000 2018-04-08 13:24:34 [44956.808908] Call Trace: 2018-04-08 13:24:34 [44956.811757] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:34 [44956.817639] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44956.823015] [] ib_fmr_cleanup_thread+0x7b/0xd0 [ib_core] 2018-04-08 13:24:34 [44956.830376] [] ? ib_fmr_batch_release+0x180/0x180 [ib_core] 2018-04-08 13:24:34 [44956.837998] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44956.843280] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44956.849771] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44956.855572] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44956.862066] ib_fmr(hfi1_0) S ffff88beb5436eb0 0 23083 2 0x00000000 2018-04-08 13:24:34 [44956.869566] Call Trace: 2018-04-08 13:24:34 [44956.872419] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:34 [44956.878303] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44956.883674] [] ib_fmr_cleanup_thread+0x7b/0xd0 [ib_core] 2018-04-08 13:24:34 [44956.891034] [] ? ib_fmr_batch_release+0x180/0x180 [ib_core] 2018-04-08 13:24:34 [44956.898655] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44956.903938] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44956.910432] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44956.916230] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44956.922722] router_checker S ffff88beb5431fa0 0 23084 2 0x00000000 2018-04-08 13:24:34 [44956.930225] Call Trace: 2018-04-08 13:24:34 [44956.933101] [] ? lnet_notify_locked+0x250/0x250 [lnet] 2018-04-08 13:24:34 [44956.940295] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44956.945676] [] lnet_router_checker+0x6a2/0x890 [lnet] 2018-04-08 13:24:34 [44956.952784] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:34 [44956.958679] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:34 [44956.964924] [] ? lnet_notify_locked+0x250/0x250 [lnet] 2018-04-08 13:24:34 [44956.972113] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44956.977405] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44956.983909] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44956.989718] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44956.996215] ptlrpcd_rcv S ffff88beb5435ee0 0 23085 2 0x00000000 2018-04-08 13:24:34 [44957.003717] Call Trace: 2018-04-08 13:24:34 [44957.006600] [] ? ptlrpc_check_set.part.23+0x115d/0x1d90 [ptlrpc] 2018-04-08 13:24:34 [44957.014680] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.020061] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:34 [44957.026311] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:34 [44957.032745] [] ptlrpcd+0x288/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.038992] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.044990] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.051925] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.057216] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.063719] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.069526] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.076029] ptlrpcd_00_00 S ffff88beb5430000 0 23086 2 0x00000000 2018-04-08 13:24:34 [44957.083536] Call Trace: 2018-04-08 13:24:34 [44957.086402] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.091798] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.098040] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.104037] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.110977] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.116264] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.122765] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.128573] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.135076] ptlrpcd_00_01 S ffff88beb5433f40 0 23087 2 0x00000000 2018-04-08 13:24:34 [44957.142584] Call Trace: 2018-04-08 13:24:34 [44957.145450] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.150846] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.157087] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.163084] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.170020] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.175308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.181804] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.187610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.194103] ptlrpcd_00_02 S ffff88beb5432f70 0 23088 2 0x00000000 2018-04-08 13:24:34 [44957.201602] Call Trace: 2018-04-08 13:24:34 [44957.204461] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.209848] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.216079] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.222068] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.228994] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.234274] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.240766] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.246558] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.253042] ptlrpcd_00_03 S ffff88beb5430fd0 0 23089 2 0x00000000 2018-04-08 13:24:34 [44957.260532] Call Trace: 2018-04-08 13:24:34 [44957.263389] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.268769] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.275007] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.280993] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.287909] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.293177] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.299660] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.305442] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.311922] ptlrpcd_00_04 S ffff88beb460dee0 0 23090 2 0x00000000 2018-04-08 13:24:34 [44957.319402] Call Trace: 2018-04-08 13:24:34 [44957.322252] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.327633] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.333863] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.339849] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.346770] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.352050] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.358531] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.364322] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.370804] ptlrpcd_00_05 S ffff88beb4609fa0 0 23091 2 0x00000000 2018-04-08 13:24:34 [44957.378288] Call Trace: 2018-04-08 13:24:34 [44957.381137] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.386516] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.392745] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.398728] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.405645] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.410916] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.417400] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.423188] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.429663] ptlrpcd_00_06 S ffff88beb4608fd0 0 23092 2 0x00000000 2018-04-08 13:24:34 [44957.437140] Call Trace: 2018-04-08 13:24:34 [44957.439988] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.445369] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.451596] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.457577] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.464495] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.469768] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.476248] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.482038] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.488515] ptlrpcd_00_07 S ffff88beb460eeb0 0 23093 2 0x00000000 2018-04-08 13:24:34 [44957.495998] Call Trace: 2018-04-08 13:24:34 [44957.498848] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.504227] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.510453] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.516436] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.523362] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.528637] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.535116] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.540908] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.547393] ptlrpcd_01_00 S ffff88beb460bf40 0 23094 2 0x00000000 2018-04-08 13:24:34 [44957.554884] Call Trace: 2018-04-08 13:24:34 [44957.557734] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.563114] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.569338] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.575320] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.582241] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.587514] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.593996] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.599785] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.606271] ptlrpcd_01_01 S ffff88beb460af70 0 23095 2 0x00000000 2018-04-08 13:24:34 [44957.613759] Call Trace: 2018-04-08 13:24:34 [44957.616609] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.621990] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.628217] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.634201] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.641119] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.646390] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.652874] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.658662] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.665148] ptlrpcd_01_02 S ffff88beb4608000 0 23096 2 0x00000000 2018-04-08 13:24:34 [44957.672637] Call Trace: 2018-04-08 13:24:34 [44957.675489] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.680865] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.687094] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.693075] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.699995] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.705268] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.711750] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.717539] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.724024] ptlrpcd_01_03 S ffff885ebbc28fd0 0 23097 2 0x00000000 2018-04-08 13:24:34 [44957.731515] Call Trace: 2018-04-08 13:24:34 [44957.734364] [] schedule+0x29/0x70 2018-04-08 13:24:34 [44957.739743] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:34 [44957.745970] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:34 [44957.751953] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:34 [44957.758870] [] kthread+0xcf/0xe0 2018-04-08 13:24:34 [44957.764145] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.770629] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:34 [44957.776414] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:34 [44957.782890] ptlrpcd_01_04 S ffff885ebbfb1fa0 0 23098 2 0x00000000 2018-04-08 13:24:35 [44957.790373] Call Trace: 2018-04-08 13:24:35 [44957.793222] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44957.798602] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:35 [44957.804830] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44957.810811] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:35 [44957.817732] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44957.823010] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44957.829494] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44957.835283] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44957.841769] ptlrpcd_01_05 S ffff885ebbfb0000 0 23099 2 0x00000000 2018-04-08 13:24:35 [44957.849260] Call Trace: 2018-04-08 13:24:35 [44957.852109] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44957.857491] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:35 [44957.863716] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44957.869699] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:35 [44957.876617] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44957.881888] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44957.888371] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44957.894161] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44957.900645] ptlrpcd_01_06 S ffff885ebbfb5ee0 0 23100 2 0x00000000 2018-04-08 13:24:35 [44957.908136] Call Trace: 2018-04-08 13:24:35 [44957.910988] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44957.916366] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:35 [44957.922593] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44957.928574] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:35 [44957.935493] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44957.940765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44957.947248] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44957.953037] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44957.959520] ptlrpcd_01_07 S ffff885ebbfb3f40 0 23101 2 0x00000000 2018-04-08 13:24:35 [44957.967004] Call Trace: 2018-04-08 13:24:35 [44957.969855] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44957.975234] [] ptlrpcd+0x2fe/0x550 [ptlrpc] 2018-04-08 13:24:35 [44957.981462] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44957.987443] [] ? ptlrpcd_check+0x5e0/0x5e0 [ptlrpc] 2018-04-08 13:24:35 [44957.994362] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44957.999633] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.006118] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.011905] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.018390] ll_ping S ffff885ebbfb6eb0 0 23102 2 0x00000000 2018-04-08 13:24:35 [44958.025881] Call Trace: 2018-04-08 13:24:35 [44958.028729] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.034093] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:35 [44958.040319] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:35 [44958.046719] [] ? cfs_block_sigsinv+0x71/0xa0 [libcfs] 2018-04-08 13:24:35 [44958.053828] [] ptlrpc_pinger_main+0x8cf/0xbb0 [ptlrpc] 2018-04-08 13:24:35 [44958.061013] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.066997] [] ? ptlrpc_obd_ping+0x130/0x130 [ptlrpc] 2018-04-08 13:24:35 [44958.074088] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.079360] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.085847] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.091639] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.098124] sptlrpc_gc S ffff885ebbfb2f70 0 23103 2 0x00000000 2018-04-08 13:24:35 [44958.105613] Call Trace: 2018-04-08 13:24:35 [44958.108462] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.113825] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:35 [44958.120050] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:35 [44958.126447] [] ? cfs_block_sigsinv+0x71/0xa0 [libcfs] 2018-04-08 13:24:35 [44958.133555] [] sec_gc_main+0x2e8/0x420 [ptlrpc] 2018-04-08 13:24:35 [44958.140126] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.146106] [] ? sptlrpc_gc_add_ctx+0x130/0x130 [ptlrpc] 2018-04-08 13:24:35 [44958.153463] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.158741] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.165224] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.171021] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.177509] ldlm_cb00_000 S ffff885eb021eeb0 0 23109 2 0x00000000 2018-04-08 13:24:35 [44958.185000] Call Trace: 2018-04-08 13:24:35 [44958.187854] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.194170] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.199547] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.206640] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.212631] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.219300] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:35 [44958.225202] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.232998] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.238277] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.244772] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.250567] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.257061] lc_watchdogd S ffff885eb0219fa0 0 23110 2 0x00000000 2018-04-08 13:24:35 [44958.264552] Call Trace: 2018-04-08 13:24:35 [44958.267411] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.272786] [] lcw_dispatch_main+0x749/0x940 [libcfs] 2018-04-08 13:24:35 [44958.279893] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:35 [44958.286135] [] ? lc_watchdog_add+0x790/0x790 [libcfs] 2018-04-08 13:24:35 [44958.293245] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.298530] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.305024] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.310822] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.317312] ldlm_cb00_001 S ffff885eb021dee0 0 23111 2 0x00000000 2018-04-08 13:24:35 [44958.324812] Call Trace: 2018-04-08 13:24:35 [44958.327670] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.334002] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.339391] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.346496] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.352490] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.359187] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.366984] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.372277] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.378777] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.384584] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.391083] ldlm_cb01_000 S ffff885eb9733f40 0 23112 2 0x00000000 2018-04-08 13:24:35 [44958.398582] Call Trace: 2018-04-08 13:24:35 [44958.401447] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.407780] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.413178] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.420290] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.426299] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.432997] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.440810] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.446104] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.452607] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.458424] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.464928] ldlm_cb01_001 S ffff885eb9735ee0 0 23113 2 0x00000000 2018-04-08 13:24:35 [44958.472440] Call Trace: 2018-04-08 13:24:35 [44958.475313] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.481647] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.487041] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.494154] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.500154] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.506852] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.514664] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.519956] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.526463] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.532274] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.538777] ldlm_cn00_000 S ffff885eb9734f10 0 23114 2 0x00000000 2018-04-08 13:24:35 [44958.546293] Call Trace: 2018-04-08 13:24:35 [44958.549165] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.555498] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.560899] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.568012] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.574018] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.580718] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.588532] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.593828] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.600341] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.606156] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.612664] ldlm_cn00_001 S ffff885eb9732f70 0 23115 2 0x00000000 2018-04-08 13:24:35 [44958.620179] Call Trace: 2018-04-08 13:24:35 [44958.623051] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.629391] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.634788] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.641909] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.647911] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.654616] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.662423] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.667721] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.674233] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.680051] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.686559] ldlm_cn00_002 S ffff885ec0e35ee0 0 23116 2 0x00000000 2018-04-08 13:24:35 [44958.694062] Call Trace: 2018-04-08 13:24:35 [44958.696938] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.703275] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.708673] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:35 [44958.715793] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:35 [44958.721799] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:35 [44958.728499] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:35 [44958.736310] [] kthread+0xcf/0xe0 2018-04-08 13:24:35 [44958.741610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.748121] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:35 [44958.753936] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:35 [44958.760441] ldlm_cn01_000 S ffff885ebd228fd0 0 23117 2 0x00000000 2018-04-08 13:24:35 [44958.767948] Call Trace: 2018-04-08 13:24:35 [44958.770823] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:35 [44958.777158] [] schedule+0x29/0x70 2018-04-08 13:24:35 [44958.782559] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:36 [44958.789679] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44958.795683] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:36 [44958.802386] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:36 [44958.810196] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44958.815491] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44958.822005] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44958.827822] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44958.834327] ldlm_cn01_001 S ffff885ebd229fa0 0 23118 2 0x00000000 2018-04-08 13:24:36 [44958.841826] Call Trace: 2018-04-08 13:24:36 [44958.844700] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44958.850099] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:36 [44958.857220] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44958.863223] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:36 [44958.869925] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:36 [44958.877736] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44958.883031] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44958.889541] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44958.895361] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44958.901870] ldlm_cn01_002 S ffff885ebd22eeb0 0 23119 2 0x00000000 2018-04-08 13:24:36 [44958.909386] Call Trace: 2018-04-08 13:24:36 [44958.912261] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44958.918599] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44958.924001] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:36 [44958.931120] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44958.937126] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:36 [44958.943829] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:36 [44958.951640] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44958.956933] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44958.963448] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44958.969262] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44958.975776] ldlm_bl_01 S ffff885ebd22cf10 0 23120 2 0x00000000 2018-04-08 13:24:36 [44958.983287] Call Trace: 2018-04-08 13:24:36 [44958.986173] [] ? obd_stale_export_get+0x31/0x190 [obdclass] 2018-04-08 13:24:36 [44958.993812] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44958.999213] [] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc] 2018-04-08 13:24:36 [44959.006509] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.012520] [] ? ldlm_handle_bl_callback+0x410/0x410 [ptlrpc] 2018-04-08 13:24:36 [44959.020334] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.025640] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.032157] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.037985] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.044505] ldlm_bl_02 S ffff885e9cc9cf10 0 23121 2 0x00000000 2018-04-08 13:24:36 [44959.052021] Call Trace: 2018-04-08 13:24:36 [44959.054911] [] ? obd_stale_export_get+0x31/0x190 [obdclass] 2018-04-08 13:24:36 [44959.062554] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.067958] [] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc] 2018-04-08 13:24:36 [44959.075255] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.081266] [] ? ldlm_handle_bl_callback+0x410/0x410 [ptlrpc] 2018-04-08 13:24:36 [44959.089092] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.094406] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.100933] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.106765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.113284] ldlm_elt S ffff885e9cc98000 0 23122 2 0x00000000 2018-04-08 13:24:36 [44959.120813] Call Trace: 2018-04-08 13:24:36 [44959.123718] [] ? ldlm_bl_to_thread+0x4e0/0x510 [ptlrpc] 2018-04-08 13:24:36 [44959.131025] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.136438] [] expired_lock_main+0x1c2/0x910 [ptlrpc] 2018-04-08 13:24:36 [44959.143569] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.149591] [] ? ldlm_bl_to_thread+0x510/0x510 [ptlrpc] 2018-04-08 13:24:36 [44959.156901] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.162218] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.168744] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.174574] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.181100] ldlm_poold S ffff885e9cc9eeb0 0 23123 2 0x00000000 2018-04-08 13:24:36 [44959.188622] Call Trace: 2018-04-08 13:24:36 [44959.191513] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.196907] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:36 [44959.203166] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:36 [44959.209600] [] ? cfs_block_sigsinv+0x71/0xa0 [libcfs] 2018-04-08 13:24:36 [44959.216747] [] ldlm_pools_thread_main+0x23e/0x330 [ptlrpc] 2018-04-08 13:24:36 [44959.224307] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.230328] [] ? ldlm_pools_recalc+0x3d0/0x3d0 [ptlrpc] 2018-04-08 13:24:36 [44959.237632] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.242945] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.249464] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.255289] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.261807] mgs_params_noti S ffff885eb5abbf40 0 23128 2 0x00000000 2018-04-08 13:24:36 [44959.269333] Call Trace: 2018-04-08 13:24:36 [44959.272225] [] ? mgc_name2resid+0x151/0x220 [mgc] 2018-04-08 13:24:36 [44959.279007] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.285362] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.290765] [] mgs_ir_notify+0x1c0/0x2b0 [mgs] 2018-04-08 13:24:36 [44959.297285] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.303285] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] 2018-04-08 13:24:36 [44959.310581] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.315882] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.322395] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.328211] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.334724] ll_mgs_0000 S ffff88be6537dee0 0 23132 2 0x00000000 2018-04-08 13:24:36 [44959.342238] Call Trace: 2018-04-08 13:24:36 [44959.345109] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.351443] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.356843] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:36 [44959.363951] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.369959] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:36 [44959.376647] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:36 [44959.384447] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.389738] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.396241] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.402048] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.408550] ll_mgs_0001 S ffff88be65378fd0 0 23133 2 0x00000000 2018-04-08 13:24:36 [44959.416054] Call Trace: 2018-04-08 13:24:36 [44959.418918] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.425244] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.430633] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:36 [44959.437736] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.443732] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:36 [44959.450419] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:36 [44959.458221] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.463507] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.470015] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.475825] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.482325] ll_mgs_0002 S ffff88be6537bf40 0 23134 2 0x00000000 2018-04-08 13:24:36 [44959.489817] Call Trace: 2018-04-08 13:24:36 [44959.492684] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.499021] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.504421] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:36 [44959.511529] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.517530] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:36 [44959.524218] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:36 [44959.532022] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.537321] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.543831] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.549649] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.556154] ll_evictor S ffff88be6537cf10 0 23135 2 0x00000000 2018-04-08 13:24:36 [44959.563662] Call Trace: 2018-04-08 13:24:36 [44959.566528] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:36 [44959.573572] [] ? ptlrpc_del_timeout_client+0x190/0x190 [ptlrpc] 2018-04-08 13:24:36 [44959.581559] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.586958] [] ping_evictor_main+0x47e/0x6c0 [ptlrpc] 2018-04-08 13:24:36 [44959.594080] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:36 [44959.599990] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.605992] [] ? ptlrpc_del_timeout_client+0x190/0x190 [ptlrpc] 2018-04-08 13:24:36 [44959.613975] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.619279] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.625790] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.631605] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.638115] ll_cfg_requeue S ffff88be65379fa0 0 23136 2 0x00000000 2018-04-08 13:24:36 [44959.645630] Call Trace: 2018-04-08 13:24:36 [44959.648505] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.654849] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.660234] [] mgc_requeue_thread+0x5f5/0x870 [mgc] 2018-04-08 13:24:36 [44959.667177] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.673168] [] ? mgc_process_config+0x13f0/0x13f0 [mgc] 2018-04-08 13:24:36 [44959.680458] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.685763] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.692276] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.698100] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.704610] mgs_home_notify S ffff88be6537af70 0 23142 2 0x00000000 2018-04-08 13:24:36 [44959.712122] Call Trace: 2018-04-08 13:24:36 [44959.714996] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.721335] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.726728] [] mgs_ir_notify+0x1c0/0x2b0 [mgs] 2018-04-08 13:24:36 [44959.733236] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.739229] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] 2018-04-08 13:24:36 [44959.746515] [] kthread+0xcf/0xe0 2018-04-08 13:24:36 [44959.751809] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.758315] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:36 [44959.764129] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:36 [44959.770634] mgs_dagg_notify S ffff88beb3f91fa0 0 23156 2 0x00000000 2018-04-08 13:24:36 [44959.778148] Call Trace: 2018-04-08 13:24:36 [44959.781020] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:36 [44959.787355] [] schedule+0x29/0x70 2018-04-08 13:24:36 [44959.792743] [] mgs_ir_notify+0x1c0/0x2b0 [mgs] 2018-04-08 13:24:36 [44959.799251] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:36 [44959.805243] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] 2018-04-08 13:24:37 [44959.812531] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44959.817826] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44959.824330] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44959.830146] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44959.836648] mgs_apps_notify S ffff88bdde943f40 0 23195 2 0x00000000 2018-04-08 13:24:37 [44959.844157] Call Trace: 2018-04-08 13:24:37 [44959.847026] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44959.853363] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44959.858747] [] mgs_ir_notify+0x1c0/0x2b0 [mgs] 2018-04-08 13:24:37 [44959.865243] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44959.871229] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] 2018-04-08 13:24:37 [44959.878505] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44959.883794] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44959.890289] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44959.896097] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44959.902587] mgs_images_noti S ffff88bd9b70af70 0 23209 2 0x00000000 2018-04-08 13:24:37 [44959.910087] Call Trace: 2018-04-08 13:24:37 [44959.912952] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44959.919281] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44959.924657] [] mgs_ir_notify+0x1c0/0x2b0 [mgs] 2018-04-08 13:24:37 [44959.931156] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44959.937136] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] 2018-04-08 13:24:37 [44959.944409] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44959.949697] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44959.956191] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44959.961990] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44959.968485] ll_mgs_0003 S ffff88bddee04f10 0 23258 2 0x00000000 2018-04-08 13:24:37 [44959.975983] Call Trace: 2018-04-08 13:24:37 [44959.978850] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44959.985174] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44959.990567] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44959.997664] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.003654] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.010340] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.018143] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.023431] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.029935] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.035738] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.042237] tx_commit_cb S ffff88bd94a88000 0 23398 2 0x00000000 2018-04-08 13:24:37 [44960.049732] Call Trace: 2018-04-08 13:24:37 [44960.052600] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.057982] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:37 [44960.064395] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.070375] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:37 [44960.077301] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.082590] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.089086] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.094891] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.101382] ldlm_cn01_003 S ffff88bd94a88fd0 0 23399 2 0x00000000 2018-04-08 13:24:37 [44960.108875] Call Trace: 2018-04-08 13:24:37 [44960.111742] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.118070] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.123461] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.130567] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.136565] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.143251] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.151053] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.156343] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.162845] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.168649] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.175148] ldlm_cn00_003 S ffff88beba835ee0 0 23400 2 0x00000000 2018-04-08 13:24:37 [44960.182653] Call Trace: 2018-04-08 13:24:37 [44960.185522] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.191855] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.197241] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.204345] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.210344] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.217035] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.224839] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.230135] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.236639] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.242450] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.248957] ldlm_cn00_004 S ffff88beb4c1bf40 0 23401 2 0x00000000 2018-04-08 13:24:37 [44960.256466] Call Trace: 2018-04-08 13:24:37 [44960.259337] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.265675] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.271069] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.278185] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.284190] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.290881] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.298684] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.303980] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.310488] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.316301] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.322808] ldlm_cn01_004 S ffff88beb4c1dee0 0 23402 2 0x00000000 2018-04-08 13:24:37 [44960.330317] Call Trace: 2018-04-08 13:24:37 [44960.333189] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.339524] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.344922] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.352036] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.358042] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.364744] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.372556] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.377853] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.384368] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.390195] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.396706] ldlm_cn01_005 S ffff885eb021af70 0 23517 2 0x00000000 2018-04-08 13:24:37 [44960.404220] Call Trace: 2018-04-08 13:24:37 [44960.407096] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.413432] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.418831] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.425951] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.431956] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.438657] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.446465] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.451767] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.458278] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.464094] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.470603] ldlm_cn00_005 S ffff88bdde940fd0 0 23626 2 0x00000000 2018-04-08 13:24:37 [44960.478116] Call Trace: 2018-04-08 13:24:37 [44960.480988] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.487327] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.492723] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.499845] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.505852] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.512553] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.520361] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.525661] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.532172] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.537987] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.544496] mdt00_000 S ffff88be60f40000 0 24006 2 0x00000000 2018-04-08 13:24:37 [44960.552011] Call Trace: 2018-04-08 13:24:37 [44960.554882] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.561219] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.566622] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.573739] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.579745] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.586444] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.594254] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.599553] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.606064] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.611884] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.618387] mdt00_001 S ffff88be60f40fd0 0 24007 2 0x00000000 2018-04-08 13:24:37 [44960.625894] Call Trace: 2018-04-08 13:24:37 [44960.628770] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.635105] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.640504] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.647622] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.653632] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.660330] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.668140] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.673437] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.679950] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.685765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.692272] mdt00_002 S ffff88be60f43f40 0 24008 2 0x00000000 2018-04-08 13:24:37 [44960.699778] Call Trace: 2018-04-08 13:24:37 [44960.702654] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.708990] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.714390] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:37 [44960.721510] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:37 [44960.727514] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:37 [44960.734216] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:37 [44960.742027] [] kthread+0xcf/0xe0 2018-04-08 13:24:37 [44960.747324] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.753833] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:37 [44960.759650] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:37 [44960.766162] mdt01_000 S ffff88be60f42f70 0 24009 2 0x00000000 2018-04-08 13:24:37 [44960.773672] Call Trace: 2018-04-08 13:24:37 [44960.776546] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:37 [44960.782883] [] schedule+0x29/0x70 2018-04-08 13:24:37 [44960.788282] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44960.795392] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44960.801399] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44960.808100] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44960.815907] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44960.821211] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44960.827717] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44960.833538] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44960.840042] mdt01_001 S ffff88bddaf21fa0 0 24010 2 0x00000000 2018-04-08 13:24:38 [44960.847551] Call Trace: 2018-04-08 13:24:38 [44960.850425] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44960.856760] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44960.862159] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44960.869279] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44960.875282] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44960.881975] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44960.889788] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44960.895085] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44960.901597] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44960.907416] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44960.913920] mdt01_002 S ffff88bddaf20fd0 0 24011 2 0x00000000 2018-04-08 13:24:38 [44960.921426] Call Trace: 2018-04-08 13:24:38 [44960.924299] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44960.930637] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44960.936034] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44960.943146] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44960.949154] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44960.955854] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44960.963662] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44960.968961] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44960.975475] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44960.981292] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44960.987798] mdt_rdpg00_000 S ffff88be5de73f40 0 24012 2 0x00000000 2018-04-08 13:24:38 [44960.995311] Call Trace: 2018-04-08 13:24:38 [44960.998187] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.004523] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.009923] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.017044] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.023049] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.029748] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.037558] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.042856] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.049368] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.055184] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.061695] mdt_rdpg00_001 S ffff88be5de72f70 0 24013 2 0x00000000 2018-04-08 13:24:38 [44961.069207] Call Trace: 2018-04-08 13:24:38 [44961.072078] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.078416] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.083818] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.090938] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.096943] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.103644] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.111453] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.116752] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.123264] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.129080] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.135585] mdt_rdpg01_000 S ffff88be5de74f10 0 24014 2 0x00000000 2018-04-08 13:24:38 [44961.143092] Call Trace: 2018-04-08 13:24:38 [44961.145967] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.152305] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.157701] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.164813] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.170821] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.177519] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.185330] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.190629] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.197138] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.202957] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.209462] mdt_rdpg01_001 S ffff88be5de76eb0 0 24015 2 0x00000000 2018-04-08 13:24:38 [44961.216971] Call Trace: 2018-04-08 13:24:38 [44961.219843] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.226182] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.231588] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.238707] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.244716] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.251418] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.259224] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.264523] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.271037] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.276862] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.283369] mdt_attr00_000 S ffff88be5de70000 0 24016 2 0x00000000 2018-04-08 13:24:38 [44961.290883] Call Trace: 2018-04-08 13:24:38 [44961.293754] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.300097] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.305500] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.312619] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.318629] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.325311] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:38 [44961.331228] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.339046] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.344348] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.350860] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.356676] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.363184] mdt_attr00_001 S ffff88be5de70fd0 0 24017 2 0x00000000 2018-04-08 13:24:38 [44961.370698] Call Trace: 2018-04-08 13:24:38 [44961.373575] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.379919] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.385316] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.392436] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.398442] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.405125] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:38 [44961.411048] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.418859] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.424158] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.430666] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.436483] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.442989] mdt_attr01_000 S ffff88be5de71fa0 0 24018 2 0x00000000 2018-04-08 13:24:38 [44961.450493] Call Trace: 2018-04-08 13:24:38 [44961.453367] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.459707] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.465108] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.472228] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.478237] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.484919] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:38 [44961.490839] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.498653] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.503955] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.510468] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.516279] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.522791] mdt_attr01_001 S ffff88606d3deeb0 0 24019 2 0x00000000 2018-04-08 13:24:38 [44961.530305] Call Trace: 2018-04-08 13:24:38 [44961.533180] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.539516] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.544915] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.552034] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.558043] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.564725] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:38 [44961.570649] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.578457] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.583753] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.590263] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.596079] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.602590] mdt_out00_000 R running task 0 24020 2 0x00000000 2018-04-08 13:24:38 [44961.610104] Call Trace: 2018-04-08 13:24:38 [44961.612977] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.619314] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.624713] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.631832] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:38 [44961.638516] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:38 [44961.644783] [] ? ptlrpc_main+0xa92/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.651659] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.659464] [] ? kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.664932] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.671441] [] ? ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.677422] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.683921] mdt_out00_001 S ffff88be65bc8000 0 24021 2 0x00000000 2018-04-08 13:24:38 [44961.691429] Call Trace: 2018-04-08 13:24:38 [44961.694296] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.700634] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.706028] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.713139] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:38 [44961.719148] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:38 [44961.725849] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:38 [44961.733660] [] kthread+0xcf/0xe0 2018-04-08 13:24:38 [44961.738956] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.745467] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:38 [44961.751282] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:38 [44961.757784] mdt_out01_000 S ffff88be65bc8fd0 0 24022 2 0x00000000 2018-04-08 13:24:38 [44961.765289] Call Trace: 2018-04-08 13:24:38 [44961.768155] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:38 [44961.774490] [] schedule+0x29/0x70 2018-04-08 13:24:38 [44961.779891] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:38 [44961.786999] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44961.793005] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44961.799701] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44961.807512] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44961.812807] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44961.819320] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44961.825132] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44961.831631] mdt_out01_001 S ffff88bd6beb0c00 0 24023 2 0x00000000 2018-04-08 13:24:39 [44961.839143] Call Trace: 2018-04-08 13:24:39 [44961.842042] [] ? tgt_request_preprocess.isra.26+0x299/0x790 [ptlrpc] 2018-04-08 13:24:39 [44961.850481] [] tgt_request_handle+0x925/0x1370 [ptlrpc] 2018-04-08 13:24:39 [44961.857792] [] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] 2018-04-08 13:24:39 [44961.865889] [] ? ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44961.873182] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:39 [44961.879871] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:39 [44961.886147] [] ? ptlrpc_main+0xa92/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44961.893024] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44961.900838] [] ? kthread+0xcf/0xe0 2018-04-08 13:24:39 [44961.906316] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44961.912824] [] ? ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44961.918814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44961.925323] mdt_seqs_0000 S ffff88be65bcaf70 0 24024 2 0x00000000 2018-04-08 13:24:39 [44961.932839] Call Trace: 2018-04-08 13:24:39 [44961.935713] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44961.942060] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44961.947467] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44961.954588] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44961.960603] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44961.967291] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:39 [44961.973220] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44961.981039] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44961.986343] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44961.992860] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44961.998684] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.005194] mdt_seqs_0001 S ffff88be65bcbf40 0 24025 2 0x00000000 2018-04-08 13:24:39 [44962.012711] Call Trace: 2018-04-08 13:24:39 [44962.015597] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.021940] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.027346] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44962.034465] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.040481] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44962.047173] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:39 [44962.053104] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44962.060924] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.066226] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.072736] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.078554] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.085062] mdt_seqm_0000 S ffff88be65bc9fa0 0 24026 2 0x00000000 2018-04-08 13:24:39 [44962.092578] Call Trace: 2018-04-08 13:24:39 [44962.095455] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.101798] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.107205] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44962.114324] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.120340] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44962.127036] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:39 [44962.132963] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44962.140781] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.146081] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.152592] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.158404] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.164906] mdt_seqm_0001 S ffff88be65bcdee0 0 24027 2 0x00000000 2018-04-08 13:24:39 [44962.172411] Call Trace: 2018-04-08 13:24:39 [44962.175280] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.181614] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.187013] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44962.194125] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.200133] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44962.206819] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:39 [44962.212741] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44962.220554] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.225854] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.232366] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.238183] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.244694] mdt_fld_0000 S ffff88bddae12f70 0 24028 2 0x00000000 2018-04-08 13:24:39 [44962.252208] Call Trace: 2018-04-08 13:24:39 [44962.255080] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.261416] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.266814] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44962.273937] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.279942] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44962.286625] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:39 [44962.292548] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44962.300358] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.305654] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.312161] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.317983] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.324489] mdt_fld_0001 S ffff88be6537eeb0 0 24029 2 0x00000000 2018-04-08 13:24:39 [44962.332004] Call Trace: 2018-04-08 13:24:39 [44962.334880] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.341215] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.346614] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44962.353735] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.359741] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44962.366441] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44962.374254] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.379556] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.386064] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.391881] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.398393] mdt00_003 S ffff88bd920aeeb0 0 24060 2 0x00000000 2018-04-08 13:24:39 [44962.405908] Call Trace: 2018-04-08 13:24:39 [44962.408780] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.415117] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.420518] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:39 [44962.427635] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.433641] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:39 [44962.440343] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:39 [44962.448155] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.453452] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.459962] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.465777] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.472284] qmt_reba_images S ffff88012ce61fa0 0 24074 2 0x00000000 2018-04-08 13:24:39 [44962.479794] Call Trace: 2018-04-08 13:24:39 [44962.482669] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.489012] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.494405] [] qmt_reba_thread+0x9e0/0xda0 [lquota] 2018-04-08 13:24:39 [44962.501349] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.507345] [] ? qmt_glimpse_lock.isra.19+0x690/0x690 [lquota] 2018-04-08 13:24:39 [44962.515243] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.520543] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.527053] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.532870] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.539376] osp-pre-0-0 S ffff88be5e191fa0 0 24084 2 0x00000000 2018-04-08 13:24:39 [44962.546891] Call Trace: 2018-04-08 13:24:39 [44962.549781] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:39 [44962.557335] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.562738] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:39 [44962.569946] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:39 [44962.576460] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.582463] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:39 [44962.589407] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.594702] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.601213] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:39 [44962.607032] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.613539] osp-syn-0-0 S ffff88bd94a8bf40 0 24100 2 0x00000000 2018-04-08 13:24:39 [44962.621057] Call Trace: 2018-04-08 13:24:39 [44962.623932] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:39 [44962.630966] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:39 [44962.637303] [] schedule+0x29/0x70 2018-04-08 13:24:39 [44962.642688] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:39 [44962.650239] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:39 [44962.656247] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:39 [44962.663807] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:39 [44962.670678] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:39 [44962.678157] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:39 [44962.685632] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:39 [44962.693190] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:39 [44962.699879] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:39 [44962.707872] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:39 [44962.715347] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:39 [44962.723345] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:39 [44962.731247] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:39 [44962.737934] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:39 [44962.744195] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:39 [44962.751065] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:39 [44962.758104] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:39 [44962.764795] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:39 [44962.770709] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:39 [44962.778527] [] kthread+0xcf/0xe0 2018-04-08 13:24:39 [44962.783832] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:39 [44962.790349] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44962.796164] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44962.802675] osp-pre-1-0 S ffff88bd94a8af70 0 24102 2 0x00000000 2018-04-08 13:24:40 [44962.810184] Call Trace: 2018-04-08 13:24:40 [44962.813084] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:40 [44962.820642] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44962.826032] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:40 [44962.833245] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:40 [44962.839768] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44962.845776] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:40 [44962.852724] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44962.858027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44962.864538] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44962.870358] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44962.876871] osp-syn-1-0 S ffff885ea3682f70 0 24107 2 0x00000000 2018-04-08 13:24:40 [44962.884382] Call Trace: 2018-04-08 13:24:40 [44962.887264] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:40 [44962.894300] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44962.900643] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44962.906039] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:40 [44962.913599] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44962.919605] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:40 [44962.927167] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:40 [44962.934040] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:40 [44962.941520] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:40 [44962.948998] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:40 [44962.956562] [] ? llog_process_or_fork+0x56/0x450 [obdclass] 2018-04-08 13:24:40 [44962.964206] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:40 [44962.972201] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:40 [44962.979669] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:40 [44962.987658] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:40 [44962.995555] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:40 [44963.002249] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:40 [44963.008509] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:40 [44963.015378] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:40 [44963.022417] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:40 [44963.029107] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:40 [44963.035012] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:40 [44963.042817] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.048116] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.054624] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.060444] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.066951] mdt00_004 S ffff885eb6125ee0 0 24110 2 0x00000000 2018-04-08 13:24:40 [44963.074467] Call Trace: 2018-04-08 13:24:40 [44963.077342] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.083685] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.089086] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:40 [44963.096205] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.102214] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:40 [44963.108915] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:40 [44963.116729] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.122027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.128535] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.134351] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.140862] lquota_wb_image S ffff88bd8d0e2f70 0 24237 2 0x00000000 2018-04-08 13:24:40 [44963.148377] Call Trace: 2018-04-08 13:24:40 [44963.151251] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.156632] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:40 [44963.162883] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:40 [44963.169315] [] ? qsd_job_pending+0x7e/0x1b0 [lquota] 2018-04-08 13:24:40 [44963.176355] [] qsd_upd_thread+0x9f7/0xd40 [lquota] 2018-04-08 13:24:40 [44963.183213] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:40 [44963.189113] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.195106] [] ? qsd_upd_add+0xf0/0xf0 [lquota] 2018-04-08 13:24:40 [44963.201698] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.206984] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.213487] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.219293] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.225786] dist_txn-0 S ffff88bd8d0e4f10 0 24239 2 0x00000000 2018-04-08 13:24:40 [44963.233283] Call Trace: 2018-04-08 13:24:40 [44963.236151] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:40 [44963.243168] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.249498] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.254898] [] distribute_txn_commit_thread+0x9ac/0xca0 [ptlrpc] 2018-04-08 13:24:40 [44963.262963] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.268975] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] 2018-04-08 13:24:40 [44963.276259] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.281548] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.288047] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.293852] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.300347] mdt01_003 S ffff88bd94a89fa0 0 24252 2 0x00000000 2018-04-08 13:24:40 [44963.307855] Call Trace: 2018-04-08 13:24:40 [44963.310721] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.317055] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.322450] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:40 [44963.329557] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.335554] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:40 [44963.342245] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:40 [44963.350049] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.355340] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.361838] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.367645] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.374147] tx_commit_cb S ffff88bddae9eeb0 0 24564 2 0x00000000 2018-04-08 13:24:40 [44963.381655] Call Trace: 2018-04-08 13:24:40 [44963.384519] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.389896] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:40 [44963.396306] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.402290] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:40 [44963.409222] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.414512] [] ? finish_task_switch+0x57/0x160 2018-04-08 13:24:40 [44963.421016] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.427514] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.433312] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.439801] mdt01_004 S ffff88bddae9dee0 0 24565 2 0x00000000 2018-04-08 13:24:40 [44963.447292] Call Trace: 2018-04-08 13:24:40 [44963.450157] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.456480] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.461873] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:40 [44963.468984] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.474983] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:40 [44963.481678] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:40 [44963.489479] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.494776] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.501280] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.507099] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.513607] mdt01_005 S ffff88bddae98fd0 0 24567 2 0x00000000 2018-04-08 13:24:40 [44963.521115] Call Trace: 2018-04-08 13:24:40 [44963.523987] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.530318] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.535711] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:40 [44963.542823] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.548833] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:40 [44963.555527] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:40 [44963.563329] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.568624] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.575131] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.580948] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.587450] mdt00_005 S ffff88beba836eb0 0 24569 2 0x00000000 2018-04-08 13:24:40 [44963.594950] Call Trace: 2018-04-08 13:24:40 [44963.597816] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.604143] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.609534] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:40 [44963.616646] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.622645] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:40 [44963.629334] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:40 [44963.637135] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.642423] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.648930] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.654743] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.661247] mdt01_006 S ffff88be5b7d4f10 0 24571 2 0x00000000 2018-04-08 13:24:40 [44963.668752] Call Trace: 2018-04-08 13:24:40 [44963.671614] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.677942] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.683336] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:40 [44963.690450] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.696453] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:40 [44963.703146] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:40 [44963.710951] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.716250] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.722760] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:40 [44963.728578] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.735087] qmt_reba_apps-Q S ffff88bd946ecf10 0 24673 2 0x00000000 2018-04-08 13:24:40 [44963.742603] Call Trace: 2018-04-08 13:24:40 [44963.745473] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:40 [44963.751809] [] schedule+0x29/0x70 2018-04-08 13:24:40 [44963.757197] [] qmt_reba_thread+0x9e0/0xda0 [lquota] 2018-04-08 13:24:40 [44963.764138] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:40 [44963.770132] [] ? qmt_glimpse_lock.isra.19+0x690/0x690 [lquota] 2018-04-08 13:24:40 [44963.778023] [] kthread+0xcf/0xe0 2018-04-08 13:24:40 [44963.783319] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:40 [44963.789831] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44963.795648] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44963.802160] osp-pre-0-0 S ffff88bd946eeeb0 0 24679 2 0x00000000 2018-04-08 13:24:41 [44963.809673] Call Trace: 2018-04-08 13:24:41 [44963.812564] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:41 [44963.820117] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44963.825508] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:41 [44963.832721] [] ? sched_clock+0x9/0x10 2018-04-08 13:24:41 [44963.838461] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44963.844461] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:41 [44963.851407] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44963.856705] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44963.863216] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44963.869034] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44963.875544] osp-syn-0-0 S ffff88beb7a39fa0 0 24686 2 0x00000000 2018-04-08 13:24:41 [44963.883055] Call Trace: 2018-04-08 13:24:41 [44963.885933] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:41 [44963.892967] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:41 [44963.899305] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44963.904690] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:41 [44963.912241] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44963.918249] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:41 [44963.925808] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:41 [44963.932679] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:41 [44963.940161] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:41 [44963.947633] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:41 [44963.955183] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:41 [44963.961697] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:41 [44963.967869] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:41 [44963.975858] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:41 [44963.983336] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:41 [44963.991333] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:41 [44963.999234] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:41 [44964.005926] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:41 [44964.012185] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:41 [44964.019055] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:41 [44964.026088] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:41 [44964.032778] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:41 [44964.038691] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:41 [44964.046508] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.051811] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.058321] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.064140] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.070647] osp-pre-1-0 S ffff88beb4c1eeb0 0 24689 2 0x00000000 2018-04-08 13:24:41 [44964.078166] Call Trace: 2018-04-08 13:24:41 [44964.081054] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:41 [44964.088605] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.093999] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:41 [44964.101211] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:41 [44964.107732] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.113729] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:41 [44964.120678] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.125981] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.132490] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.138308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.144817] osp-syn-1-0 S ffff88bddee05ee0 0 24699 2 0x00000000 2018-04-08 13:24:41 [44964.152336] Call Trace: 2018-04-08 13:24:41 [44964.155213] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:41 [44964.162248] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:41 [44964.168594] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.173986] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:41 [44964.181541] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.187545] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:41 [44964.195109] [] ? llog_process_or_fork+0x56/0x450 [obdclass] 2018-04-08 13:24:41 [44964.202754] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:41 [44964.209627] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:41 [44964.217106] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:41 [44964.224579] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:41 [44964.232128] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:41 [44964.238635] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:41 [44964.244807] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:41 [44964.252796] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:41 [44964.260270] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:41 [44964.268262] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:41 [44964.276166] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:41 [44964.282857] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:41 [44964.289118] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:41 [44964.295989] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:41 [44964.303024] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:41 [44964.309712] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:41 [44964.315618] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:41 [44964.323429] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.328734] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.335248] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.341072] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.347582] ldlm_cn01_006 S ffff88bd86dccf10 0 24800 2 0x00000000 2018-04-08 13:24:41 [44964.355106] Call Trace: 2018-04-08 13:24:41 [44964.357982] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:41 [44964.364321] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.369731] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:41 [44964.376851] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.382865] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:41 [44964.389562] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:41 [44964.397372] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.402674] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.409186] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.415001] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.421513] lquota_wb_apps- S ffff88bd86e99fa0 0 24805 2 0x00000000 2018-04-08 13:24:41 [44964.429028] Call Trace: 2018-04-08 13:24:41 [44964.431906] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.437297] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:41 [44964.443544] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:41 [44964.449976] [] ? qsd_job_pending+0x7e/0x1b0 [lquota] 2018-04-08 13:24:41 [44964.457009] [] qsd_upd_thread+0x9f7/0xd40 [lquota] 2018-04-08 13:24:41 [44964.463860] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:41 [44964.469761] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.475742] [] ? qsd_upd_add+0xf0/0xf0 [lquota] 2018-04-08 13:24:41 [44964.482333] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.487627] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.494128] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.499936] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.506435] dist_txn-0 S ffff88bd86e9af70 0 24806 2 0x00000000 2018-04-08 13:24:41 [44964.513936] Call Trace: 2018-04-08 13:24:41 [44964.516803] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:41 [44964.523835] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:41 [44964.530166] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.535562] [] distribute_txn_commit_thread+0x9ac/0xca0 [ptlrpc] 2018-04-08 13:24:41 [44964.543625] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.549631] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] 2018-04-08 13:24:41 [44964.556920] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.562214] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.568715] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.574525] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.581024] tx_commit_cb S ffff88bdde942f70 0 25137 2 0x00000000 2018-04-08 13:24:41 [44964.588533] Call Trace: 2018-04-08 13:24:41 [44964.591400] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.596782] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:41 [44964.603194] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.609181] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:41 [44964.616107] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.621398] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.627902] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.633709] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.640206] mdt01_007 S ffff88bdde944f10 0 25153 2 0x00000000 2018-04-08 13:24:41 [44964.647706] Call Trace: 2018-04-08 13:24:41 [44964.650561] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:41 [44964.656891] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.662282] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:41 [44964.669383] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.675381] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:41 [44964.682072] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:41 [44964.689866] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.695155] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.701659] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.707464] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.713956] qmt_reba_home-Q S ffff88beb7aadee0 0 25282 2 0x00000000 2018-04-08 13:24:41 [44964.721453] Call Trace: 2018-04-08 13:24:41 [44964.724309] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:41 [44964.730643] [] schedule+0x29/0x70 2018-04-08 13:24:41 [44964.736021] [] qmt_reba_thread+0x9e0/0xda0 [lquota] 2018-04-08 13:24:41 [44964.742956] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:41 [44964.748946] [] ? qmt_glimpse_lock.isra.19+0x690/0x690 [lquota] 2018-04-08 13:24:41 [44964.756831] [] kthread+0xcf/0xe0 2018-04-08 13:24:41 [44964.762130] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.768634] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:41 [44964.774453] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:41 [44964.780963] osp-pre-0-0 S ffff88be60f2cf10 0 25292 2 0x00000000 2018-04-08 13:24:41 [44964.788488] Call Trace: 2018-04-08 13:24:42 [44964.791380] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:42 [44964.798939] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44964.804327] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:42 [44964.811529] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:42 [44964.818040] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44964.824037] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:42 [44964.830983] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44964.836277] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44964.842789] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44964.848603] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44964.855105] osp-syn-0-0 S ffff885eb9a4bf40 0 25301 2 0x00000000 2018-04-08 13:24:42 [44964.862613] Call Trace: 2018-04-08 13:24:42 [44964.865490] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44964.871827] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44964.877212] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:42 [44964.884756] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44964.890757] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:42 [44964.898308] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:42 [44964.905170] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:42 [44964.912641] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:42 [44964.920110] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:42 [44964.927660] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:42 [44964.934184] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:42 [44964.940354] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:42 [44964.948347] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:42 [44964.955818] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:42 [44964.963807] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:42 [44964.971704] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:42 [44964.978395] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:42 [44964.984654] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:42 [44964.991524] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:42 [44964.998556] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:42 [44965.005245] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:42 [44965.011151] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:42 [44965.018962] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.024266] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.030771] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.036589] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.043100] osp-pre-1-0 S ffff88012cc3cf10 0 25308 2 0x00000000 2018-04-08 13:24:42 [44965.050618] Call Trace: 2018-04-08 13:24:42 [44965.053508] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:42 [44965.061069] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.066459] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:42 [44965.073673] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:42 [44965.080192] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.086194] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:42 [44965.093140] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.098443] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.104952] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.110768] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.117277] osp-syn-1-0 S ffff88012dbfeeb0 0 25318 2 0x00000000 2018-04-08 13:24:42 [44965.124782] Call Trace: 2018-04-08 13:24:42 [44965.127661] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44965.134001] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.139389] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:42 [44965.146941] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.152949] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:42 [44965.160510] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:42 [44965.167377] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:42 [44965.174850] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:42 [44965.182323] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:42 [44965.189873] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:42 [44965.196570] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:42 [44965.204561] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:42 [44965.212031] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:42 [44965.220022] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:42 [44965.227922] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:42 [44965.234608] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:42 [44965.240872] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:42 [44965.247739] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:42 [44965.254774] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:42 [44965.261460] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:42 [44965.267374] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:42 [44965.275188] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.280485] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.286999] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.292820] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.299331] ldlm_cn01_007 S ffff88be5e190fd0 0 25450 2 0x00000000 2018-04-08 13:24:42 [44965.306847] Call Trace: 2018-04-08 13:24:42 [44965.309722] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44965.316068] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.321476] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:42 [44965.328593] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.334610] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:42 [44965.341319] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:42 [44965.349152] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.354450] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.360961] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.366773] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.373282] lquota_wb_home- S ffff885e76a00fd0 0 25500 2 0x00000000 2018-04-08 13:24:42 [44965.380800] Call Trace: 2018-04-08 13:24:42 [44965.383675] [] ? queued_spin_lock_slowpath+0xb/0xf 2018-04-08 13:24:42 [44965.390542] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.395929] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:42 [44965.402179] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:42 [44965.408609] [] ? qsd_job_pending+0x7e/0x1b0 [lquota] 2018-04-08 13:24:42 [44965.415647] [] qsd_upd_thread+0x9f7/0xd40 [lquota] 2018-04-08 13:24:42 [44965.422509] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.428498] [] ? qsd_upd_add+0xf0/0xf0 [lquota] 2018-04-08 13:24:42 [44965.435090] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.440391] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.446899] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.452705] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.459208] dist_txn-0 S ffff885e76a06eb0 0 25501 2 0x00000000 2018-04-08 13:24:42 [44965.466712] Call Trace: 2018-04-08 13:24:42 [44965.469582] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:42 [44965.476607] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44965.482945] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.488350] [] distribute_txn_commit_thread+0x9ac/0xca0 [ptlrpc] 2018-04-08 13:24:42 [44965.496418] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.502425] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] 2018-04-08 13:24:42 [44965.509713] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.515010] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.521521] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.527333] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.533837] tx_commit_cb S ffff88beb3f94f10 0 25905 2 0x00000000 2018-04-08 13:24:42 [44965.541344] Call Trace: 2018-04-08 13:24:42 [44965.544207] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.549595] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:42 [44965.556017] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.562011] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:42 [44965.568946] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.574235] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.580742] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.586555] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.593053] mdt00_006 S ffff88bd86121fa0 0 26015 2 0x00000000 2018-04-08 13:24:42 [44965.600553] Call Trace: 2018-04-08 13:24:42 [44965.603417] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44965.609743] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.615136] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:42 [44965.622246] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.628246] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:42 [44965.634936] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:42 [44965.642738] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.648027] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.654530] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.660337] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.666835] ldlm_cn00_006 S ffff88012ca34f10 0 26131 2 0x00000000 2018-04-08 13:24:42 [44965.674335] Call Trace: 2018-04-08 13:24:42 [44965.677198] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44965.683524] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.688917] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:42 [44965.696028] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.702027] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:42 [44965.708720] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:42 [44965.716523] [] kthread+0xcf/0xe0 2018-04-08 13:24:42 [44965.721821] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.728325] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:42 [44965.734143] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:42 [44965.740653] ldlm_cn01_008 S ffff88012ca36eb0 0 26132 2 0x00000000 2018-04-08 13:24:42 [44965.748170] Call Trace: 2018-04-08 13:24:42 [44965.751038] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:42 [44965.757375] [] schedule+0x29/0x70 2018-04-08 13:24:42 [44965.762773] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:42 [44965.769886] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:42 [44965.775891] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:42 [44965.782582] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:43 [44965.790382] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44965.795678] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44965.802180] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44965.807990] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44965.814492] qmt_reba_dagg-Q S ffff885e76a02f70 0 26729 2 0x00000000 2018-04-08 13:24:43 [44965.821992] Call Trace: 2018-04-08 13:24:43 [44965.824864] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:43 [44965.831197] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44965.836583] [] qmt_reba_thread+0x9e0/0xda0 [lquota] 2018-04-08 13:24:43 [44965.843518] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44965.849512] [] ? qmt_glimpse_lock.isra.19+0x690/0x690 [lquota] 2018-04-08 13:24:43 [44965.857405] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44965.862706] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44965.869215] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44965.875035] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44965.881544] osp-pre-0-0 S ffff885eb9a48000 0 26735 2 0x00000000 2018-04-08 13:24:43 [44965.889057] Call Trace: 2018-04-08 13:24:43 [44965.891948] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:43 [44965.899498] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44965.904893] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:43 [44965.912104] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:43 [44965.918622] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44965.924614] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:43 [44965.931566] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44965.936866] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44965.943379] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44965.949197] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44965.955709] osp-syn-0-0 S ffff885eb9589fa0 0 26737 2 0x00000000 2018-04-08 13:24:43 [44965.963219] Call Trace: 2018-04-08 13:24:43 [44965.966097] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:43 [44965.973130] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:43 [44965.979469] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44965.984852] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:43 [44965.992405] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44965.998409] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:43 [44966.005965] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:43 [44966.012834] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:43 [44966.020312] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:43 [44966.027783] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:43 [44966.035338] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:43 [44966.042035] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:43 [44966.050029] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:43 [44966.057508] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:43 [44966.065504] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:43 [44966.073409] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:43 [44966.080101] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:43 [44966.086360] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:43 [44966.093229] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:43 [44966.100268] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:43 [44966.106961] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:43 [44966.112878] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:43 [44966.120692] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44966.125998] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.132514] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44966.138330] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.144841] osp-pre-1-0 S ffff88bd94710fd0 0 26744 2 0x00000000 2018-04-08 13:24:43 [44966.152358] Call Trace: 2018-04-08 13:24:43 [44966.155257] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:43 [44966.162814] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44966.168210] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:43 [44966.175420] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:43 [44966.181940] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44966.187942] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:43 [44966.194897] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44966.200201] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.206718] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44966.212532] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.219043] osp-syn-1-0 S ffff88bd94710000 0 26745 2 0x00000000 2018-04-08 13:24:43 [44966.226556] Call Trace: 2018-04-08 13:24:43 [44966.229436] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:43 [44966.236471] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:43 [44966.242814] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44966.248203] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:43 [44966.255766] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44966.261774] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:43 [44966.269332] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:43 [44966.276209] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:43 [44966.283688] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:43 [44966.291165] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:43 [44966.298722] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:43 [44966.305418] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:43 [44966.313414] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:43 [44966.320888] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:43 [44966.328887] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:43 [44966.336789] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:43 [44966.343486] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:43 [44966.349752] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:43 [44966.356621] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:43 [44966.363663] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:43 [44966.370350] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:43 [44966.376260] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:43 [44966.384070] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44966.389375] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.395884] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44966.401702] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.408213] osp-pre-2-0 S ffff88bd8d58eeb0 0 26748 2 0x00000000 2018-04-08 13:24:43 [44966.415719] Call Trace: 2018-04-08 13:24:43 [44966.418610] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:43 [44966.426168] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44966.431563] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:43 [44966.438774] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:43 [44966.445294] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44966.451295] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:43 [44966.458241] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44966.463546] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.470053] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44966.475868] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.482381] osp-syn-2-0 S ffff88bd8d588fd0 0 26749 2 0x00000000 2018-04-08 13:24:43 [44966.489887] Call Trace: 2018-04-08 13:24:43 [44966.492765] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:43 [44966.499801] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:43 [44966.506145] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44966.511543] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:43 [44966.519103] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44966.525109] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:43 [44966.532667] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:43 [44966.539537] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:43 [44966.547013] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:43 [44966.554490] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:43 [44966.562047] [] ? llog_process_or_fork+0x56/0x450 [obdclass] 2018-04-08 13:24:43 [44966.569698] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:43 [44966.577686] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:43 [44966.585156] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:43 [44966.593144] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:43 [44966.601039] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:43 [44966.607734] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:43 [44966.613995] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:43 [44966.620862] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:43 [44966.627898] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:43 [44966.634582] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:43 [44966.640485] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:43 [44966.648301] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44966.653596] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.660110] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44966.665925] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.672438] osp-pre-3-0 S ffff88bd8d58cf10 0 26750 2 0x00000000 2018-04-08 13:24:43 [44966.679951] Call Trace: 2018-04-08 13:24:43 [44966.682845] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:43 [44966.690403] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44966.695795] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:43 [44966.703010] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:43 [44966.709528] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:43 [44966.715528] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:43 [44966.722476] [] kthread+0xcf/0xe0 2018-04-08 13:24:43 [44966.727779] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.734289] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:43 [44966.740104] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:43 [44966.746613] osp-syn-3-0 S ffff88bd8d589fa0 0 26752 2 0x00000000 2018-04-08 13:24:43 [44966.754119] Call Trace: 2018-04-08 13:24:43 [44966.756998] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:43 [44966.764033] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:43 [44966.770371] [] schedule+0x29/0x70 2018-04-08 13:24:43 [44966.775766] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:43 [44966.783324] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44966.789334] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44966.796894] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44966.803765] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44966.811241] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:44 [44966.818715] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44966.826266] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:44 [44966.832962] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44966.840953] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44966.848423] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44966.856412] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:44 [44966.864311] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:44 [44966.871003] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:44 [44966.877262] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44966.884131] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:44 [44966.891174] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:44 [44966.897862] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:44 [44966.903774] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:44 [44966.911592] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44966.916896] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44966.923405] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44966.929224] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44966.935731] osp-pre-4-0 S ffff88bd84cf0000 0 26756 2 0x00000000 2018-04-08 13:24:44 [44966.943244] Call Trace: 2018-04-08 13:24:44 [44966.946141] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:44 [44966.953701] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44966.959091] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:44 [44966.966307] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:44 [44966.972824] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44966.978823] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:44 [44966.985772] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44966.991075] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44966.997584] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44967.003400] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.009908] osp-syn-4-0 S ffff88bd84cf1fa0 0 26758 2 0x00000000 2018-04-08 13:24:44 [44967.017423] Call Trace: 2018-04-08 13:24:44 [44967.020301] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:44 [44967.027340] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:44 [44967.033683] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44967.039082] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:44 [44967.046638] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44967.052645] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44967.060207] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44967.067075] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44967.074553] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:44 [44967.082030] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44967.089588] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:44 [44967.096286] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44967.104284] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44967.111762] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44967.119763] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:44 [44967.127669] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:44 [44967.134359] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:44 [44967.140623] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44967.147498] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:44 [44967.154539] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:44 [44967.161226] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:44 [44967.167137] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:44 [44967.174954] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44967.180259] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.186768] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44967.192588] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.199097] osp-pre-5-0 S ffff88bd84cc6eb0 0 26762 2 0x00000000 2018-04-08 13:24:44 [44967.206612] Call Trace: 2018-04-08 13:24:44 [44967.209502] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:44 [44967.217062] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44967.222455] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:44 [44967.229668] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:44 [44967.236189] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44967.242188] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:44 [44967.249137] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44967.254439] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.260946] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44967.266764] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.273271] osp-syn-5-0 S ffff88bd84cc4f10 0 26763 2 0x00000000 2018-04-08 13:24:44 [44967.280787] Call Trace: 2018-04-08 13:24:44 [44967.283667] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:44 [44967.290704] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:44 [44967.297045] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44967.302434] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:44 [44967.310001] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44967.316009] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44967.323571] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44967.330446] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44967.337925] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:44 [44967.345400] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44967.352950] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:44 [44967.359647] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44967.367640] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44967.375121] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44967.383115] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:44 [44967.391018] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:44 [44967.397713] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:44 [44967.403973] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44967.410843] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:44 [44967.417880] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:44 [44967.424567] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:44 [44967.430473] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:44 [44967.438283] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44967.443586] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.450098] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44967.455913] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.462422] osp-pre-6-0 S ffff88bd84c2dee0 0 26767 2 0x00000000 2018-04-08 13:24:44 [44967.469941] Call Trace: 2018-04-08 13:24:44 [44967.472840] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:44 [44967.480399] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44967.485790] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:44 [44967.493007] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:44 [44967.499523] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44967.505524] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:44 [44967.512473] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44967.517777] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.524283] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44967.530100] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.536612] osp-syn-6-0 S ffff88bd84c2cf10 0 26768 2 0x00000000 2018-04-08 13:24:44 [44967.544114] Call Trace: 2018-04-08 13:24:44 [44967.546995] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:44 [44967.554032] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:44 [44967.560375] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44967.565770] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:44 [44967.573331] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44967.579337] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44967.586898] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44967.593767] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44967.601244] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:44 [44967.608723] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:44 [44967.616278] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:44 [44967.622975] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44967.630970] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:44 [44967.638445] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:44 [44967.646442] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:44 [44967.654350] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:44 [44967.661040] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:44 [44967.667302] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:44 [44967.674171] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:44 [44967.681209] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:44 [44967.687901] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:44 [44967.693811] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:44 [44967.701620] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44967.706923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.713434] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:44 [44967.719251] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:44 [44967.725761] osp-pre-7-0 S ffff88bd84c28fd0 0 26772 2 0x00000000 2018-04-08 13:24:44 [44967.733279] Call Trace: 2018-04-08 13:24:44 [44967.736181] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:44 [44967.743738] [] schedule+0x29/0x70 2018-04-08 13:24:44 [44967.749128] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:44 [44967.756343] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:44 [44967.762862] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:44 [44967.768860] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:44 [44967.775809] [] kthread+0xcf/0xe0 2018-04-08 13:24:44 [44967.781115] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44967.787631] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44967.793444] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44967.799954] osp-syn-7-0 S ffff88be70268fd0 0 26775 2 0x00000000 2018-04-08 13:24:45 [44967.807472] Call Trace: 2018-04-08 13:24:45 [44967.810347] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:45 [44967.817385] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:45 [44967.823731] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44967.829124] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:45 [44967.836685] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44967.842694] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44967.850253] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44967.857131] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44967.864607] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:45 [44967.872084] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44967.879640] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:45 [44967.886340] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44967.894331] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44967.901810] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44967.909805] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:45 [44967.917711] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:45 [44967.924405] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:45 [44967.930664] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44967.937534] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:45 [44967.944576] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:45 [44967.951259] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:45 [44967.957165] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:45 [44967.964984] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44967.970283] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44967.976796] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44967.982616] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44967.989125] osp-pre-8-0 S ffff88be60953f40 0 26779 2 0x00000000 2018-04-08 13:24:45 [44967.996642] Call Trace: 2018-04-08 13:24:45 [44967.999539] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:45 [44968.007100] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44968.012493] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:45 [44968.019706] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:45 [44968.026226] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44968.032234] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:45 [44968.039181] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44968.044487] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.051000] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44968.056818] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.063326] osp-syn-8-0 S ffff88be60951fa0 0 26781 2 0x00000000 2018-04-08 13:24:45 [44968.070844] Call Trace: 2018-04-08 13:24:45 [44968.073720] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:45 [44968.080758] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:45 [44968.087103] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44968.092496] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:45 [44968.100059] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44968.106065] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44968.113628] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44968.120503] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44968.127980] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:45 [44968.135457] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44968.143014] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:45 [44968.149713] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44968.157710] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44968.165189] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44968.173188] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:45 [44968.181092] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:45 [44968.187788] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:45 [44968.194057] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44968.200933] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:45 [44968.207973] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:45 [44968.214659] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:45 [44968.220573] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:45 [44968.228390] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44968.233693] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.240206] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44968.246029] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.252540] osp-pre-9-0 S ffff88bd8d0b9fa0 0 26787 2 0x00000000 2018-04-08 13:24:45 [44968.260055] Call Trace: 2018-04-08 13:24:45 [44968.262947] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:45 [44968.270508] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44968.275902] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:45 [44968.283112] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:45 [44968.289629] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44968.295630] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:45 [44968.302583] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44968.307882] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.314391] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44968.320206] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.326717] osp-syn-9-0 S ffff88bd8d095ee0 0 26789 2 0x00000000 2018-04-08 13:24:45 [44968.334231] Call Trace: 2018-04-08 13:24:45 [44968.337110] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:45 [44968.344146] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:45 [44968.350490] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44968.355888] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:45 [44968.363445] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44968.369454] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44968.377014] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44968.383890] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44968.391370] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:45 [44968.398845] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44968.406403] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:45 [44968.413101] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44968.421100] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44968.428577] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44968.436577] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:45 [44968.444481] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:45 [44968.451175] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:45 [44968.457435] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44968.464304] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:45 [44968.471341] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:45 [44968.478033] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:45 [44968.483942] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:45 [44968.491750] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44968.497048] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.503558] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44968.509376] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.515885] osp-pre-10-0 S ffff88bd8d092f70 0 26792 2 0x00000000 2018-04-08 13:24:45 [44968.523403] Call Trace: 2018-04-08 13:24:45 [44968.526301] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:45 [44968.533862] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44968.539252] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:45 [44968.546464] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:45 [44968.552985] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44968.558984] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:45 [44968.565932] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44968.571236] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.577744] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44968.583560] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.590070] osp-syn-10-0 S ffff88bd869dcf10 0 26796 2 0x00000000 2018-04-08 13:24:45 [44968.597585] Call Trace: 2018-04-08 13:24:45 [44968.600465] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:45 [44968.607501] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:45 [44968.613845] [] schedule+0x29/0x70 2018-04-08 13:24:45 [44968.619240] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:45 [44968.626801] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:45 [44968.632804] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44968.640366] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44968.647236] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44968.654714] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:45 [44968.662188] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:45 [44968.669739] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:45 [44968.676438] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44968.684437] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:45 [44968.691915] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:45 [44968.699912] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:45 [44968.707816] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:45 [44968.714512] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:45 [44968.720772] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:45 [44968.727638] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:45 [44968.734679] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:45 [44968.741368] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:45 [44968.747280] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:45 [44968.755096] [] kthread+0xcf/0xe0 2018-04-08 13:24:45 [44968.760401] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.766912] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:45 [44968.772730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:45 [44968.779238] osp-pre-11-0 S ffff88bd869daf70 0 26801 2 0x00000000 2018-04-08 13:24:46 [44968.786756] Call Trace: 2018-04-08 13:24:46 [44968.789655] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:46 [44968.797216] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44968.802606] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:46 [44968.809822] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:46 [44968.816341] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44968.822340] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:46 [44968.829288] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44968.834592] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44968.841098] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44968.846913] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44968.853426] osp-syn-11-0 S ffff88bd869deeb0 0 26802 2 0x00000000 2018-04-08 13:24:46 [44968.860943] Call Trace: 2018-04-08 13:24:46 [44968.863819] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:46 [44968.870857] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:46 [44968.877197] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44968.882587] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:46 [44968.890149] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44968.896152] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44968.903713] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44968.910582] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44968.918059] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:46 [44968.925533] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44968.933085] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:46 [44968.939784] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44968.947781] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44968.955250] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44968.963240] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:46 [44968.971148] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:46 [44968.977839] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:46 [44968.984100] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44968.990968] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:46 [44968.998008] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:46 [44969.004694] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:46 [44969.010601] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:46 [44969.018417] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44969.023722] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.030233] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44969.036052] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.042558] osp-pre-12-0 S ffff88bd8d0e0fd0 0 26806 2 0x00000000 2018-04-08 13:24:46 [44969.050077] Call Trace: 2018-04-08 13:24:46 [44969.052974] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:46 [44969.060534] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44969.065928] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:46 [44969.073140] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:46 [44969.079660] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44969.085658] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:46 [44969.092608] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44969.097914] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.104430] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44969.110244] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.116752] osp-syn-12-0 S ffff88bd8d0e1fa0 0 26807 2 0x00000000 2018-04-08 13:24:46 [44969.124268] Call Trace: 2018-04-08 13:24:46 [44969.127148] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:46 [44969.134184] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:46 [44969.140526] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44969.145924] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:46 [44969.153483] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44969.159489] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44969.167049] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44969.173916] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44969.181394] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:46 [44969.188876] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44969.196431] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:46 [44969.203131] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44969.211127] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44969.218606] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44969.226605] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:46 [44969.234509] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:46 [44969.241206] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:46 [44969.247473] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44969.254349] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:46 [44969.261387] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:46 [44969.268077] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:46 [44969.273990] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:46 [44969.281806] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44969.287108] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.293621] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44969.299439] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.305949] osp-pre-13-0 S ffff88beb3f96eb0 0 26813 2 0x00000000 2018-04-08 13:24:46 [44969.313465] Call Trace: 2018-04-08 13:24:46 [44969.316364] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:46 [44969.323923] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44969.329315] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:46 [44969.336528] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:46 [44969.343048] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44969.349049] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:46 [44969.355994] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44969.361301] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.367816] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44969.373631] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.380141] osp-syn-13-0 S ffff88beb7aa9fa0 0 26816 2 0x00000000 2018-04-08 13:24:46 [44969.387656] Call Trace: 2018-04-08 13:24:46 [44969.390537] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:46 [44969.397571] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:46 [44969.403916] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44969.409310] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:46 [44969.416870] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44969.422879] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44969.430439] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44969.437308] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44969.444784] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:46 [44969.452261] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44969.459813] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:46 [44969.466507] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44969.474502] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44969.481976] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44969.489973] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:46 [44969.497871] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:46 [44969.504563] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:46 [44969.510826] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44969.517697] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:46 [44969.524733] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:46 [44969.531423] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:46 [44969.537334] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:46 [44969.545148] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44969.550447] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.556957] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44969.562774] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.569284] osp-pre-14-0 S ffff88be5a110000 0 26819 2 0x00000000 2018-04-08 13:24:46 [44969.576793] Call Trace: 2018-04-08 13:24:46 [44969.579682] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:46 [44969.587244] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44969.592636] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:46 [44969.599848] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:46 [44969.606370] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44969.612366] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:46 [44969.619318] [] kthread+0xcf/0xe0 2018-04-08 13:24:46 [44969.624619] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.631128] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:46 [44969.636942] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:46 [44969.643452] osp-syn-14-0 S ffff88be5a110fd0 0 26821 2 0x00000000 2018-04-08 13:24:46 [44969.650967] Call Trace: 2018-04-08 13:24:46 [44969.653844] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:46 [44969.660190] [] schedule+0x29/0x70 2018-04-08 13:24:46 [44969.665583] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:46 [44969.673136] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:46 [44969.679142] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44969.686707] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44969.693582] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44969.701061] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:46 [44969.708536] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:46 [44969.716092] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:46 [44969.722793] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44969.730790] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:46 [44969.738271] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:46 [44969.746267] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:46 [44969.754169] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:46 [44969.760864] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:46 [44969.767124] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:46 [44969.773995] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:47 [44969.781035] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:47 [44969.787724] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:47 [44969.793635] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:47 [44969.801450] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44969.806757] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44969.813264] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44969.819081] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44969.825592] osp-pre-15-0 S ffff88bd8625bf40 0 26826 2 0x00000000 2018-04-08 13:24:47 [44969.833111] Call Trace: 2018-04-08 13:24:47 [44969.836009] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:47 [44969.843571] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44969.848960] [] osp_precreate_thread+0xba2/0x1260 [osp] 2018-04-08 13:24:47 [44969.856175] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:47 [44969.862692] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44969.868693] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:47 [44969.875642] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44969.880949] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44969.887466] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44969.893287] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44969.899796] osp-syn-15-0 S ffff88bd8625af70 0 26828 2 0x00000000 2018-04-08 13:24:47 [44969.907310] Call Trace: 2018-04-08 13:24:47 [44969.910188] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:47 [44969.917223] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44969.923561] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44969.928954] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:47 [44969.936507] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44969.942513] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:47 [44969.950076] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:47 [44969.956947] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:47 [44969.964429] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:47 [44969.971907] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:47 [44969.979464] [] ? select_task_rq_fair+0x549/0x700 2018-04-08 13:24:47 [44969.986162] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:47 [44969.994153] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:47 [44970.001632] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:47 [44970.009631] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:47 [44970.017535] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:47 [44970.024230] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:47 [44970.030492] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:47 [44970.037368] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:47 [44970.044408] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:47 [44970.051093] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:47 [44970.057007] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:47 [44970.064825] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.070130] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.076638] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.082455] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.088968] osp_up1-0 S ffff88bd86258fd0 0 26833 2 0x00000000 2018-04-08 13:24:47 [44970.096481] Call Trace: 2018-04-08 13:24:47 [44970.099363] [] ? osp_get_next_request+0x2d/0x1a0 [osp] 2018-04-08 13:24:47 [44970.106578] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.111969] [] osp_send_update_thread+0x2f8/0x600 [osp] 2018-04-08 13:24:47 [44970.119270] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.125272] [] ? osp_invalidate_request+0x3a0/0x3a0 [osp] 2018-04-08 13:24:47 [44970.132753] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.138064] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.144579] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.150403] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.156910] osp_up2-0 S ffff88bdde92dee0 0 26834 2 0x00000000 2018-04-08 13:24:47 [44970.164429] Call Trace: 2018-04-08 13:24:47 [44970.167314] [] ? osp_get_next_request+0x2d/0x1a0 [osp] 2018-04-08 13:24:47 [44970.174523] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.179918] [] osp_send_update_thread+0x2f8/0x600 [osp] 2018-04-08 13:24:47 [44970.187216] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.193223] [] ? osp_invalidate_request+0x3a0/0x3a0 [osp] 2018-04-08 13:24:47 [44970.200699] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.206014] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.212540] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.218362] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.224879] lquota_wb_dagg- S ffff88bd94712f70 0 27000 2 0x00000000 2018-04-08 13:24:47 [44970.232404] Call Trace: 2018-04-08 13:24:47 [44970.235288] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.240685] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:47 [44970.246943] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:47 [44970.253376] [] ? qsd_job_pending+0x7e/0x1b0 [lquota] 2018-04-08 13:24:47 [44970.260416] [] qsd_upd_thread+0x9f7/0xd40 [lquota] 2018-04-08 13:24:47 [44970.267276] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:47 [44970.273187] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.279181] [] ? qsd_upd_add+0xf0/0xf0 [lquota] 2018-04-08 13:24:47 [44970.285783] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.291079] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.297591] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.303401] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.309902] dist_txn-0 S ffff88bddae9cf10 0 27005 2 0x00000000 2018-04-08 13:24:47 [44970.317407] Call Trace: 2018-04-08 13:24:47 [44970.320278] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:47 [44970.327309] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44970.333638] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.339038] [] distribute_txn_commit_thread+0x9ac/0xca0 [ptlrpc] 2018-04-08 13:24:47 [44970.347108] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.353114] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] 2018-04-08 13:24:47 [44970.360401] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.365699] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.372213] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.378028] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.384535] tx_commit_cb S ffff885ea46e1fa0 0 27954 2 0x00000000 2018-04-08 13:24:47 [44970.392041] Call Trace: 2018-04-08 13:24:47 [44970.394915] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.400298] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:47 [44970.406711] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.412693] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:47 [44970.419625] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.424911] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.431409] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.437217] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.443717] mdt_rdpg01_002 S ffff88bd83972f70 0 27978 2 0x00000000 2018-04-08 13:24:47 [44970.451223] Call Trace: 2018-04-08 13:24:47 [44970.454090] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44970.460411] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.465805] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:47 [44970.472905] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.478902] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:47 [44970.485586] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:47 [44970.493378] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.498666] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.505161] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.510971] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.517467] mdt_rdpg01_003 S ffff88bd83973f40 0 27979 2 0x00000000 2018-04-08 13:24:47 [44970.524965] Call Trace: 2018-04-08 13:24:47 [44970.527822] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44970.534153] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.539543] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:47 [44970.546648] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.552647] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:47 [44970.559339] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:47 [44970.567142] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.572439] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.578944] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.584761] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.591273] mdt01_008 S ffff88beb7a3cf10 0 28410 2 0x00000000 2018-04-08 13:24:47 [44970.598789] Call Trace: 2018-04-08 13:24:47 [44970.601657] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44970.607995] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.613394] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:47 [44970.620504] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.626510] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:47 [44970.633202] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:47 [44970.641010] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.646308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.652808] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.658618] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.665119] mdt00_007 S ffff88bd83b96eb0 0 28411 2 0x00000000 2018-04-08 13:24:47 [44970.672628] Call Trace: 2018-04-08 13:24:47 [44970.675499] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44970.681833] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.687224] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:47 [44970.694342] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.700343] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:47 [44970.707036] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:47 [44970.714848] [] kthread+0xcf/0xe0 2018-04-08 13:24:47 [44970.720146] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.726660] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:47 [44970.732476] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:47 [44970.738981] ldlm_cn00_007 S ffff88bd83b91fa0 0 28412 2 0x00000000 2018-04-08 13:24:47 [44970.746488] Call Trace: 2018-04-08 13:24:47 [44970.749361] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:47 [44970.755698] [] schedule+0x29/0x70 2018-04-08 13:24:47 [44970.761098] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:47 [44970.768217] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:47 [44970.774224] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:48 [44970.780925] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:48 [44970.788732] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44970.794033] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44970.800541] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44970.806359] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44970.812867] osp_up0-1 S ffff88beb3f90000 0 28705 2 0x00000000 2018-04-08 13:24:48 [44970.820382] Call Trace: 2018-04-08 13:24:48 [44970.823257] [] ? osp_get_next_request+0x2d/0x1a0 [osp] 2018-04-08 13:24:48 [44970.830459] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44970.835847] [] osp_send_update_thread+0x2f8/0x600 [osp] 2018-04-08 13:24:48 [44970.843134] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44970.849128] [] ? osp_invalidate_request+0x3a0/0x3a0 [osp] 2018-04-08 13:24:48 [44970.856599] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44970.861901] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44970.868413] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44970.874230] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44970.880742] osp-pre-0-1 S ffff88bd86259fa0 0 28706 2 0x00000000 2018-04-08 13:24:48 [44970.888255] Call Trace: 2018-04-08 13:24:48 [44970.891130] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:48 [44970.896776] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44970.902164] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:48 [44970.910164] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:48 [44970.917296] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:48 [44970.925208] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:48 [44970.932763] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44970.938755] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:48 [44970.945703] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:48 [44970.952910] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:48 [44970.959429] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44970.965425] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:48 [44970.972367] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44970.977662] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44970.984174] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44970.989989] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44970.996492] osp-syn-0-1 S ffff88bd869dbf40 0 28708 2 0x00000000 2018-04-08 13:24:48 [44971.004007] Call Trace: 2018-04-08 13:24:48 [44971.006885] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:48 [44971.013920] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:48 [44971.020258] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44971.025642] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:48 [44971.033194] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.039195] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:48 [44971.046757] [] ? llog_process_or_fork+0x56/0x450 [obdclass] 2018-04-08 13:24:48 [44971.054394] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:48 [44971.061266] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:48 [44971.068743] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:48 [44971.076220] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:48 [44971.083776] [] ? llog_process_or_fork+0x56/0x450 [obdclass] 2018-04-08 13:24:48 [44971.091418] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:48 [44971.099405] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:48 [44971.106879] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:48 [44971.114876] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:48 [44971.122787] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:48 [44971.129479] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:48 [44971.135738] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:48 [44971.142606] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:48 [44971.149638] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:48 [44971.156317] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:48 [44971.162223] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:48 [44971.170031] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44971.175328] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.181841] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44971.187656] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.194167] osp-pre-1-1 S ffff88beb259eeb0 0 28710 2 0x00000000 2018-04-08 13:24:48 [44971.201682] Call Trace: 2018-04-08 13:24:48 [44971.204556] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:48 [44971.210197] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44971.215584] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:48 [44971.223585] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:48 [44971.230714] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:48 [44971.238629] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:48 [44971.246175] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.252163] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:48 [44971.259111] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:48 [44971.266310] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:48 [44971.272818] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.278809] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:48 [44971.285752] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44971.291049] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.297564] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44971.303380] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.309891] osp-syn-1-1 S ffff88bd84cc0000 0 28712 2 0x00000000 2018-04-08 13:24:48 [44971.317403] Call Trace: 2018-04-08 13:24:48 [44971.320279] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:48 [44971.327311] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:48 [44971.333647] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44971.339035] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:48 [44971.346586] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.352581] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:48 [44971.360136] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:48 [44971.367002] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:48 [44971.374474] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:48 [44971.381948] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:48 [44971.389499] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:48 [44971.396009] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:48 [44971.402182] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:48 [44971.410173] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:48 [44971.417642] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:48 [44971.425630] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:48 [44971.433525] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:48 [44971.440206] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:48 [44971.446457] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:48 [44971.453321] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:48 [44971.460352] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:48 [44971.467032] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:48 [44971.472938] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:48 [44971.480746] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44971.486040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.492545] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44971.498364] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.504871] osp-pre-2-1 S ffff88be5ef18fd0 0 28717 2 0x00000000 2018-04-08 13:24:48 [44971.512378] Call Trace: 2018-04-08 13:24:48 [44971.515251] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:48 [44971.520894] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44971.526279] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:48 [44971.534284] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:48 [44971.541418] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:48 [44971.549333] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:48 [44971.556881] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.562869] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:48 [44971.569815] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:48 [44971.577019] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:48 [44971.583534] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.589525] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:48 [44971.596468] [] kthread+0xcf/0xe0 2018-04-08 13:24:48 [44971.601763] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.608276] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:48 [44971.614093] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:48 [44971.620605] osp-syn-2-1 S ffff88be5ef1dee0 0 28720 2 0x00000000 2018-04-08 13:24:48 [44971.628117] Call Trace: 2018-04-08 13:24:48 [44971.630993] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:48 [44971.638017] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:48 [44971.644358] [] schedule+0x29/0x70 2018-04-08 13:24:48 [44971.649741] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:48 [44971.657291] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:48 [44971.663286] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:48 [44971.670841] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:48 [44971.677700] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:48 [44971.685171] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:48 [44971.692642] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:48 [44971.700188] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:48 [44971.706698] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:48 [44971.712871] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:48 [44971.720860] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:48 [44971.728331] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:48 [44971.736318] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:48 [44971.744213] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:48 [44971.750899] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:48 [44971.757144] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:48 [44971.764010] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:48 [44971.771041] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:49 [44971.777722] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:49 [44971.783630] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:49 [44971.791438] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44971.796733] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44971.803243] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44971.809061] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44971.815570] osp-pre-3-1 S ffff88beb453cf10 0 28725 2 0x00000000 2018-04-08 13:24:49 [44971.823084] Call Trace: 2018-04-08 13:24:49 [44971.825957] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:49 [44971.831600] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44971.836987] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:49 [44971.844987] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:49 [44971.852117] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:49 [44971.860028] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:49 [44971.867576] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44971.873569] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:49 [44971.880511] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:49 [44971.887713] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:49 [44971.894224] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44971.900213] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:49 [44971.907156] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44971.912453] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44971.918965] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44971.924783] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44971.931292] osp-syn-3-1 S ffff88beb4539fa0 0 28726 2 0x00000000 2018-04-08 13:24:49 [44971.938806] Call Trace: 2018-04-08 13:24:49 [44971.941681] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:49 [44971.948707] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:49 [44971.955042] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44971.960429] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:49 [44971.967979] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44971.973975] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:49 [44971.981530] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:49 [44971.988397] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:49 [44971.995868] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:49 [44972.003336] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:49 [44972.010887] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:49 [44972.017395] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:49 [44972.023566] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:49 [44972.031556] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:49 [44972.039026] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:49 [44972.047016] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:49 [44972.054911] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:49 [44972.061592] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:49 [44972.067843] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:49 [44972.074705] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:49 [44972.081741] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:49 [44972.088422] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:49 [44972.094322] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:49 [44972.102133] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44972.107428] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.113932] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44972.119749] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.126257] osp-pre-4-1 S ffff88beb4538000 0 28727 2 0x00000000 2018-04-08 13:24:49 [44972.133762] Call Trace: 2018-04-08 13:24:49 [44972.136628] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:49 [44972.142271] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44972.147660] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:49 [44972.155659] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:49 [44972.162791] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:49 [44972.170700] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:49 [44972.178250] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44972.184243] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:49 [44972.191183] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:49 [44972.198383] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:49 [44972.204893] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44972.210883] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:49 [44972.217826] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44972.223122] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.229629] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44972.235445] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.241957] osp-syn-4-1 S ffff88beb453dee0 0 28728 2 0x00000000 2018-04-08 13:24:49 [44972.249469] Call Trace: 2018-04-08 13:24:49 [44972.252343] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:49 [44972.259369] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:49 [44972.265709] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44972.271091] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:49 [44972.278641] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44972.284638] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:49 [44972.292194] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:49 [44972.299061] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:49 [44972.306528] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:49 [44972.314002] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:49 [44972.321549] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:49 [44972.328061] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:49 [44972.334227] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:49 [44972.342213] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:49 [44972.349679] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:49 [44972.357670] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:49 [44972.365565] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:49 [44972.372246] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:49 [44972.378497] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:49 [44972.385358] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:49 [44972.392383] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:49 [44972.399066] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:49 [44972.404973] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:49 [44972.412779] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44972.418073] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.424577] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44972.430394] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.436905] osp-pre-5-1 S ffff88beb4538fd0 0 28731 2 0x00000000 2018-04-08 13:24:49 [44972.444412] Call Trace: 2018-04-08 13:24:49 [44972.447284] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:49 [44972.452923] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44972.458303] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:49 [44972.466307] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:49 [44972.473432] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:49 [44972.481337] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:49 [44972.488886] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44972.494877] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:49 [44972.501819] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:49 [44972.509022] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:49 [44972.515531] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44972.521523] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:49 [44972.528464] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44972.533762] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.540275] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44972.546091] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.552603] osp-syn-5-1 S ffff88bd83e8bf40 0 28734 2 0x00000000 2018-04-08 13:24:49 [44972.560116] Call Trace: 2018-04-08 13:24:49 [44972.562990] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:49 [44972.570016] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:49 [44972.576351] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44972.581739] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:49 [44972.589290] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:49 [44972.595283] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:49 [44972.602838] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:49 [44972.609700] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:49 [44972.617169] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:49 [44972.624640] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:49 [44972.632188] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:49 [44972.638697] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:49 [44972.644867] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:49 [44972.652858] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:49 [44972.660327] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:49 [44972.668317] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:49 [44972.676209] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:49 [44972.682891] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:49 [44972.689144] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:49 [44972.696006] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:49 [44972.703041] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:49 [44972.709724] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:49 [44972.715627] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:49 [44972.723434] [] kthread+0xcf/0xe0 2018-04-08 13:24:49 [44972.728730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.735242] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:49 [44972.741061] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:49 [44972.747569] osp-pre-6-1 S ffff88bd83e89fa0 0 28737 2 0x00000000 2018-04-08 13:24:49 [44972.755084] Call Trace: 2018-04-08 13:24:49 [44972.757954] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:49 [44972.763598] [] schedule+0x29/0x70 2018-04-08 13:24:49 [44972.768985] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:50 [44972.776987] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:50 [44972.784114] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:50 [44972.792027] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:50 [44972.799579] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44972.805567] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44972.812509] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:50 [44972.819711] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:50 [44972.826222] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44972.832212] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44972.839155] [] kthread+0xcf/0xe0 2018-04-08 13:24:50 [44972.844450] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44972.850964] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:50 [44972.856780] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44972.863292] osp-syn-6-1 S ffff88bd83e8af70 0 28738 2 0x00000000 2018-04-08 13:24:50 [44972.870804] Call Trace: 2018-04-08 13:24:50 [44972.873681] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:50 [44972.880715] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:50 [44972.887051] [] schedule+0x29/0x70 2018-04-08 13:24:50 [44972.892438] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:50 [44972.899984] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44972.905983] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:50 [44972.913537] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:50 [44972.920395] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:50 [44972.927865] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:50 [44972.935334] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:50 [44972.942886] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:50 [44972.949396] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:50 [44972.955564] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:50 [44972.963546] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:50 [44972.971017] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:50 [44972.979007] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:50 [44972.986904] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:50 [44972.993582] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:50 [44972.999831] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:50 [44973.006697] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:50 [44973.013729] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:50 [44973.020407] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:50 [44973.026315] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:50 [44973.034122] [] kthread+0xcf/0xe0 2018-04-08 13:24:50 [44973.039419] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.045930] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:50 [44973.051750] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.058257] osp-pre-7-1 S ffff88bd84cc2f70 0 28741 2 0x00000000 2018-04-08 13:24:50 [44973.065772] Call Trace: 2018-04-08 13:24:50 [44973.068646] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:50 [44973.074287] [] schedule+0x29/0x70 2018-04-08 13:24:50 [44973.079676] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:50 [44973.087678] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:50 [44973.094813] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:50 [44973.102725] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:50 [44973.110273] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.116266] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44973.123208] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:50 [44973.130409] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:50 [44973.136920] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.142911] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44973.149853] [] kthread+0xcf/0xe0 2018-04-08 13:24:50 [44973.155150] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.161663] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:50 [44973.167478] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.173989] osp-syn-7-1 S ffff88bd946e9fa0 0 28743 2 0x00000000 2018-04-08 13:24:50 [44973.181503] Call Trace: 2018-04-08 13:24:50 [44973.184379] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:50 [44973.191403] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:50 [44973.197741] [] schedule+0x29/0x70 2018-04-08 13:24:50 [44973.203124] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:50 [44973.210675] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.216670] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:50 [44973.224224] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:50 [44973.231083] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:50 [44973.238555] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:50 [44973.246025] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:50 [44973.253576] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:50 [44973.260083] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:50 [44973.266254] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:50 [44973.274248] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:50 [44973.281715] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:50 [44973.289706] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:50 [44973.297600] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:50 [44973.304283] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:50 [44973.310531] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:50 [44973.317394] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:50 [44973.324428] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:50 [44973.331109] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:50 [44973.337013] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:50 [44973.344823] [] kthread+0xcf/0xe0 2018-04-08 13:24:50 [44973.350116] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.356629] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:50 [44973.362447] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.368957] osp-pre-8-1 S ffff88bd946eaf70 0 28747 2 0x00000000 2018-04-08 13:24:50 [44973.376473] Call Trace: 2018-04-08 13:24:50 [44973.379344] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:50 [44973.384985] [] schedule+0x29/0x70 2018-04-08 13:24:50 [44973.390373] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:50 [44973.398374] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:50 [44973.405505] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:50 [44973.413415] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:50 [44973.420964] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.426954] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44973.433898] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:50 [44973.441097] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:50 [44973.447608] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.453600] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44973.460541] [] kthread+0xcf/0xe0 2018-04-08 13:24:50 [44973.465840] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.472351] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:50 [44973.478166] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.484679] osp-syn-8-1 S ffff88beb4c19fa0 0 28749 2 0x00000000 2018-04-08 13:24:50 [44973.492190] Call Trace: 2018-04-08 13:24:50 [44973.495066] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:50 [44973.502091] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:50 [44973.508427] [] schedule+0x29/0x70 2018-04-08 13:24:50 [44973.513814] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:50 [44973.521366] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.527359] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:50 [44973.534907] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:50 [44973.541766] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:50 [44973.549238] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:50 [44973.556705] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:50 [44973.564253] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:50 [44973.570766] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:50 [44973.576934] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:50 [44973.584924] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:50 [44973.592395] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:50 [44973.600386] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:50 [44973.608279] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:50 [44973.614961] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:50 [44973.621211] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:50 [44973.628073] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:50 [44973.635108] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:50 [44973.641789] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:50 [44973.647693] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:50 [44973.655503] [] kthread+0xcf/0xe0 2018-04-08 13:24:50 [44973.660797] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.667308] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:50 [44973.673128] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:50 [44973.679636] osp-pre-9-1 S ffff88beb4c1cf10 0 28751 2 0x00000000 2018-04-08 13:24:50 [44973.687152] Call Trace: 2018-04-08 13:24:50 [44973.690023] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:50 [44973.695666] [] schedule+0x29/0x70 2018-04-08 13:24:50 [44973.701052] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:50 [44973.709054] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:50 [44973.716184] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:50 [44973.724095] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:50 [44973.731642] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.737636] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:50 [44973.744577] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:50 [44973.751777] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:50 [44973.758288] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:50 [44973.764282] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44973.771221] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44973.776519] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44973.783029] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44973.788848] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44973.795359] osp-syn-9-1 S ffff88bdde820fd0 0 28754 2 0x00000000 2018-04-08 13:24:51 [44973.802872] Call Trace: 2018-04-08 13:24:51 [44973.805746] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:51 [44973.812771] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:51 [44973.819107] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44973.824495] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:51 [44973.832047] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44973.838040] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:51 [44973.845595] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:51 [44973.852454] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:51 [44973.859925] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:51 [44973.867396] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:51 [44973.874943] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:51 [44973.881455] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:51 [44973.887624] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:51 [44973.895616] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:51 [44973.903084] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:51 [44973.911073] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:51 [44973.918969] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:51 [44973.925650] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:51 [44973.931902] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:51 [44973.938765] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:51 [44973.945800] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:51 [44973.952484] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:51 [44973.958390] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:51 [44973.966199] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44973.971494] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44973.978000] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44973.983814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44973.990327] osp-pre-10-1 S ffff885ea3680fd0 0 28761 2 0x00000000 2018-04-08 13:24:51 [44973.997831] Call Trace: 2018-04-08 13:24:51 [44974.000705] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:51 [44974.006345] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44974.011733] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:51 [44974.019736] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:51 [44974.026864] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:51 [44974.034776] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:51 [44974.042325] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.048316] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44974.055259] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:51 [44974.062459] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:51 [44974.068967] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.074960] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44974.081902] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44974.087198] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.093713] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44974.099528] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.106040] osp-syn-10-1 S ffff885eb9a49fa0 0 28762 2 0x00000000 2018-04-08 13:24:51 [44974.113553] Call Trace: 2018-04-08 13:24:51 [44974.116428] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:51 [44974.123454] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:51 [44974.129788] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44974.135177] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:51 [44974.142727] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.148720] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:51 [44974.156273] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:51 [44974.163134] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:51 [44974.170607] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:51 [44974.178077] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:51 [44974.185626] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:51 [44974.192134] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:51 [44974.198305] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:51 [44974.206294] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:51 [44974.213766] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:51 [44974.221753] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:51 [44974.229651] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:51 [44974.236332] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:51 [44974.242583] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:51 [44974.249444] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:51 [44974.256478] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:51 [44974.263159] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:51 [44974.269062] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:51 [44974.276870] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44974.282165] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.288672] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44974.294487] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.300999] osp-pre-11-1 S ffff885ebbc18000 0 28766 2 0x00000000 2018-04-08 13:24:51 [44974.308511] Call Trace: 2018-04-08 13:24:51 [44974.311387] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:51 [44974.317025] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44974.322405] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:51 [44974.330404] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:51 [44974.337537] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:51 [44974.345449] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:51 [44974.352996] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.358986] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44974.365931] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:51 [44974.373129] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:51 [44974.379641] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.385632] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44974.392575] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44974.397872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.404383] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44974.410202] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.416714] osp-syn-11-1 S ffff885ebd97af70 0 28769 2 0x00000000 2018-04-08 13:24:51 [44974.424225] Call Trace: 2018-04-08 13:24:51 [44974.427101] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:51 [44974.434134] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:51 [44974.440471] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44974.445855] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:51 [44974.453404] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.459406] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:51 [44974.466954] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:51 [44974.473814] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:51 [44974.481285] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:51 [44974.488757] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:51 [44974.496305] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:51 [44974.502815] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:51 [44974.508987] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:51 [44974.516979] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:51 [44974.524445] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:51 [44974.532433] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:51 [44974.540330] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:51 [44974.547010] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:51 [44974.553261] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:51 [44974.560124] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:51 [44974.567156] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:51 [44974.573838] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:51 [44974.579744] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:51 [44974.587552] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44974.592847] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.599359] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44974.605178] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.611685] osp-pre-12-1 S ffff88be65f9af70 0 28775 2 0x00000000 2018-04-08 13:24:51 [44974.619185] Call Trace: 2018-04-08 13:24:51 [44974.622055] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:51 [44974.627697] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44974.633084] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:51 [44974.641086] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:51 [44974.648216] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:51 [44974.656128] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:51 [44974.663676] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.669667] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44974.676611] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:51 [44974.683810] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:51 [44974.690320] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:51 [44974.696312] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:51 [44974.703254] [] kthread+0xcf/0xe0 2018-04-08 13:24:51 [44974.708550] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.715057] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:51 [44974.720873] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:51 [44974.727383] osp-syn-12-1 S ffff88be65f9bf40 0 28777 2 0x00000000 2018-04-08 13:24:51 [44974.734895] Call Trace: 2018-04-08 13:24:51 [44974.737770] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:51 [44974.744796] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:51 [44974.751134] [] schedule+0x29/0x70 2018-04-08 13:24:51 [44974.756519] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:52 [44974.764070] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44974.770064] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44974.777618] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44974.784479] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44974.791948] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:52 [44974.799418] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44974.806968] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:52 [44974.813476] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:52 [44974.819647] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:52 [44974.827634] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44974.835100] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:52 [44974.843089] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:52 [44974.850987] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:52 [44974.857665] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:52 [44974.863916] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44974.870780] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:52 [44974.877812] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:52 [44974.884495] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:52 [44974.890399] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:52 [44974.898205] [] kthread+0xcf/0xe0 2018-04-08 13:24:52 [44974.903501] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44974.910013] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:52 [44974.915831] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44974.922340] osp-pre-13-1 S ffff885e9c976eb0 0 28781 2 0x00000000 2018-04-08 13:24:52 [44974.929845] Call Trace: 2018-04-08 13:24:52 [44974.932719] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:52 [44974.938361] [] schedule+0x29/0x70 2018-04-08 13:24:52 [44974.943750] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:52 [44974.951750] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:52 [44974.958878] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:52 [44974.966794] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:52 [44974.974339] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44974.980330] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:52 [44974.987274] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:52 [44974.994473] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:52 [44975.000981] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.006978] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:52 [44975.013917] [] kthread+0xcf/0xe0 2018-04-08 13:24:52 [44975.019216] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.025727] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:52 [44975.031544] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.038055] osp-syn-13-1 S ffff88012cbb9fa0 0 28784 2 0x00000000 2018-04-08 13:24:52 [44975.045567] Call Trace: 2018-04-08 13:24:52 [44975.048444] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:52 [44975.055468] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:52 [44975.061804] [] schedule+0x29/0x70 2018-04-08 13:24:52 [44975.067192] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:52 [44975.074743] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.080737] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44975.088292] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44975.095151] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44975.102622] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:52 [44975.110093] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44975.117644] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:52 [44975.124151] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:52 [44975.130322] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:52 [44975.138313] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44975.145780] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:52 [44975.153771] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:52 [44975.161666] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:52 [44975.168347] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:52 [44975.174597] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44975.181462] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:52 [44975.188493] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:52 [44975.195173] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:52 [44975.201078] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:52 [44975.208887] [] kthread+0xcf/0xe0 2018-04-08 13:24:52 [44975.214183] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.220695] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:52 [44975.226513] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.233022] osp-pre-14-1 S ffff88012cbbcf10 0 28787 2 0x00000000 2018-04-08 13:24:52 [44975.240536] Call Trace: 2018-04-08 13:24:52 [44975.243410] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:52 [44975.249053] [] schedule+0x29/0x70 2018-04-08 13:24:52 [44975.254438] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:52 [44975.262439] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:52 [44975.269569] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:52 [44975.277484] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:52 [44975.285034] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.291028] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:52 [44975.297970] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:52 [44975.305174] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:52 [44975.311680] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.317677] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:52 [44975.324620] [] kthread+0xcf/0xe0 2018-04-08 13:24:52 [44975.329914] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.336425] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:52 [44975.342245] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.348752] osp-syn-14-1 S ffff885e9cd84f10 0 28788 2 0x00000000 2018-04-08 13:24:52 [44975.356266] Call Trace: 2018-04-08 13:24:52 [44975.359140] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:52 [44975.366171] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:52 [44975.372502] [] schedule+0x29/0x70 2018-04-08 13:24:52 [44975.377890] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:52 [44975.385437] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.391435] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44975.398988] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44975.405848] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44975.413320] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:52 [44975.420791] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44975.428338] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:52 [44975.434847] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:52 [44975.441017] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:52 [44975.449011] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44975.456476] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:52 [44975.464469] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:52 [44975.472363] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:52 [44975.479045] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:52 [44975.485295] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44975.492157] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:52 [44975.499189] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:52 [44975.505871] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:52 [44975.511776] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:52 [44975.519585] [] kthread+0xcf/0xe0 2018-04-08 13:24:52 [44975.524880] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.531391] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:52 [44975.537211] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.543719] osp-pre-15-1 S ffff885e9cd85ee0 0 28791 2 0x00000000 2018-04-08 13:24:52 [44975.551223] Call Trace: 2018-04-08 13:24:52 [44975.554098] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:52 [44975.559740] [] schedule+0x29/0x70 2018-04-08 13:24:52 [44975.565125] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:52 [44975.573129] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:52 [44975.580256] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:52 [44975.588169] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:52 [44975.595717] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.601707] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:52 [44975.608653] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:52 [44975.615852] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:52 [44975.622364] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.628353] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:52 [44975.635298] [] kthread+0xcf/0xe0 2018-04-08 13:24:52 [44975.640593] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.647106] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:52 [44975.652923] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:52 [44975.659433] osp-syn-15-1 S ffff885e9cd82f70 0 28793 2 0x00000000 2018-04-08 13:24:52 [44975.666938] Call Trace: 2018-04-08 13:24:52 [44975.669813] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:52 [44975.676839] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:52 [44975.683174] [] schedule+0x29/0x70 2018-04-08 13:24:52 [44975.688561] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:52 [44975.696109] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:52 [44975.702106] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44975.709666] [] ? llog_process_or_fork+0x56/0x450 [obdclass] 2018-04-08 13:24:52 [44975.717303] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:52 [44975.724163] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:52 [44975.731639] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:52 [44975.739112] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:52 [44975.746660] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:52 [44975.753171] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:53 [44975.759339] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:53 [44975.767321] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:53 [44975.774792] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:53 [44975.782783] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:53 [44975.790675] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:53 [44975.797359] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:53 [44975.803612] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:53 [44975.810478] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:53 [44975.817507] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:53 [44975.824187] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:53 [44975.830090] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:53 [44975.837899] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44975.843197] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44975.849709] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44975.855527] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44975.862032] osp_up2-1 S ffff88beb3f93f40 0 28796 2 0x00000000 2018-04-08 13:24:53 [44975.869541] Call Trace: 2018-04-08 13:24:53 [44975.872416] [] ? osp_get_next_request+0x2d/0x1a0 [osp] 2018-04-08 13:24:53 [44975.879620] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44975.885010] [] osp_send_update_thread+0x2f8/0x600 [osp] 2018-04-08 13:24:53 [44975.892299] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44975.898292] [] ? osp_invalidate_request+0x3a0/0x3a0 [osp] 2018-04-08 13:24:53 [44975.905755] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44975.911055] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44975.917567] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44975.923386] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44975.929896] ldlm_cb00_002 S ffff88beb7a38000 0 29064 2 0x00000000 2018-04-08 13:24:53 [44975.937415] Call Trace: 2018-04-08 13:24:53 [44975.940296] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:53 [44975.946642] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44975.952048] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:24:53 [44975.959169] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44975.965186] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:24:53 [44975.971874] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:53 [44975.977795] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:24:53 [44975.985604] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44975.990902] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44975.997414] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.003230] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.009737] ldlm_bl_03 S ffff88beb7a3bf40 0 29065 2 0x00000000 2018-04-08 13:24:53 [44976.017253] Call Trace: 2018-04-08 13:24:53 [44976.020134] [] ? obd_stale_export_get+0x31/0x190 [obdclass] 2018-04-08 13:24:53 [44976.027775] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.033176] [] ldlm_bl_thread_main+0x42d/0x700 [ptlrpc] 2018-04-08 13:24:53 [44976.040475] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.046491] [] ? ldlm_handle_bl_callback+0x410/0x410 [ptlrpc] 2018-04-08 13:24:53 [44976.054312] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.059626] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.066144] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.071968] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.078488] qsd_reint_1.dag S ffff885e68981fa0 0 29158 2 0x00000000 2018-04-08 13:24:53 [44976.086010] Call Trace: 2018-04-08 13:24:53 [44976.088890] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:53 [44976.095234] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.100630] [] qsd_reint_main+0xc76/0xe40 [lquota] 2018-04-08 13:24:53 [44976.107496] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.113499] [] ? qsd_reconciliation+0xa90/0xa90 [lquota] 2018-04-08 13:24:53 [44976.120882] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.126186] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.132702] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.138528] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.145041] lquota_wb_dagg- S ffff885eba569fa0 0 29166 2 0x00000000 2018-04-08 13:24:53 [44976.152568] Call Trace: 2018-04-08 13:24:53 [44976.155444] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.160835] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:53 [44976.167090] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:53 [44976.173515] [] ? qsd_job_pending+0x7e/0x1b0 [lquota] 2018-04-08 13:24:53 [44976.180547] [] qsd_upd_thread+0x9f7/0xd40 [lquota] 2018-04-08 13:24:53 [44976.187407] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:53 [44976.193311] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.199300] [] ? qsd_upd_add+0xf0/0xf0 [lquota] 2018-04-08 13:24:53 [44976.205898] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.211195] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.217698] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.223511] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.230013] dist_txn-1 S ffff88606d540000 0 29205 2 0x00000000 2018-04-08 13:24:53 [44976.237520] Call Trace: 2018-04-08 13:24:53 [44976.240389] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:53 [44976.247413] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:53 [44976.253748] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.259145] [] distribute_txn_commit_thread+0x9ac/0xca0 [ptlrpc] 2018-04-08 13:24:53 [44976.267216] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.273224] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] 2018-04-08 13:24:53 [44976.280512] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.285809] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.292318] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.298141] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.304642] lod0001_rec0000 R running task 0 29210 2 0x00000000 2018-04-08 13:24:53 [44976.312151] Call Trace: 2018-04-08 13:24:53 [44976.315023] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:53 [44976.320660] [] ? schedule+0x29/0x70 2018-04-08 13:24:53 [44976.326209] [] ? schedule_timeout+0x174/0x2c0 2018-04-08 13:24:53 [44976.332636] [] ? ptlrpc_send_new_req+0x468/0xa60 [ptlrpc] 2018-04-08 13:24:53 [44976.340085] [] ? list_del+0xd/0x30 2018-04-08 13:24:53 [44976.345559] [] ? ptlrpc_set_wait+0x4c0/0x910 [ptlrpc] 2018-04-08 13:24:53 [44976.352672] [] ? lustre_get_jobid+0x99/0x4d0 [obdclass] 2018-04-08 13:24:53 [44976.359953] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.365951] [] ? ptlrpc_prep_bulk_imp+0x5d/0x180 [ptlrpc] 2018-04-08 13:24:53 [44976.373413] [] ? ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] 2018-04-08 13:24:53 [44976.380620] [] ? ptlrpc_req_finished+0x10/0x20 [ptlrpc] 2018-04-08 13:24:53 [44976.387893] [] ? osp_md_read+0x4cd/0x8c0 [osp] 2018-04-08 13:24:53 [44976.394383] [] ? osp_attr_get+0x102/0x6f0 [osp] 2018-04-08 13:24:53 [44976.400976] [] ? dt_read+0x14/0x50 [obdclass] 2018-04-08 13:24:53 [44976.407390] [] ? llog_osd_next_block+0x36a/0xbe0 [obdclass] 2018-04-08 13:24:53 [44976.415002] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:53 [44976.420895] [] ? llog_process_thread+0x294/0x1180 [obdclass] 2018-04-08 13:24:53 [44976.428611] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:53 [44976.436586] [] ? llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:53 [44976.444213] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:53 [44976.452191] [] ? llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:53 [44976.460250] [] ? lod_sub_prep_llog+0x24a/0x783 [lod] 2018-04-08 13:24:53 [44976.467271] [] ? lodname2mdt_index+0x2f0/0x2f0 [lod] 2018-04-08 13:24:53 [44976.474292] [] ? llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:53 [44976.481486] [] ? lod_sub_recovery_thread+0x419/0xaf0 [lod] 2018-04-08 13:24:53 [44976.489025] [] ? lod_trans_stop+0x340/0x340 [lod] 2018-04-08 13:24:53 [44976.495783] [] ? kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.501242] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.507736] [] ? ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.513710] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.520202] tgt_recover_1 D ffff88bd82cfeeb0 0 29650 2 0x00000000 2018-04-08 13:24:53 [44976.527705] Call Trace: 2018-04-08 13:24:53 [44976.530569] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.535944] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:24:53 [44976.542178] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:24:53 [44976.548600] [] ? handle_recovery_req+0x270/0x270 [ptlrpc] 2018-04-08 13:24:53 [44976.556058] [] target_recovery_overseer+0xd8/0x650 [ptlrpc] 2018-04-08 13:24:53 [44976.563686] [] ? ldlm_dump_ns_write+0x90/0x90 [ptlrpc] 2018-04-08 13:24:53 [44976.570878] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:53 [44976.577541] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:53 [44976.583771] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:24:53 [44976.590012] [] target_recovery_thread+0x5d0/0x1360 [ptlrpc] 2018-04-08 13:24:53 [44976.597640] [] ? replay_request_or_update.isra.21+0x8c0/0x8c0 [ptlrpc] 2018-04-08 13:24:53 [44976.606210] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.611488] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.617982] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.623780] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.630263] tx_commit_cb S ffff88bd83386eb0 0 29903 2 0x00000000 2018-04-08 13:24:53 [44976.637755] Call Trace: 2018-04-08 13:24:53 [44976.640612] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.645982] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:53 [44976.652387] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.658361] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:53 [44976.665284] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.670563] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.677051] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.682849] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.689339] z_rd_int_5 S ffff88beb3f92f70 0 30343 2 0x00000000 2018-04-08 13:24:53 [44976.696822] Call Trace: 2018-04-08 13:24:53 [44976.699679] [] schedule+0x29/0x70 2018-04-08 13:24:53 [44976.705048] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:53 [44976.711455] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:53 [44976.717428] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:53 [44976.724350] [] kthread+0xcf/0xe0 2018-04-08 13:24:53 [44976.729630] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.736122] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:53 [44976.741914] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:53 [44976.748397] z_rd_int_5 S ffff88beb3f90fd0 0 30344 2 0x00000000 2018-04-08 13:24:54 [44976.755887] Call Trace: 2018-04-08 13:24:54 [44976.758734] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44976.764105] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:54 [44976.770507] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44976.776483] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:54 [44976.783407] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44976.788688] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44976.795181] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44976.800986] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44976.807479] z_rd_int_5 S ffff88bd83e88fd0 0 30349 2 0x00000000 2018-04-08 13:24:54 [44976.814973] Call Trace: 2018-04-08 13:24:54 [44976.817828] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44976.823196] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:54 [44976.829603] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44976.835581] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:54 [44976.842502] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44976.847780] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44976.854268] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44976.860066] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44976.866548] osp_up0-2 S ffff88bd833d2f70 0 30391 2 0x00000000 2018-04-08 13:24:54 [44976.874042] Call Trace: 2018-04-08 13:24:54 [44976.876904] [] ? osp_get_next_request+0x2d/0x1a0 [osp] 2018-04-08 13:24:54 [44976.884091] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44976.889457] [] osp_send_update_thread+0x2f8/0x600 [osp] 2018-04-08 13:24:54 [44976.896731] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44976.902709] [] ? osp_invalidate_request+0x3a0/0x3a0 [osp] 2018-04-08 13:24:54 [44976.910162] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44976.915445] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44976.921937] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44976.927738] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44976.934233] osp-pre-0-2 S ffff88bd833d5ee0 0 30392 2 0x00000000 2018-04-08 13:24:54 [44976.941732] Call Trace: 2018-04-08 13:24:54 [44976.944589] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:54 [44976.950219] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44976.955590] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:54 [44976.963576] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:54 [44976.970700] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:54 [44976.978601] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:54 [44976.986140] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44976.992124] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:54 [44976.999062] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:54 [44977.006260] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:54 [44977.012764] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.018746] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:54 [44977.025685] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44977.030978] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.037479] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44977.043287] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.049787] osp-syn-0-2 S ffff88bd833d0000 0 30394 2 0x00000000 2018-04-08 13:24:54 [44977.057286] Call Trace: 2018-04-08 13:24:54 [44977.060154] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:54 [44977.067182] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:54 [44977.073518] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44977.078904] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:54 [44977.086448] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.092445] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:54 [44977.100001] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:54 [44977.106866] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:54 [44977.114338] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:54 [44977.121805] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:54 [44977.129357] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:54 [44977.135865] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:54 [44977.142034] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:54 [44977.150019] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:54 [44977.157490] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:54 [44977.165483] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:54 [44977.173387] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:54 [44977.180075] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:54 [44977.186326] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:54 [44977.193192] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:54 [44977.200227] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:54 [44977.206907] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:54 [44977.212811] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:54 [44977.220621] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44977.225916] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.232427] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44977.238245] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.244753] osp-pre-1-2 S ffff88bdde824f10 0 30401 2 0x00000000 2018-04-08 13:24:54 [44977.252263] Call Trace: 2018-04-08 13:24:54 [44977.255134] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:54 [44977.260777] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44977.266162] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:54 [44977.274164] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:54 [44977.281291] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:54 [44977.289204] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:54 [44977.296755] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.302743] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:54 [44977.309689] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:54 [44977.316890] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:54 [44977.323397] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.329387] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:54 [44977.336330] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44977.341629] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.348140] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44977.353958] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.360466] osp-syn-1-2 S ffff88bd84215ee0 0 30410 2 0x00000000 2018-04-08 13:24:54 [44977.367982] Call Trace: 2018-04-08 13:24:54 [44977.370859] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:54 [44977.377890] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:54 [44977.384226] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44977.389616] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:54 [44977.397164] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.403160] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:54 [44977.410712] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:54 [44977.417572] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:54 [44977.425044] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:54 [44977.432513] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:54 [44977.440060] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:54 [44977.446570] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:54 [44977.452741] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:54 [44977.460724] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:54 [44977.468191] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:54 [44977.476182] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:54 [44977.484080] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:54 [44977.490759] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:54 [44977.497011] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:54 [44977.503876] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:54 [44977.510906] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:54 [44977.517585] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:54 [44977.523494] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:54 [44977.531298] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44977.536597] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.543108] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44977.548927] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.555434] osp-pre-2-2 S ffff88bd84212f70 0 30416 2 0x00000000 2018-04-08 13:24:54 [44977.562941] Call Trace: 2018-04-08 13:24:54 [44977.565815] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:54 [44977.571455] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44977.576841] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:54 [44977.584845] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:54 [44977.591971] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:54 [44977.599888] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:54 [44977.607432] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.613426] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:54 [44977.620369] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:54 [44977.627568] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:54 [44977.634079] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.640071] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:54 [44977.647012] [] kthread+0xcf/0xe0 2018-04-08 13:24:54 [44977.652309] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.658819] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:54 [44977.664636] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:54 [44977.671140] osp-syn-2-2 S ffff88bd82851fa0 0 30427 2 0x00000000 2018-04-08 13:24:54 [44977.678654] Call Trace: 2018-04-08 13:24:54 [44977.681529] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:54 [44977.688554] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:54 [44977.694888] [] schedule+0x29/0x70 2018-04-08 13:24:54 [44977.700277] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:54 [44977.707827] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:54 [44977.713820] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:54 [44977.721369] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:54 [44977.728226] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:54 [44977.735696] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:54 [44977.743167] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:54 [44977.750718] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:55 [44977.757222] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:55 [44977.763388] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44977.771381] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44977.778848] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44977.786838] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:55 [44977.794733] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:55 [44977.801413] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:55 [44977.807665] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:55 [44977.814527] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:55 [44977.821559] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:55 [44977.828240] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:55 [44977.834147] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:55 [44977.841954] [] kthread+0xcf/0xe0 2018-04-08 13:24:55 [44977.847249] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44977.853754] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:55 [44977.859570] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44977.866082] osp-pre-3-2 S ffff88bd82855ee0 0 30430 2 0x00000000 2018-04-08 13:24:55 [44977.873594] Call Trace: 2018-04-08 13:24:55 [44977.876469] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:55 [44977.882109] [] schedule+0x29/0x70 2018-04-08 13:24:55 [44977.887490] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:55 [44977.895490] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:55 [44977.902607] [] ? queued_spin_lock_slowpath+0xb/0xf 2018-04-08 13:24:55 [44977.909474] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:55 [44977.917022] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44977.923014] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:55 [44977.929959] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:55 [44977.937157] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:55 [44977.943669] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44977.949658] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:55 [44977.956602] [] kthread+0xcf/0xe0 2018-04-08 13:24:55 [44977.961898] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44977.968403] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:55 [44977.974221] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44977.980731] osp-syn-3-2 S ffff88be5a114f10 0 30445 2 0x00000000 2018-04-08 13:24:55 [44977.988246] Call Trace: 2018-04-08 13:24:55 [44977.991120] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:55 [44977.998144] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:55 [44978.004481] [] schedule+0x29/0x70 2018-04-08 13:24:55 [44978.009869] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:55 [44978.017418] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.023413] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:55 [44978.030969] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:55 [44978.037827] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44978.045299] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:55 [44978.052768] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:55 [44978.060315] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:55 [44978.066825] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:55 [44978.072995] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44978.080978] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44978.088447] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44978.096437] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:55 [44978.104332] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:55 [44978.111011] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:55 [44978.117267] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:55 [44978.124128] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:55 [44978.131159] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:55 [44978.137840] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:55 [44978.143747] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:55 [44978.151558] [] kthread+0xcf/0xe0 2018-04-08 13:24:55 [44978.156852] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.163364] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:55 [44978.169181] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.175691] osp-pre-4-2 S ffff88bd9b70cf10 0 30450 2 0x00000000 2018-04-08 13:24:55 [44978.183205] Call Trace: 2018-04-08 13:24:55 [44978.186080] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:55 [44978.191720] [] schedule+0x29/0x70 2018-04-08 13:24:55 [44978.197107] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:55 [44978.205109] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:55 [44978.212238] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:55 [44978.220149] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:55 [44978.227699] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.233687] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:55 [44978.240631] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:55 [44978.247831] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:55 [44978.254341] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.260335] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:55 [44978.267274] [] kthread+0xcf/0xe0 2018-04-08 13:24:55 [44978.272570] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.279077] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:55 [44978.284891] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.291396] osp-syn-4-2 S ffff88bd83b95ee0 0 30464 2 0x00000000 2018-04-08 13:24:55 [44978.298908] Call Trace: 2018-04-08 13:24:55 [44978.301785] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:55 [44978.308818] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:55 [44978.315154] [] schedule+0x29/0x70 2018-04-08 13:24:55 [44978.320541] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:55 [44978.328092] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:55 [44978.335464] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.341458] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:55 [44978.349003] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:55 [44978.355865] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44978.363341] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:55 [44978.370806] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:55 [44978.378354] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:55 [44978.384866] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:55 [44978.391035] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44978.399023] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44978.406495] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44978.414484] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:55 [44978.422378] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:55 [44978.429062] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:55 [44978.435313] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:55 [44978.442174] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:55 [44978.449207] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:55 [44978.455889] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:55 [44978.461794] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:55 [44978.469600] [] kthread+0xcf/0xe0 2018-04-08 13:24:55 [44978.474898] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.481411] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:55 [44978.487228] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.493734] osp-pre-5-2 S ffff88be5b7d1fa0 0 30468 2 0x00000000 2018-04-08 13:24:55 [44978.501243] Call Trace: 2018-04-08 13:24:55 [44978.504116] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:55 [44978.509760] [] schedule+0x29/0x70 2018-04-08 13:24:55 [44978.515144] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:55 [44978.523143] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:55 [44978.530276] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:55 [44978.538187] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:55 [44978.545736] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.551728] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:55 [44978.558669] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:55 [44978.565869] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:55 [44978.572383] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.578371] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:55 [44978.585316] [] kthread+0xcf/0xe0 2018-04-08 13:24:55 [44978.590614] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.597124] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:55 [44978.602942] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:55 [44978.609450] osp-syn-5-2 S ffff88bd83ed3f40 0 30480 2 0x00000000 2018-04-08 13:24:55 [44978.616965] Call Trace: 2018-04-08 13:24:55 [44978.619839] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:55 [44978.626864] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:55 [44978.633202] [] schedule+0x29/0x70 2018-04-08 13:24:55 [44978.638586] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:55 [44978.646139] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:55 [44978.653510] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:55 [44978.659507] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:55 [44978.667062] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:55 [44978.673921] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44978.681395] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:55 [44978.688861] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:55 [44978.696411] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:55 [44978.702922] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:55 [44978.709092] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44978.717085] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:55 [44978.724550] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:55 [44978.732539] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:55 [44978.740435] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:56 [44978.747117] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:56 [44978.753368] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44978.760230] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:56 [44978.767265] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:56 [44978.773946] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:56 [44978.779846] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:56 [44978.787657] [] kthread+0xcf/0xe0 2018-04-08 13:24:56 [44978.792952] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44978.799465] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:56 [44978.805282] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44978.811788] osp-pre-6-2 S ffff88012ca30fd0 0 30485 2 0x00000000 2018-04-08 13:24:56 [44978.819296] Call Trace: 2018-04-08 13:24:56 [44978.822170] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:56 [44978.827814] [] schedule+0x29/0x70 2018-04-08 13:24:56 [44978.833198] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:56 [44978.841199] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:56 [44978.848332] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:56 [44978.856242] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:56 [44978.863787] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44978.869781] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:56 [44978.876723] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:56 [44978.883926] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:56 [44978.890434] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44978.896427] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:56 [44978.903367] [] kthread+0xcf/0xe0 2018-04-08 13:24:56 [44978.908668] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44978.915177] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:56 [44978.920996] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44978.927505] osp-syn-6-2 S ffff885eb5abaf70 0 30499 2 0x00000000 2018-04-08 13:24:56 [44978.935017] Call Trace: 2018-04-08 13:24:56 [44978.937893] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:56 [44978.944920] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:56 [44978.951260] [] schedule+0x29/0x70 2018-04-08 13:24:56 [44978.956640] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:56 [44978.964194] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:56 [44978.971565] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44978.977561] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:56 [44978.985109] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44978.991966] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:56 [44978.999439] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:56 [44979.006907] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:56 [44979.014459] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:56 [44979.020968] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:56 [44979.027137] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:56 [44979.035126] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:56 [44979.042598] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:56 [44979.050585] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:56 [44979.058480] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:56 [44979.065164] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:56 [44979.071414] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44979.078278] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:56 [44979.085312] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:56 [44979.091999] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:56 [44979.097905] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:56 [44979.105714] [] kthread+0xcf/0xe0 2018-04-08 13:24:56 [44979.111008] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.117522] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:56 [44979.123339] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.129845] osp-pre-7-2 S ffff885e68980000 0 30506 2 0x00000000 2018-04-08 13:24:56 [44979.137352] Call Trace: 2018-04-08 13:24:56 [44979.140227] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:56 [44979.145871] [] schedule+0x29/0x70 2018-04-08 13:24:56 [44979.151253] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:56 [44979.159257] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:56 [44979.166386] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:56 [44979.174296] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:56 [44979.181844] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44979.187837] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:56 [44979.194784] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:56 [44979.201990] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:56 [44979.208500] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44979.214492] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:56 [44979.221433] [] kthread+0xcf/0xe0 2018-04-08 13:24:56 [44979.226730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.233245] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:56 [44979.239062] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.245567] osp-syn-7-2 S ffff88012d6a9fa0 0 30514 2 0x00000000 2018-04-08 13:24:56 [44979.253077] Call Trace: 2018-04-08 13:24:56 [44979.255947] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:56 [44979.262976] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:56 [44979.269311] [] schedule+0x29/0x70 2018-04-08 13:24:56 [44979.274698] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:56 [44979.282251] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:56 [44979.289632] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44979.295625] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:56 [44979.303173] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44979.310032] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:56 [44979.317507] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:56 [44979.324973] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:56 [44979.332521] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:56 [44979.339031] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:56 [44979.345200] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:56 [44979.353191] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:56 [44979.360660] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:56 [44979.368650] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:56 [44979.376545] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:56 [44979.383227] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:56 [44979.389480] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44979.396342] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:56 [44979.403374] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:56 [44979.410055] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:56 [44979.415959] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:56 [44979.423766] [] kthread+0xcf/0xe0 2018-04-08 13:24:56 [44979.429065] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.435576] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:56 [44979.441398] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.447899] osp-pre-8-2 S ffff885eb6121fa0 0 30525 2 0x00000000 2018-04-08 13:24:56 [44979.455405] Call Trace: 2018-04-08 13:24:56 [44979.458274] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:56 [44979.463916] [] schedule+0x29/0x70 2018-04-08 13:24:56 [44979.469299] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:56 [44979.477301] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:56 [44979.484432] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:56 [44979.492344] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:56 [44979.499891] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44979.505882] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:56 [44979.512825] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:56 [44979.520025] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:56 [44979.526537] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44979.532527] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:56 [44979.539471] [] kthread+0xcf/0xe0 2018-04-08 13:24:56 [44979.544773] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.551279] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:56 [44979.557098] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:56 [44979.563606] osp-syn-8-2 S ffff885e68ed0fd0 0 30536 2 0x00000000 2018-04-08 13:24:56 [44979.571119] Call Trace: 2018-04-08 13:24:56 [44979.573995] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:56 [44979.581021] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:56 [44979.587361] [] schedule+0x29/0x70 2018-04-08 13:24:56 [44979.592745] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:56 [44979.600293] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:56 [44979.607669] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:56 [44979.613665] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:56 [44979.621218] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44979.628077] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:56 [44979.635551] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:56 [44979.643017] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:56 [44979.650565] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:56 [44979.657080] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:56 [44979.663248] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:56 [44979.671238] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:56 [44979.678707] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:56 [44979.686694] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:56 [44979.694590] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:56 [44979.701273] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:56 [44979.707525] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:56 [44979.714391] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:56 [44979.721419] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:56 [44979.728103] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:56 [44979.734004] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:57 [44979.741815] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44979.747109] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44979.753622] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44979.759440] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44979.765946] osp-pre-9-2 S ffff88012cbccf10 0 30543 2 0x00000000 2018-04-08 13:24:57 [44979.773452] Call Trace: 2018-04-08 13:24:57 [44979.776327] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:57 [44979.781971] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44979.787356] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:57 [44979.795355] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:57 [44979.802486] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:57 [44979.810397] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:57 [44979.817945] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44979.823938] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:57 [44979.830882] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:57 [44979.838084] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:57 [44979.844594] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44979.850584] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:57 [44979.857528] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44979.862825] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44979.869338] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44979.875154] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44979.881660] osp-syn-9-2 S ffff885e9aaa3f40 0 30551 2 0x00000000 2018-04-08 13:24:57 [44979.889168] Call Trace: 2018-04-08 13:24:57 [44979.892041] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:57 [44979.899067] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:57 [44979.905409] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44979.910788] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:57 [44979.918340] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:57 [44979.925715] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44979.931710] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:57 [44979.939265] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:57 [44979.946124] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:57 [44979.953599] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:57 [44979.961066] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:57 [44979.968613] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:57 [44979.975125] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:57 [44979.981292] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:57 [44979.989276] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:57 [44979.996745] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:57 [44980.004735] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:57 [44980.012630] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:57 [44980.019311] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:57 [44980.025563] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:57 [44980.032428] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:57 [44980.039461] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:57 [44980.046149] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:57 [44980.052052] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:57 [44980.059862] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44980.065157] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.071671] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44980.077485] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.083994] osp-pre-10-2 S ffff885e9aaa4f10 0 30554 2 0x00000000 2018-04-08 13:24:57 [44980.091503] Call Trace: 2018-04-08 13:24:57 [44980.094374] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:57 [44980.100017] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44980.105402] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:57 [44980.113404] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:57 [44980.120533] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:57 [44980.128446] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:57 [44980.135993] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44980.141987] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:57 [44980.148928] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:57 [44980.156130] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:57 [44980.162642] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44980.168633] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:57 [44980.175575] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44980.180872] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.187385] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44980.193201] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.199707] osp-syn-10-2 S ffff885eb9588fd0 0 30565 2 0x00000000 2018-04-08 13:24:57 [44980.207215] Call Trace: 2018-04-08 13:24:57 [44980.210089] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:57 [44980.217116] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:57 [44980.223456] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44980.228836] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:57 [44980.236387] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44980.242381] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:57 [44980.249927] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:57 [44980.256790] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:57 [44980.264260] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:57 [44980.271729] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:57 [44980.279276] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:57 [44980.285785] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:57 [44980.291960] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:57 [44980.299947] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:57 [44980.307419] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:57 [44980.315406] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:57 [44980.323302] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:57 [44980.329982] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:57 [44980.336233] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:57 [44980.343095] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:57 [44980.350128] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:57 [44980.356810] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:57 [44980.362715] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:57 [44980.370525] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44980.375821] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.382332] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44980.388148] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.394659] osp-pre-11-2 S ffff885ea4739fa0 0 30572 2 0x00000000 2018-04-08 13:24:57 [44980.402173] Call Trace: 2018-04-08 13:24:57 [44980.405045] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:57 [44980.410688] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44980.416075] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:57 [44980.424082] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:57 [44980.431219] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:57 [44980.439126] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:57 [44980.446675] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44980.452663] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:57 [44980.459610] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:57 [44980.466811] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:57 [44980.473317] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44980.479312] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:57 [44980.486250] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44980.491550] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.498059] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44980.503878] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.510390] osp-syn-11-2 S ffff885ebd978fd0 0 30582 2 0x00000000 2018-04-08 13:24:57 [44980.517895] Call Trace: 2018-04-08 13:24:57 [44980.520769] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:57 [44980.527795] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:57 [44980.534132] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44980.539516] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:57 [44980.547069] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:57 [44980.554440] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:57 [44980.560439] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:57 [44980.567993] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:57 [44980.574851] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:57 [44980.582326] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:57 [44980.589794] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:57 [44980.597342] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:57 [44980.603852] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:57 [44980.610019] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:57 [44980.618003] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:57 [44980.625473] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:57 [44980.633462] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:57 [44980.641355] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:57 [44980.648039] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:57 [44980.654292] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:57 [44980.661151] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:57 [44980.668186] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:57 [44980.674868] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:57 [44980.680770] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:57 [44980.688580] [] kthread+0xcf/0xe0 2018-04-08 13:24:57 [44980.693876] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.700389] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:57 [44980.706204] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:57 [44980.712713] osp-pre-12-2 S ffff88bd83445ee0 0 30589 2 0x00000000 2018-04-08 13:24:57 [44980.720219] Call Trace: 2018-04-08 13:24:57 [44980.723095] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:57 [44980.728736] [] schedule+0x29/0x70 2018-04-08 13:24:57 [44980.734122] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:58 [44980.742120] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:58 [44980.749253] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:58 [44980.757167] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:58 [44980.764712] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44980.770704] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44980.777649] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:58 [44980.784847] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:58 [44980.791357] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44980.797347] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44980.804290] [] kthread+0xcf/0xe0 2018-04-08 13:24:58 [44980.809590] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44980.816101] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:58 [44980.821916] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44980.828423] osp-syn-12-2 S ffff88bd831e0000 0 30599 2 0x00000000 2018-04-08 13:24:58 [44980.835931] Call Trace: 2018-04-08 13:24:58 [44980.838806] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:58 [44980.845833] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:58 [44980.852168] [] schedule+0x29/0x70 2018-04-08 13:24:58 [44980.857555] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:58 [44980.865106] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:58 [44980.872479] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44980.878474] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:58 [44980.886022] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:58 [44980.892881] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:58 [44980.900355] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:58 [44980.907820] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:58 [44980.915372] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:58 [44980.921881] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:58 [44980.928047] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:58 [44980.936031] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:58 [44980.943499] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:58 [44980.951483] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:58 [44980.959376] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:58 [44980.966061] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:58 [44980.972314] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:58 [44980.979176] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:58 [44980.986206] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:58 [44980.992888] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:58 [44980.998790] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:58 [44981.006600] [] kthread+0xcf/0xe0 2018-04-08 13:24:58 [44981.011899] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.018408] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:58 [44981.024226] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.030737] osp-pre-13-2 S ffff88bd82dd9fa0 0 30609 2 0x00000000 2018-04-08 13:24:58 [44981.038251] Call Trace: 2018-04-08 13:24:58 [44981.041123] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:58 [44981.046768] [] schedule+0x29/0x70 2018-04-08 13:24:58 [44981.052151] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:58 [44981.060151] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:58 [44981.067282] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:58 [44981.075194] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:58 [44981.082742] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.088734] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44981.095679] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:58 [44981.102884] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:58 [44981.109397] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.115390] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44981.122328] [] kthread+0xcf/0xe0 2018-04-08 13:24:58 [44981.127627] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.134140] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:58 [44981.139957] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.146462] osp-syn-13-2 S ffff88bd82884f10 0 30620 2 0x00000000 2018-04-08 13:24:58 [44981.153972] Call Trace: 2018-04-08 13:24:58 [44981.156844] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:58 [44981.163870] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:58 [44981.170211] [] schedule+0x29/0x70 2018-04-08 13:24:58 [44981.175592] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:58 [44981.183144] [] ? libcfs_debug_vmsg2+0x6d8/0xb40 [libcfs] 2018-04-08 13:24:58 [44981.190518] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.196514] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:58 [44981.204065] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:58 [44981.210927] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:58 [44981.218404] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:58 [44981.225868] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:58 [44981.233417] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:58 [44981.239926] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:58 [44981.246098] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:58 [44981.254091] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:58 [44981.261558] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:58 [44981.269548] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:58 [44981.277442] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:58 [44981.284123] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:58 [44981.290375] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:58 [44981.297238] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:58 [44981.304271] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:58 [44981.310950] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:58 [44981.316853] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:58 [44981.324662] [] kthread+0xcf/0xe0 2018-04-08 13:24:58 [44981.329960] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.336475] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:58 [44981.342289] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.348795] osp-pre-14-2 S ffff88bd82885ee0 0 30621 2 0x00000000 2018-04-08 13:24:58 [44981.356305] Call Trace: 2018-04-08 13:24:58 [44981.359177] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:58 [44981.364820] [] schedule+0x29/0x70 2018-04-08 13:24:58 [44981.370204] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:58 [44981.378205] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:58 [44981.385337] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:58 [44981.393248] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:58 [44981.400796] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.406787] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44981.413731] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:58 [44981.420934] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:58 [44981.427443] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.433432] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44981.440375] [] kthread+0xcf/0xe0 2018-04-08 13:24:58 [44981.445676] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.452183] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:58 [44981.458002] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.464508] osp-syn-14-2 S ffff88bd83e8cf10 0 30636 2 0x00000000 2018-04-08 13:24:58 [44981.472017] Call Trace: 2018-04-08 13:24:58 [44981.474892] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:58 [44981.481921] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:58 [44981.488257] [] schedule+0x29/0x70 2018-04-08 13:24:58 [44981.493641] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:58 [44981.501191] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.507186] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:58 [44981.514741] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:58 [44981.521609] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:58 [44981.529079] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:58 [44981.536548] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:58 [44981.544098] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:58 [44981.550605] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:58 [44981.556778] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:58 [44981.564766] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:58 [44981.572238] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:58 [44981.580232] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:58 [44981.588133] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:58 [44981.594814] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:58 [44981.601061] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:58 [44981.607925] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:58 [44981.614957] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:58 [44981.621639] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:58 [44981.627542] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:58 [44981.635353] [] kthread+0xcf/0xe0 2018-04-08 13:24:58 [44981.640648] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.647159] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:58 [44981.652978] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:58 [44981.659488] osp-pre-15-2 S ffff88bd83e8eeb0 0 30639 2 0x00000000 2018-04-08 13:24:58 [44981.667000] Call Trace: 2018-04-08 13:24:58 [44981.669876] [] ? __wake_up+0x44/0x50 2018-04-08 13:24:58 [44981.675515] [] schedule+0x29/0x70 2018-04-08 13:24:58 [44981.680906] [] osp_precreate_cleanup_orphans+0x2c3/0x10a0 [osp] 2018-04-08 13:24:58 [44981.688905] [] ? ptlrpcd_add_req+0x22b/0x300 [ptlrpc] 2018-04-08 13:24:58 [44981.696033] [] ? ptlrpc_request_bufs_pack+0x1d9/0x480 [ptlrpc] 2018-04-08 13:24:58 [44981.703948] [] ? lustre_msg_set_timeout+0x27/0xa0 [ptlrpc] 2018-04-08 13:24:58 [44981.711495] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:58 [44981.717483] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:58 [44981.724430] [] osp_precreate_thread+0x580/0x1260 [osp] 2018-04-08 13:24:58 [44981.731630] [] ? dequeue_task_fair+0x41e/0x660 2018-04-08 13:24:59 [44981.738140] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44981.744130] [] ? osp_init_pre_fid+0x5f0/0x5f0 [osp] 2018-04-08 13:24:59 [44981.751072] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44981.756369] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44981.762882] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44981.768699] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44981.775213] osp-syn-15-2 S ffff88bd8d0bbf40 0 30648 2 0x00000000 2018-04-08 13:24:59 [44981.782722] Call Trace: 2018-04-08 13:24:59 [44981.785598] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:24:59 [44981.792626] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:24:59 [44981.798958] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44981.804345] [] osp_sync_process_queues+0x161f/0x2010 [osp] 2018-04-08 13:24:59 [44981.811895] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44981.817892] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:59 [44981.825444] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:59 [44981.832302] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:59 [44981.839766] [] llog_cat_process_cb+0x43d/0x4e0 [obdclass] 2018-04-08 13:24:59 [44981.847237] [] llog_process_thread+0x5a5/0x1180 [obdclass] 2018-04-08 13:24:59 [44981.854786] [] ? enqueue_task_fair+0x208/0x6c0 2018-04-08 13:24:59 [44981.861296] [] ? sched_clock_cpu+0x85/0xc0 2018-04-08 13:24:59 [44981.867467] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:59 [44981.875458] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:24:59 [44981.882927] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:24:59 [44981.890918] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:24:59 [44981.898810] [] ? default_wake_function+0x12/0x20 2018-04-08 13:24:59 [44981.905492] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:24:59 [44981.911743] [] ? osp_sync_thread+0x9e0/0x9e0 [osp] 2018-04-08 13:24:59 [44981.918604] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:24:59 [44981.925628] [] osp_sync_thread+0x208/0x9e0 [osp] 2018-04-08 13:24:59 [44981.932309] [] ? __schedule+0x424/0x9b0 2018-04-08 13:24:59 [44981.938216] [] ? osp_sync_process_committed+0x6c0/0x6c0 [osp] 2018-04-08 13:24:59 [44981.946024] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44981.951321] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44981.957831] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44981.963650] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44981.970160] osp_up1-2 S ffff88bd83bb5ee0 0 30661 2 0x00000000 2018-04-08 13:24:59 [44981.977673] Call Trace: 2018-04-08 13:24:59 [44981.980549] [] ? osp_get_next_request+0x2d/0x1a0 [osp] 2018-04-08 13:24:59 [44981.987749] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44981.993137] [] osp_send_update_thread+0x2f8/0x600 [osp] 2018-04-08 13:24:59 [44982.000426] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.006418] [] ? osp_invalidate_request+0x3a0/0x3a0 [osp] 2018-04-08 13:24:59 [44982.013888] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.019189] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.025702] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.031520] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.038028] z_wr_int_4 S ffff88bddee00000 0 30990 2 0x00000000 2018-04-08 13:24:59 [44982.045542] Call Trace: 2018-04-08 13:24:59 [44982.048419] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.053814] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.060243] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.066282] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:59 [44982.074798] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.081751] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.087055] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.093562] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.099380] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.105886] z_wr_int_4 S ffff88bd82ddbf40 0 30994 2 0x00000000 2018-04-08 13:24:59 [44982.113407] Call Trace: 2018-04-08 13:24:59 [44982.116279] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.121670] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.128090] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.134114] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:59 [44982.142629] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.149575] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.154879] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.161389] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.167206] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.173717] z_wr_int_6 S ffff88bd82886eb0 0 31002 2 0x00000000 2018-04-08 13:24:59 [44982.181224] Call Trace: 2018-04-08 13:24:59 [44982.184094] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.189477] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.195899] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.201909] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:59 [44982.210417] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.217362] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.222657] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.229169] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.234986] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.241493] z_wr_int_1 S ffff88bd84ad0fd0 0 31031 2 0x00000000 2018-04-08 13:24:59 [44982.249010] Call Trace: 2018-04-08 13:24:59 [44982.251885] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.257278] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.263700] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.269688] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.276630] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.281928] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.288436] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.294243] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.300744] z_wr_int_7 S ffff88bd84ad2f70 0 31033 2 0x00000000 2018-04-08 13:24:59 [44982.308240] Call Trace: 2018-04-08 13:24:59 [44982.311107] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.316495] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.322916] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.328914] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:59 [44982.337408] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.344350] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.349648] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.356150] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.361955] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.368456] z_wr_int_2 S ffff88bd84ad3f40 0 31034 2 0x00000000 2018-04-08 13:24:59 [44982.375960] Call Trace: 2018-04-08 13:24:59 [44982.378829] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.384215] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.390639] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.396626] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.403556] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.408845] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.415339] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.421152] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.427652] z_wr_int_7 S ffff88bd84ad4f10 0 31035 2 0x00000000 2018-04-08 13:24:59 [44982.435144] Call Trace: 2018-04-08 13:24:59 [44982.438002] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.443379] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.449793] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.455796] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:59 [44982.464289] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.471217] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.476508] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.483010] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.488819] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.495316] z_wr_int_2 S ffff88bd82f4dee0 0 31036 2 0x00000000 2018-04-08 13:24:59 [44982.502814] Call Trace: 2018-04-08 13:24:59 [44982.505672] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.511047] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.517464] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.523462] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:24:59 [44982.531962] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.538895] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.544184] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.550682] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.556488] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.562989] z_wr_int_7 S ffff88be5ef19fa0 0 31039 2 0x00000000 2018-04-08 13:24:59 [44982.570488] Call Trace: 2018-04-08 13:24:59 [44982.573356] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.578740] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.585155] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.591133] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.598066] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.603353] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.609851] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.615661] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.622157] z_wr_int_7 S ffff88be5ef1bf40 0 31040 2 0x00000000 2018-04-08 13:24:59 [44982.629652] Call Trace: 2018-04-08 13:24:59 [44982.632511] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.637888] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.644301] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.650287] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.657218] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.662505] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.668996] [] ret_from_fork+0x58/0x90 2018-04-08 13:24:59 [44982.674799] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.681290] z_wr_int_7 S ffff88be5ef1af70 0 31041 2 0x00000000 2018-04-08 13:24:59 [44982.688783] Call Trace: 2018-04-08 13:24:59 [44982.691648] [] schedule+0x29/0x70 2018-04-08 13:24:59 [44982.697027] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:24:59 [44982.703439] [] ? wake_up_state+0x20/0x20 2018-04-08 13:24:59 [44982.709423] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:24:59 [44982.716353] [] kthread+0xcf/0xe0 2018-04-08 13:24:59 [44982.721634] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:24:59 [44982.728127] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44982.733925] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.740418] z_wr_int_5 S ffff88bd83e88000 0 31044 2 0x00000000 2018-04-08 13:25:00 [44982.747916] Call Trace: 2018-04-08 13:25:00 [44982.750771] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44982.756135] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:00 [44982.762542] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44982.768517] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:00 [44982.775443] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44982.780718] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.787203] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44982.792995] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.799480] ldlm_cb01_002 S ffff88bd83ec3f40 0 31071 2 0x00000000 2018-04-08 13:25:00 [44982.806970] Call Trace: 2018-04-08 13:25:00 [44982.809824] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44982.816144] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44982.821525] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:00 [44982.828619] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44982.834612] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:00 [44982.841295] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:00 [44982.849085] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44982.854363] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.860859] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44982.866658] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.873151] ldlm_cb01_003 S ffff88bd83ec4f10 0 31072 2 0x00000000 2018-04-08 13:25:00 [44982.880649] Call Trace: 2018-04-08 13:25:00 [44982.883506] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44982.889828] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44982.895220] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:00 [44982.902324] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44982.908319] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:00 [44982.915001] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:00 [44982.922793] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44982.928075] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.934569] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44982.940371] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44982.946870] qsd_reint_1.dag S ffff88bd836deeb0 0 31307 2 0x00000000 2018-04-08 13:25:00 [44982.954371] Call Trace: 2018-04-08 13:25:00 [44982.957237] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44982.963566] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44982.968943] [] qsd_reint_main+0xc76/0xe40 [lquota] 2018-04-08 13:25:00 [44982.975787] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44982.981771] [] ? qsd_reconciliation+0xa90/0xa90 [lquota] 2018-04-08 13:25:00 [44982.989136] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44982.994425] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.000929] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.006738] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.013243] lquota_wb_dagg- S ffff88bd836dbf40 0 31308 2 0x00000000 2018-04-08 13:25:00 [44983.020749] Call Trace: 2018-04-08 13:25:00 [44983.023623] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.029005] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:25:00 [44983.035243] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:25:00 [44983.041660] [] ? qsd_job_pending+0x7e/0x1b0 [lquota] 2018-04-08 13:25:00 [44983.048681] [] qsd_upd_thread+0x9f7/0xd40 [lquota] 2018-04-08 13:25:00 [44983.055525] [] ? __schedule+0x424/0x9b0 2018-04-08 13:25:00 [44983.061422] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.067406] [] ? qsd_upd_add+0xf0/0xf0 [lquota] 2018-04-08 13:25:00 [44983.073993] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.079284] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.085787] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.091587] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.098085] dist_txn-2 S ffff885e9cc98fd0 0 31311 2 0x00000000 2018-04-08 13:25:00 [44983.105586] Call Trace: 2018-04-08 13:25:00 [44983.108448] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] 2018-04-08 13:25:00 [44983.115466] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44983.121796] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.127191] [] distribute_txn_commit_thread+0x9ac/0xca0 [ptlrpc] 2018-04-08 13:25:00 [44983.135250] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.141248] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] 2018-04-08 13:25:00 [44983.148528] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.153818] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.160322] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.166127] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.172629] lod0002_rec0000 R running task 0 31314 2 0x00000000 2018-04-08 13:25:00 [44983.180132] Call Trace: 2018-04-08 13:25:00 [44983.183001] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.188381] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:25:00 [44983.194619] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:25:00 [44983.201042] [] ptlrpc_set_wait+0x4c0/0x910 [ptlrpc] 2018-04-08 13:25:00 [44983.207969] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.213955] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] 2018-04-08 13:25:00 [44983.220978] [] osp_md_read+0x4cd/0x8c0 [osp] 2018-04-08 13:25:00 [44983.227315] [] dt_read+0x14/0x50 [obdclass] 2018-04-08 13:25:00 [44983.233557] [] llog_osd_next_block+0x36a/0xbe0 [obdclass] 2018-04-08 13:25:00 [44983.241004] [] ? __schedule+0x424/0x9b0 2018-04-08 13:25:00 [44983.246893] [] llog_process_thread+0x294/0x1180 [obdclass] 2018-04-08 13:25:00 [44983.254437] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:25:00 [44983.262412] [] llog_process_or_fork+0xbc/0x450 [obdclass] 2018-04-08 13:25:00 [44983.269873] [] ? llog_cat_cancel_records+0x3d0/0x3d0 [obdclass] 2018-04-08 13:25:00 [44983.277857] [] llog_cat_process_or_fork+0x199/0x2a0 [obdclass] 2018-04-08 13:25:00 [44983.285751] [] ? lod_sub_prep_llog+0x24a/0x783 [lod] 2018-04-08 13:25:00 [44983.292774] [] ? lodname2mdt_index+0x2f0/0x2f0 [lod] 2018-04-08 13:25:00 [44983.299796] [] llog_cat_process+0x2e/0x30 [obdclass] 2018-04-08 13:25:00 [44983.306821] [] lod_sub_recovery_thread+0x419/0xaf0 [lod] 2018-04-08 13:25:00 [44983.314189] [] ? lod_trans_stop+0x340/0x340 [lod] 2018-04-08 13:25:00 [44983.320942] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.326228] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.332726] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.338534] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.345029] tgt_recover_2 D ffff88012cc39fa0 0 31538 2 0x00000000 2018-04-08 13:25:00 [44983.352527] Call Trace: 2018-04-08 13:25:00 [44983.355392] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.360765] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:25:00 [44983.367008] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:25:00 [44983.373438] [] ? handle_recovery_req+0x270/0x270 [ptlrpc] 2018-04-08 13:25:00 [44983.380905] [] target_recovery_overseer+0xd8/0x650 [ptlrpc] 2018-04-08 13:25:00 [44983.388546] [] ? ldlm_dump_ns_write+0x90/0x90 [ptlrpc] 2018-04-08 13:25:00 [44983.395745] [] ? default_wake_function+0x12/0x20 2018-04-08 13:25:00 [44983.402426] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:25:00 [44983.408666] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:25:00 [44983.414916] [] target_recovery_thread+0x5d0/0x1360 [ptlrpc] 2018-04-08 13:25:00 [44983.422551] [] ? replay_request_or_update.isra.21+0x8c0/0x8c0 [ptlrpc] 2018-04-08 13:25:00 [44983.431132] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.436426] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.442928] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.448732] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.455222] tx_commit_cb S ffff885e68986eb0 0 31563 2 0x00000000 2018-04-08 13:25:00 [44983.462723] Call Trace: 2018-04-08 13:25:00 [44983.465589] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.470967] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:00 [44983.477380] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.483361] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:00 [44983.490292] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.495570] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.502069] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.507876] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.514370] mdt_rdpg00_002 S ffff88bd82dddee0 0 31986 2 0x00000000 2018-04-08 13:25:00 [44983.521870] Call Trace: 2018-04-08 13:25:00 [44983.524733] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44983.531062] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.536454] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:00 [44983.543567] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.549571] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:00 [44983.556261] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:00 [44983.564064] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.569352] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.575851] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.581655] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.588147] mdt_fld_0002 S ffff88bd82ddaf70 0 31987 2 0x00000000 2018-04-08 13:25:00 [44983.595651] Call Trace: 2018-04-08 13:25:00 [44983.598516] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44983.604845] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.610233] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:00 [44983.617335] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.623335] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:00 [44983.630012] [] ? __schedule+0x424/0x9b0 2018-04-08 13:25:00 [44983.635923] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:00 [44983.643722] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.649009] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.655503] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.661315] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.667817] mdt_rdpg00_003 S ffff88bd82ddeeb0 0 31988 2 0x00000000 2018-04-08 13:25:00 [44983.675322] Call Trace: 2018-04-08 13:25:00 [44983.678190] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:00 [44983.684526] [] schedule+0x29/0x70 2018-04-08 13:25:00 [44983.689925] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:00 [44983.697036] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:00 [44983.703048] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:00 [44983.709746] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:00 [44983.717556] [] kthread+0xcf/0xe0 2018-04-08 13:25:00 [44983.722848] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.729356] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:00 [44983.735171] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:00 [44983.741685] mdt_rdpg00_004 S ffff88bd82ddcf10 0 31989 2 0x00000000 2018-04-08 13:25:00 [44983.749185] Call Trace: 2018-04-08 13:25:00 [44983.752050] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44983.758386] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44983.763787] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44983.770897] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44983.776907] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44983.783606] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44983.791418] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44983.796718] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44983.803227] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44983.809039] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44983.815542] mdt_rdpg00_005 S ffff88bddee02f70 0 31990 2 0x00000000 2018-04-08 13:25:01 [44983.823055] Call Trace: 2018-04-08 13:25:01 [44983.825933] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44983.832274] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44983.837673] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44983.844786] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44983.850792] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44983.857493] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44983.865305] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44983.870610] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44983.877123] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44983.882935] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44983.889444] mdt01_009 S ffff88beb4d41fa0 0 32593 2 0x00000000 2018-04-08 13:25:01 [44983.896958] Call Trace: 2018-04-08 13:25:01 [44983.899834] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44983.906168] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44983.911570] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44983.918691] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44983.924703] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44983.931404] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44983.939216] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44983.944511] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44983.951025] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44983.956842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44983.963347] mdt01_010 S ffff88beb4d42f70 0 32594 2 0x00000000 2018-04-08 13:25:01 [44983.970862] Call Trace: 2018-04-08 13:25:01 [44983.973737] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44983.980074] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44983.985471] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44983.992592] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44983.998597] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.005297] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.013111] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.018412] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.024928] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.030744] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.037251] mdt01_011 S ffff88beba834f10 0 32597 2 0x00000000 2018-04-08 13:25:01 [44984.044765] Call Trace: 2018-04-08 13:25:01 [44984.047637] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.053977] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.059377] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.066492] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.072502] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.079201] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.087007] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.092308] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.098820] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.104635] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.111145] mdt01_012 S ffff88bd82cf8000 0 32601 2 0x00000000 2018-04-08 13:25:01 [44984.118658] Call Trace: 2018-04-08 13:25:01 [44984.121533] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.127869] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.133270] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.140388] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.146394] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.153095] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.160903] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.166202] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.172715] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.178531] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.185036] mdt00_008 S ffff88bd82cfcf10 0 32605 2 0x00000000 2018-04-08 13:25:01 [44984.192545] Call Trace: 2018-04-08 13:25:01 [44984.195416] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.201754] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.207154] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.214271] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.220280] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.226978] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.234788] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.240088] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.246598] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.252416] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.258923] mdt01_013 S ffff885e76a05ee0 0 32611 2 0x00000000 2018-04-08 13:25:01 [44984.266438] Call Trace: 2018-04-08 13:25:01 [44984.269312] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.275647] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.281049] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.288165] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.294172] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.300873] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.308683] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.313981] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.320493] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.326310] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.332819] mdt00_009 S ffff885e6935af70 0 32612 2 0x00000000 2018-04-08 13:25:01 [44984.340332] Call Trace: 2018-04-08 13:25:01 [44984.343204] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.349541] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.354940] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.362052] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.368061] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.374762] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.382568] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.387867] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.394379] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.400199] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.406701] mdt00_010 S ffff885e6935cf10 0 32613 2 0x00000000 2018-04-08 13:25:01 [44984.414209] Call Trace: 2018-04-08 13:25:01 [44984.417081] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.423419] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.428819] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.435939] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.441943] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.448644] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.456454] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.461751] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.468264] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.474082] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.480587] mdt00_011 S ffff88bd94716eb0 0 32614 2 0x00000000 2018-04-08 13:25:01 [44984.488093] Call Trace: 2018-04-08 13:25:01 [44984.490966] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.497307] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.502703] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.509813] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.515821] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.522524] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.530333] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.535631] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.542142] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.547961] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.554464] mdt00_012 S ffff88bd94711fa0 0 32615 2 0x00000000 2018-04-08 13:25:01 [44984.561972] Call Trace: 2018-04-08 13:25:01 [44984.564846] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.571181] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.576579] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.583692] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.589701] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.596396] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.604199] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.609496] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.616014] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.621833] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.628342] mdt01_014 S ffff88012ca5eeb0 0 32616 2 0x00000000 2018-04-08 13:25:01 [44984.635847] Call Trace: 2018-04-08 13:25:01 [44984.638722] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:01 [44984.645060] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.650458] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:01 [44984.657581] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:01 [44984.663582] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:01 [44984.670283] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:01 [44984.678092] [] kthread+0xcf/0xe0 2018-04-08 13:25:01 [44984.683390] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.689904] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:01 [44984.695720] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:01 [44984.702227] kworker/u897:0 S ffff88012e248000 0 32659 2 0x00000000 2018-04-08 13:25:01 [44984.709736] Call Trace: 2018-04-08 13:25:01 [44984.712608] [] ? __call_usermodehelper+0x7c/0x90 2018-04-08 13:25:01 [44984.719296] [] ? process_one_work+0x215/0x440 2018-04-08 13:25:01 [44984.725721] [] schedule+0x29/0x70 2018-04-08 13:25:01 [44984.731103] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:02 [44984.737089] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:02 [44984.744029] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44984.749325] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.755830] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44984.761645] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.768149] mdt_rdpg01_004 S ffff88be60952f70 0 32911 2 0x00000000 2018-04-08 13:25:02 [44984.775651] Call Trace: 2018-04-08 13:25:02 [44984.778518] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44984.784851] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44984.790243] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44984.797354] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44984.803351] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44984.810046] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44984.817845] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44984.823139] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.829650] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44984.835460] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.841963] mdt_rdpg01_005 S ffff88beba833f40 0 32912 2 0x00000000 2018-04-08 13:25:02 [44984.849469] Call Trace: 2018-04-08 13:25:02 [44984.852332] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44984.858658] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44984.864049] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44984.871162] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44984.877157] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44984.883852] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44984.891655] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44984.896951] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.903452] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44984.909264] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.915763] mdt_rdpg01_006 S ffff88beba832f70 0 32913 2 0x00000000 2018-04-08 13:25:02 [44984.923268] Call Trace: 2018-04-08 13:25:02 [44984.926134] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44984.932469] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44984.937860] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44984.944973] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44984.950977] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44984.957669] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44984.965473] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44984.970765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.977271] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44984.983090] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44984.989598] mdt_rdpg01_007 S ffff88beb7aacf10 0 32914 2 0x00000000 2018-04-08 13:25:02 [44984.997102] Call Trace: 2018-04-08 13:25:02 [44984.999966] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.006302] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.011693] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.018804] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.024804] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.031496] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.039309] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.044609] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.051121] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.056936] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.063443] mdt_rdpg01_008 S ffff88bddee6bf40 0 32915 2 0x00000000 2018-04-08 13:25:02 [44985.070958] Call Trace: 2018-04-08 13:25:02 [44985.073831] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.080172] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.085575] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.092699] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.098711] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.105410] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.113222] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.118519] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.125031] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.130850] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.137356] mdt_rdpg01_009 S ffff88be5cc6af70 0 32916 2 0x00000000 2018-04-08 13:25:02 [44985.144872] Call Trace: 2018-04-08 13:25:02 [44985.147743] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.154083] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.159488] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.166609] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.172616] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.179313] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.187123] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.192424] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.198933] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.204752] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.211256] mdt_rdpg01_010 S ffff88be5cc68000 0 32917 2 0x00000000 2018-04-08 13:25:02 [44985.218773] Call Trace: 2018-04-08 13:25:02 [44985.221646] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.227982] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.233381] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.240502] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.246509] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.253208] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.261017] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.266317] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.272828] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.278646] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.285151] mdt_rdpg01_011 S ffff88be5cc6eeb0 0 32918 2 0x00000000 2018-04-08 13:25:02 [44985.292666] Call Trace: 2018-04-08 13:25:02 [44985.295539] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.301876] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.307275] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.314395] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.320401] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.327104] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.334911] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.340213] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.346722] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.352541] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.359049] mdt_rdpg01_012 S ffff88be5cc6cf10 0 32919 2 0x00000000 2018-04-08 13:25:02 [44985.366562] Call Trace: 2018-04-08 13:25:02 [44985.369435] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.375771] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.381171] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.388295] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.394304] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.401008] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.408815] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.414114] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.420625] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.426445] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.432956] mdt_rdpg01_013 S ffff88be5cc6dee0 0 32920 2 0x00000000 2018-04-08 13:25:02 [44985.440473] Call Trace: 2018-04-08 13:25:02 [44985.443347] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.449682] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.455082] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.462204] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.468216] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.474919] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.482728] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.488032] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.494543] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.500365] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.506867] mdt_rdpg01_014 S ffff88be5cc68fd0 0 32921 2 0x00000000 2018-04-08 13:25:02 [44985.514383] Call Trace: 2018-04-08 13:25:02 [44985.517257] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.523594] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.528993] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.536114] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.542119] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.548822] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.556629] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.561929] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.568439] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.574255] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.580761] mdt_rdpg00_006 S ffff88be5cc69fa0 0 32922 2 0x00000000 2018-04-08 13:25:02 [44985.588268] Call Trace: 2018-04-08 13:25:02 [44985.591144] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.597480] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.602879] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.609998] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.616004] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.622706] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.630516] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.635814] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.642324] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.648142] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.654650] mdt_rdpg00_007 S ffff88be60f41fa0 0 32923 2 0x00000000 2018-04-08 13:25:02 [44985.662164] Call Trace: 2018-04-08 13:25:02 [44985.665037] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:02 [44985.671373] [] schedule+0x29/0x70 2018-04-08 13:25:02 [44985.676772] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:02 [44985.683893] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:02 [44985.689897] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:02 [44985.696597] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:02 [44985.704408] [] kthread+0xcf/0xe0 2018-04-08 13:25:02 [44985.709706] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.716220] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:02 [44985.722040] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:02 [44985.728550] mdt_rdpg00_008 S ffff88bd82852f70 0 32924 2 0x00000000 2018-04-08 13:25:03 [44985.736057] Call Trace: 2018-04-08 13:25:03 [44985.738930] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44985.745266] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44985.750666] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44985.757785] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44985.763795] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44985.770492] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44985.778303] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44985.783604] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.790112] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44985.795928] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.802436] mdt_rdpg00_009 S ffff88bd82856eb0 0 32925 2 0x00000000 2018-04-08 13:25:03 [44985.809951] Call Trace: 2018-04-08 13:25:03 [44985.812824] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44985.819163] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44985.824563] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44985.831680] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44985.837686] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44985.844385] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44985.852195] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44985.857493] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.864006] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44985.869823] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.876330] z_wr_int_4 S ffff88bd8d58dee0 0 34467 2 0x00000000 2018-04-08 13:25:03 [44985.883845] Call Trace: 2018-04-08 13:25:03 [44985.886717] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44985.892105] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44985.898524] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44985.904516] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44985.911456] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44985.916744] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.923246] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44985.929056] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.935556] z_wr_int_4 S ffff885e60108000 0 34469 2 0x00000000 2018-04-08 13:25:03 [44985.943068] Call Trace: 2018-04-08 13:25:03 [44985.945936] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44985.951319] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44985.957731] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44985.963717] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44985.970653] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44985.975947] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.982450] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44985.988254] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44985.994745] z_wr_int_4 S ffff885e60108fd0 0 34470 2 0x00000000 2018-04-08 13:25:03 [44986.002245] Call Trace: 2018-04-08 13:25:03 [44986.005111] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.010490] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44986.016901] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.022883] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44986.029811] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.035094] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.041589] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.047389] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.053879] mdt_rdpg00_010 S ffff88bd9b70eeb0 0 34595 2 0x00000000 2018-04-08 13:25:03 [44986.061376] Call Trace: 2018-04-08 13:25:03 [44986.064233] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44986.070563] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.075953] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44986.083056] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.089052] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44986.095735] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44986.103530] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.108815] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.115308] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.121106] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.127604] mdt_rdpg00_011 S ffff88be5b7d3f40 0 34602 2 0x00000000 2018-04-08 13:25:03 [44986.135097] Call Trace: 2018-04-08 13:25:03 [44986.137956] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44986.144283] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.149666] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44986.156768] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.162764] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44986.169447] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44986.177239] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.182521] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.189014] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.194820] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.201316] mdt_rdpg00_012 S ffff88be5b7d2f70 0 34604 2 0x00000000 2018-04-08 13:25:03 [44986.208818] Call Trace: 2018-04-08 13:25:03 [44986.211683] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44986.218016] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.223409] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44986.230519] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.236517] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44986.243209] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44986.251014] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.256312] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.262811] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.268623] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.275126] mdt_rdpg00_013 S ffff885e6010cf10 0 34722 2 0x00000000 2018-04-08 13:25:03 [44986.282633] Call Trace: 2018-04-08 13:25:03 [44986.285506] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44986.291837] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.297231] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44986.304344] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.310350] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44986.317052] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44986.324864] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.330171] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.336680] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.342502] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.349013] mdt_out00_002 S ffff88bd86e9dee0 0 35047 2 0x00000000 2018-04-08 13:25:03 [44986.356519] Call Trace: 2018-04-08 13:25:03 [44986.359393] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:03 [44986.365730] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.371129] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:03 [44986.378253] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.384265] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:03 [44986.390966] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:03 [44986.398774] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.404074] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.410582] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.416400] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.422906] z_wr_int_4 S ffff885ebbc1eeb0 0 35149 2 0x00000000 2018-04-08 13:25:03 [44986.430424] Call Trace: 2018-04-08 13:25:03 [44986.433295] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.438683] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44986.445104] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.451095] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44986.458038] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.463329] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.469831] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.475642] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.482144] z_wr_int_4 S ffff88012cbc9fa0 0 35150 2 0x00000000 2018-04-08 13:25:03 [44986.489652] Call Trace: 2018-04-08 13:25:03 [44986.492523] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.497907] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44986.504326] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.510314] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44986.517255] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.522549] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.529051] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.534859] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.541357] z_wr_int_4 S ffff88012cbceeb0 0 35151 2 0x00000000 2018-04-08 13:25:03 [44986.548857] Call Trace: 2018-04-08 13:25:03 [44986.551726] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.557110] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44986.563518] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.569504] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44986.576433] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.581717] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.588205] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.594007] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.600500] z_wr_int_6 S ffff88012cbcdee0 0 35152 2 0x00000000 2018-04-08 13:25:03 [44986.607999] Call Trace: 2018-04-08 13:25:03 [44986.610852] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.616223] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44986.622635] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.628632] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:03 [44986.637123] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44986.644052] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.649328] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.655823] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.661624] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.668114] z_wr_int_6 S ffff88012cbc8000 0 35154 2 0x00000000 2018-04-08 13:25:03 [44986.675613] Call Trace: 2018-04-08 13:25:03 [44986.678469] [] schedule+0x29/0x70 2018-04-08 13:25:03 [44986.683832] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:03 [44986.690242] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:03 [44986.696221] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:03 [44986.703150] [] kthread+0xcf/0xe0 2018-04-08 13:25:03 [44986.708428] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.714919] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:03 [44986.720709] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:03 [44986.727201] z_wr_int_6 S ffff885e68980fd0 0 35156 2 0x00000000 2018-04-08 13:25:03 [44986.734699] Call Trace: 2018-04-08 13:25:04 [44986.737554] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44986.742926] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44986.749335] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44986.755310] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44986.762233] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44986.767513] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.774003] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44986.779795] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.786280] z_wr_int_6 S ffff885e68985ee0 0 35158 2 0x00000000 2018-04-08 13:25:04 [44986.793772] Call Trace: 2018-04-08 13:25:04 [44986.796628] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44986.801992] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44986.808400] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44986.814379] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44986.821304] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44986.826577] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.833062] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44986.838854] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.845340] z_wr_int_7 S ffff885e68983f40 0 35159 2 0x00000000 2018-04-08 13:25:04 [44986.852837] Call Trace: 2018-04-08 13:25:04 [44986.855694] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44986.861061] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44986.867468] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44986.873462] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:04 [44986.881951] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44986.888879] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44986.894165] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.900659] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44986.906458] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.912952] z_wr_int_2 S ffff88bd869d8000 0 35444 2 0x00000000 2018-04-08 13:25:04 [44986.920448] Call Trace: 2018-04-08 13:25:04 [44986.923304] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44986.928673] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44986.935076] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44986.941053] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44986.947981] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44986.953264] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.959756] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44986.965546] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44986.972031] z_wr_int_2 S ffff88bddee03f40 0 35446 2 0x00000000 2018-04-08 13:25:04 [44986.979521] Call Trace: 2018-04-08 13:25:04 [44986.982381] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44986.987746] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44986.994153] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.000128] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.007055] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.012328] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.018814] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.024613] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.031101] z_wr_int_2 S ffff88bddee00fd0 0 35449 2 0x00000000 2018-04-08 13:25:04 [44987.038590] Call Trace: 2018-04-08 13:25:04 [44987.041446] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.046812] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.053218] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.059196] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.066124] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.071406] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.077897] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.083689] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.090175] z_wr_int_2 S ffff88be66370fd0 0 35450 2 0x00000000 2018-04-08 13:25:04 [44987.097674] Call Trace: 2018-04-08 13:25:04 [44987.100532] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.105897] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.112305] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.118281] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.125206] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.130483] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.136973] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.142765] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.149251] z_wr_int_0 S ffff88bd83975ee0 0 35457 2 0x00000000 2018-04-08 13:25:04 [44987.156750] Call Trace: 2018-04-08 13:25:04 [44987.159603] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.164968] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.171363] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.177349] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:04 [44987.185840] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.192773] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.198054] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.204539] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.210330] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.216818] z_wr_int_0 S ffff88bd83970000 0 35458 2 0x00000000 2018-04-08 13:25:04 [44987.224316] Call Trace: 2018-04-08 13:25:04 [44987.227171] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.232542] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.238946] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.244925] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.251854] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.257133] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.263623] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.269415] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.275899] z_wr_int_0 S ffff88bd83974f10 0 35459 2 0x00000000 2018-04-08 13:25:04 [44987.283394] Call Trace: 2018-04-08 13:25:04 [44987.286248] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.291613] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.298021] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.303997] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.310920] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.316197] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.322682] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.328481] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.334967] z_wr_int_0 S ffff88bd83970fd0 0 35460 2 0x00000000 2018-04-08 13:25:04 [44987.342458] Call Trace: 2018-04-08 13:25:04 [44987.345316] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.350689] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.357096] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.363076] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.370005] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.375281] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.381765] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.387557] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.394043] z_wr_int_0 S ffff88bd83976eb0 0 35461 2 0x00000000 2018-04-08 13:25:04 [44987.401532] Call Trace: 2018-04-08 13:25:04 [44987.404390] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.409757] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.416161] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.422139] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.429063] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.434341] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.440834] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.446632] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.453117] z_wr_int_0 S ffff88be60f28000 0 35463 2 0x00000000 2018-04-08 13:25:04 [44987.460607] Call Trace: 2018-04-08 13:25:04 [44987.463464] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.468826] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.475224] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.481194] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.488114] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.493389] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.499871] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.505660] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.512143] z_wr_int_0 S ffff88be60f29fa0 0 35464 2 0x00000000 2018-04-08 13:25:04 [44987.519635] Call Trace: 2018-04-08 13:25:04 [44987.522482] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.527849] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.534247] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.540214] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.547145] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.552418] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.558901] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.564692] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.571177] z_wr_int_7 S ffff88be60f2eeb0 0 35466 2 0x00000000 2018-04-08 13:25:04 [44987.578669] Call Trace: 2018-04-08 13:25:04 [44987.581514] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.586881] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.593280] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.599248] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.606173] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.611455] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.617944] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.623730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.630208] z_wr_int_1 S ffff88bd82854f10 0 35470 2 0x00000000 2018-04-08 13:25:04 [44987.637700] Call Trace: 2018-04-08 13:25:04 [44987.640549] [] schedule+0x29/0x70 2018-04-08 13:25:04 [44987.645916] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:04 [44987.652320] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:04 [44987.658293] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:04 [44987.665214] [] kthread+0xcf/0xe0 2018-04-08 13:25:04 [44987.670494] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.676977] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:04 [44987.682763] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:04 [44987.689240] mdt_out00_003 R running task 0 35475 2 0x00000000 2018-04-08 13:25:04 [44987.696732] Call Trace: 2018-04-08 13:25:04 [44987.699604] [] ? tgt_request_preprocess.isra.26+0x299/0x790 [ptlrpc] 2018-04-08 13:25:04 [44987.708020] [] tgt_request_handle+0x597/0x1370 [ptlrpc] 2018-04-08 13:25:04 [44987.715314] [] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] 2018-04-08 13:25:04 [44987.723394] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] 2018-04-08 13:25:04 [44987.730586] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44987.736588] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44987.743275] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44987.751076] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44987.756366] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.762868] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44987.768677] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.775181] mdt_out01_002 S ffff88012cbbbf40 0 35586 2 0x00000000 2018-04-08 13:25:05 [44987.782689] Call Trace: 2018-04-08 13:25:05 [44987.785572] [] ? lustre_msg_set_last_committed+0x27/0xa0 [ptlrpc] 2018-04-08 13:25:05 [44987.793751] [] tgt_request_handle+0x925/0x1370 [ptlrpc] 2018-04-08 13:25:05 [44987.801062] [] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] 2018-04-08 13:25:05 [44987.809156] [] ? ptlrpc_server_post_idle_rqbds+0x61/0xf0 [ptlrpc] 2018-04-08 13:25:05 [44987.817335] [] ? ptlrpc_main+0xa92/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44987.824211] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44987.832023] [] ? kthread+0xcf/0xe0 2018-04-08 13:25:05 [44987.837503] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.844011] [] ? ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44987.850003] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.856513] mdt_out00_004 S ffff88012cc38fd0 0 37366 2 0x00000000 2018-04-08 13:25:05 [44987.864022] Call Trace: 2018-04-08 13:25:05 [44987.866904] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44987.872308] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44987.879425] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44987.885434] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44987.892135] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44987.899957] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44987.905261] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.911783] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44987.917609] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.924128] z_rd_int_3 S ffff88bd833d0fd0 0 37649 2 0x00000000 2018-04-08 13:25:05 [44987.931663] Call Trace: 2018-04-08 13:25:05 [44987.934550] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44987.939942] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:05 [44987.946375] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44987.952375] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:05 [44987.959327] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44987.964629] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.971152] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44987.976977] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44987.983495] mdt_rdpg00_014 S ffff885e5d993f40 0 37777 2 0x00000000 2018-04-08 13:25:05 [44987.991014] Call Trace: 2018-04-08 13:25:05 [44987.993895] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:05 [44988.000245] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.005651] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44988.012778] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.018790] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44988.025491] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44988.033299] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.038600] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.045117] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.050929] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.057444] mdt_rdpg00_015 S ffff88bd86125ee0 0 37778 2 0x00000000 2018-04-08 13:25:05 [44988.064961] Call Trace: 2018-04-08 13:25:05 [44988.067843] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:05 [44988.074185] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.079585] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44988.086699] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.092703] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44988.099396] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44988.107205] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.112498] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.119004] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.124809] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.131312] z_wr_int_4 S ffff885e5dcd8fd0 0 40034 2 0x00000000 2018-04-08 13:25:05 [44988.138819] Call Trace: 2018-04-08 13:25:05 [44988.141690] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.147077] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:05 [44988.153498] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.159501] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:05 [44988.168005] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:05 [44988.174944] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.180241] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.186745] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.192559] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.199062] z_wr_int_5 S ffff885ebcc42f70 0 40051 2 0x00000000 2018-04-08 13:25:05 [44988.206567] Call Trace: 2018-04-08 13:25:05 [44988.209442] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.214824] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:05 [44988.221246] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.227230] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:05 [44988.234161] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.239452] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.245953] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.251762] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.258267] mdt_out01_003 S ffff885e5dec5ee0 0 43540 2 0x00000000 2018-04-08 13:25:05 [44988.265774] Call Trace: 2018-04-08 13:25:05 [44988.268649] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.274043] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44988.281153] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.287152] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44988.293845] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44988.301655] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.306948] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.313454] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.319267] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.325766] kworker/14:1 S ffff885ea473dee0 0 60930 2 0x00000000 2018-04-08 13:25:05 [44988.333279] Call Trace: 2018-04-08 13:25:05 [44988.336151] [] ? process_one_work+0x215/0x440 2018-04-08 13:25:05 [44988.342576] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.347956] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:05 [44988.353935] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:05 [44988.360868] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.366156] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.372649] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.378450] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.384942] mdt_rdpg01_015 S ffff885e9aaa6eb0 0 77247 2 0x00000000 2018-04-08 13:25:05 [44988.392442] Call Trace: 2018-04-08 13:25:05 [44988.395302] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:05 [44988.401631] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.407025] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44988.414142] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.420139] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44988.426826] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44988.434627] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.439916] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.446418] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.452223] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.458715] tx_commit_cb S ffff88bd83bb0000 0 274911 2 0x00000000 2018-04-08 13:25:05 [44988.466291] Call Trace: 2018-04-08 13:25:05 [44988.469159] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.474534] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:05 [44988.480947] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.486932] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:05 [44988.493859] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.499140] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.505637] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.511444] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.517935] tx_commit_cb S ffff885eb9a11fa0 0 276394 2 0x00000000 2018-04-08 13:25:05 [44988.525527] Call Trace: 2018-04-08 13:25:05 [44988.528390] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.533766] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:05 [44988.540180] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.546160] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:05 [44988.553092] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.558372] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.564863] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.570664] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.577158] mdt_rdpg00_016 S ffff88bd84ad0000 0 276874 2 0x00000000 2018-04-08 13:25:05 [44988.584741] Call Trace: 2018-04-08 13:25:05 [44988.587597] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:05 [44988.593917] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.599307] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44988.606411] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.612408] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44988.619092] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44988.626883] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.632174] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.638675] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:05 [44988.644474] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.650972] mdt_rdpg00_017 S ffff885e649c4f10 0 276875 2 0x00000000 2018-04-08 13:25:05 [44988.658566] Call Trace: 2018-04-08 13:25:05 [44988.661433] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:05 [44988.667771] [] schedule+0x29/0x70 2018-04-08 13:25:05 [44988.673165] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:05 [44988.680277] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:05 [44988.686273] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:05 [44988.692967] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:05 [44988.700769] [] kthread+0xcf/0xe0 2018-04-08 13:25:05 [44988.706064] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:05 [44988.712568] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44988.718371] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.724873] mdt_rdpg00_018 S ffff885e649c6eb0 0 276876 2 0x00000000 2018-04-08 13:25:06 [44988.732470] Call Trace: 2018-04-08 13:25:06 [44988.735335] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:06 [44988.741673] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44988.747069] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:06 [44988.754178] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44988.760177] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:06 [44988.766870] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:06 [44988.774672] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44988.779971] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.786475] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44988.792294] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.798802] mdt_rdpg00_019 S ffff885e649c0000 0 276879 2 0x00000000 2018-04-08 13:25:06 [44988.806407] Call Trace: 2018-04-08 13:25:06 [44988.809275] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:06 [44988.815610] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44988.821009] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:06 [44988.828124] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44988.834130] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:06 [44988.840834] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:06 [44988.848646] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44988.853951] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.860461] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44988.866278] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.872783] ldlm_cn00_008 S ffff88bd6c180fd0 0 276907 2 0x00000000 2018-04-08 13:25:06 [44988.880386] Call Trace: 2018-04-08 13:25:06 [44988.883260] [] ? recalc_sigpending+0x1b/0x50 2018-04-08 13:25:06 [44988.889596] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44988.894995] [] ptlrpc_wait_event+0x325/0x340 [ptlrpc] 2018-04-08 13:25:06 [44988.902116] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44988.908133] [] ptlrpc_main+0x7fe/0x1e40 [ptlrpc] 2018-04-08 13:25:06 [44988.914831] [] ? ptlrpc_register_service+0xe30/0xe30 [ptlrpc] 2018-04-08 13:25:06 [44988.922641] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44988.927949] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.934458] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44988.940275] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44988.946781] pickup S ffff885eb5abdee0 0 279397 9169 0x00000000 2018-04-08 13:25:06 [44988.954383] Call Trace: 2018-04-08 13:25:06 [44988.957257] [] ? hrtimer_start_range_ns+0x1d0/0x3c0 2018-04-08 13:25:06 [44988.964202] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44988.969594] [] schedule_hrtimeout_range_clock+0xb2/0x150 2018-04-08 13:25:06 [44988.976972] [] ? hrtimer_get_res+0x50/0x50 2018-04-08 13:25:06 [44988.983143] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 2018-04-08 13:25:06 [44988.990692] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:25:06 [44988.997468] [] ep_poll+0x23e/0x360 2018-04-08 13:25:06 [44989.002939] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.008930] [] SyS_epoll_wait+0xed/0x120 2018-04-08 13:25:06 [44989.014920] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:25:06 [44989.021338] tx_commit_cb S ffff88bd8d0b8fd0 0 281686 2 0x00000000 2018-04-08 13:25:06 [44989.028932] Call Trace: 2018-04-08 13:25:06 [44989.031804] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.037192] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.043612] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.049605] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.056545] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.061842] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.068342] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.074154] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.080654] tx_commit_cb S ffff88bd8d0b8000 0 281689 2 0x00000000 2018-04-08 13:25:06 [44989.088247] Call Trace: 2018-04-08 13:25:06 [44989.091109] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.096485] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.102896] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.108881] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.115815] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.121101] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.127595] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.133400] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.139894] tx_commit_cb S ffff88be65378000 0 281691 2 0x00000000 2018-04-08 13:25:06 [44989.147478] Call Trace: 2018-04-08 13:25:06 [44989.150339] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.155716] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.162128] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.168105] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.175030] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.180312] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.186804] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.192603] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.199095] tx_commit_cb S ffff88bddee01fa0 0 281692 2 0x00000000 2018-04-08 13:25:06 [44989.206678] Call Trace: 2018-04-08 13:25:06 [44989.209537] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.214912] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.221318] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.227296] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.234222] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.239500] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.245985] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.251775] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.258258] z_wr_int_1 S ffff885eb5ab9fa0 0 282311 2 0x00000000 2018-04-08 13:25:06 [44989.265836] Call Trace: 2018-04-08 13:25:06 [44989.268683] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.274049] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.280447] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.286431] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:06 [44989.294913] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.301846] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.307123] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.313614] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.319417] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.325908] z_wr_int_7 S ffff88be5de75ee0 0 282318 2 0x00000000 2018-04-08 13:25:06 [44989.333486] Call Trace: 2018-04-08 13:25:06 [44989.336343] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.341710] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.348116] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.354107] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:06 [44989.362600] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.369536] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.374821] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.381315] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.387118] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.393611] z_wr_int_5 S ffff885ebcc44f10 0 282325 2 0x00000000 2018-04-08 13:25:06 [44989.401205] Call Trace: 2018-04-08 13:25:06 [44989.404069] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.409445] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.415860] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.421858] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:06 [44989.430361] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.437294] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.442584] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.449085] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.454896] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.461397] z_wr_int_5 S ffff88beb8480fd0 0 282327 2 0x00000000 2018-04-08 13:25:06 [44989.468991] Call Trace: 2018-04-08 13:25:06 [44989.471856] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.477243] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.483665] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.489669] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:06 [44989.498167] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.505109] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.510403] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.516908] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.522723] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.529225] z_wr_int_5 S ffff88beb8481fa0 0 282328 2 0x00000000 2018-04-08 13:25:06 [44989.536821] Call Trace: 2018-04-08 13:25:06 [44989.539695] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.545083] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.551507] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.557514] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:06 [44989.566014] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.572964] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.578263] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.584771] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.590583] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.597084] z_wr_int_6 S ffff88beb8482f70 0 282330 2 0x00000000 2018-04-08 13:25:06 [44989.604682] Call Trace: 2018-04-08 13:25:06 [44989.607554] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.612942] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.619361] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.625363] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:06 [44989.633866] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.640814] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.646111] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.652620] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:06 [44989.658435] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.664936] z_wr_int_5 S ffff88bd946e8000 0 282331 2 0x00000000 2018-04-08 13:25:06 [44989.672521] Call Trace: 2018-04-08 13:25:06 [44989.675396] [] schedule+0x29/0x70 2018-04-08 13:25:06 [44989.680782] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:06 [44989.687201] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:06 [44989.693197] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:06 [44989.700135] [] kthread+0xcf/0xe0 2018-04-08 13:25:06 [44989.705432] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:06 [44989.711936] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44989.717748] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.724248] z_wr_int_4 S ffff88bd946ebf40 0 282334 2 0x00000000 2018-04-08 13:25:07 [44989.731842] Call Trace: 2018-04-08 13:25:07 [44989.734709] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44989.740095] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44989.746521] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44989.752506] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44989.759436] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44989.764728] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.771230] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44989.777038] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.783536] z_wr_int_4 S ffff88beb2f28000 0 282335 2 0x00000000 2018-04-08 13:25:07 [44989.791120] Call Trace: 2018-04-08 13:25:07 [44989.793980] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44989.799354] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44989.805768] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44989.811754] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44989.818686] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44989.823968] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.830462] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44989.836262] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.842762] z_wr_int_4 S ffff88bd9b709fa0 0 282336 2 0x00000000 2018-04-08 13:25:07 [44989.850349] Call Trace: 2018-04-08 13:25:07 [44989.853204] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44989.858570] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44989.864976] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44989.870952] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44989.877881] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44989.883161] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.889645] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44989.895436] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.901923] z_wr_int_4 S ffff885eb0218000 0 282337 2 0x00000000 2018-04-08 13:25:07 [44989.909508] Call Trace: 2018-04-08 13:25:07 [44989.912361] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44989.917727] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44989.924123] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44989.930091] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44989.937015] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44989.942299] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.948785] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44989.954576] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44989.961062] z_wr_int_3 S ffff885eb021bf40 0 282338 2 0x00000000 2018-04-08 13:25:07 [44989.968629] Call Trace: 2018-04-08 13:25:07 [44989.971479] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44989.976843] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44989.983243] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44989.989210] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44989.996134] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.001415] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.007898] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.013684] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.020170] z_wr_int_3 S ffff88bd8d0e3f40 0 282339 2 0x00000000 2018-04-08 13:25:07 [44990.027747] Call Trace: 2018-04-08 13:25:07 [44990.030596] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.035964] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.042360] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.048331] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.055252] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.060537] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.067023] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.072813] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.079299] z_wr_int_0 S ffff88beb2bcaf70 0 282343 2 0x00000000 2018-04-08 13:25:07 [44990.086867] Call Trace: 2018-04-08 13:25:07 [44990.089716] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.095083] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.101481] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.107458] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.114383] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.119661] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.126146] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.131931] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.138420] kworker/u896:0 S ffff88bd836d9fa0 0 282576 2 0x00000000 2018-04-08 13:25:07 [44990.145998] Call Trace: 2018-04-08 13:25:07 [44990.148854] [] ? start_worker+0x27/0x30 2018-04-08 13:25:07 [44990.154739] [] ? manage_workers.isra.24+0x189/0x2a0 2018-04-08 13:25:07 [44990.161665] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.167034] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:07 [44990.173006] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:07 [44990.179926] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.185200] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.191685] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.197477] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.203959] kworker/14:0 S ffff885eb9a16eb0 0 282636 2 0x00000000 2018-04-08 13:25:07 [44990.211542] Call Trace: 2018-04-08 13:25:07 [44990.214395] [] ? process_one_work+0x215/0x440 2018-04-08 13:25:07 [44990.220799] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.226167] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:07 [44990.232134] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:07 [44990.239060] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.244336] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.250818] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.256609] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.263095] z_wr_int_7 S ffff88bd82cfaf70 0 282961 2 0x00000000 2018-04-08 13:25:07 [44990.270675] Call Trace: 2018-04-08 13:25:07 [44990.273522] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.278887] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.285285] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.291253] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.298178] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.303453] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.309939] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.315734] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.322218] z_wr_int_1 S ffff88bd752e6eb0 0 282983 2 0x00000000 2018-04-08 13:25:07 [44990.329793] Call Trace: 2018-04-08 13:25:07 [44990.332640] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.338005] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.344405] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.350370] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.357285] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.362554] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.369040] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.374832] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.381314] z_wr_int_1 S ffff88bd94a8dee0 0 282985 2 0x00000000 2018-04-08 13:25:07 [44990.388885] Call Trace: 2018-04-08 13:25:07 [44990.391733] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.397099] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.403498] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.409466] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.416391] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.421665] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.428150] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.433940] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.440426] z_wr_int_6 S ffff885e9c881fa0 0 282987 2 0x00000000 2018-04-08 13:25:07 [44990.448000] Call Trace: 2018-04-08 13:25:07 [44990.450852] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.456221] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.462623] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.468610] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:07 [44990.477100] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.484030] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.489307] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.495798] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.501587] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.508076] z_wr_int_6 S ffff885e9c885ee0 0 282988 2 0x00000000 2018-04-08 13:25:07 [44990.515652] Call Trace: 2018-04-08 13:25:07 [44990.518510] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.523878] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.530283] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.536272] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:07 [44990.544766] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.551695] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.556981] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.563475] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.569276] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.575768] z_wr_int_6 S ffff885e9c880fd0 0 282989 2 0x00000000 2018-04-08 13:25:07 [44990.583354] Call Trace: 2018-04-08 13:25:07 [44990.586220] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.591596] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.598010] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.603996] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.610923] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.616204] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.622697] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.628501] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.635002] z_wr_int_3 S ffff88bd84c2eeb0 0 282990 2 0x00000000 2018-04-08 13:25:07 [44990.642587] Call Trace: 2018-04-08 13:25:07 [44990.645450] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.650828] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:07 [44990.657242] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:07 [44990.663227] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:07 [44990.670154] [] kthread+0xcf/0xe0 2018-04-08 13:25:07 [44990.675434] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.681930] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:07 [44990.687730] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:07 [44990.694222] z_wr_int_6 S ffff88bd84c28000 0 282991 2 0x00000000 2018-04-08 13:25:07 [44990.701806] Call Trace: 2018-04-08 13:25:07 [44990.704667] [] schedule+0x29/0x70 2018-04-08 13:25:07 [44990.710041] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44990.716458] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44990.722459] [] ? zio_taskq_member.isra.7.constprop.10+0x80/0x80 [zfs] 2018-04-08 13:25:08 [44990.730953] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44990.737891] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44990.743178] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.749682] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44990.755491] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.761990] z_wr_int_6 S ffff88bd84c2af70 0 282992 2 0x00000000 2018-04-08 13:25:08 [44990.769582] Call Trace: 2018-04-08 13:25:08 [44990.772447] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44990.777824] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44990.784236] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44990.790222] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44990.797150] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44990.802431] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.808923] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44990.814725] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.821217] z_wr_int_3 S ffff88bd84c2bf40 0 282993 2 0x00000000 2018-04-08 13:25:08 [44990.828792] Call Trace: 2018-04-08 13:25:08 [44990.831648] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44990.837023] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44990.843430] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44990.849404] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44990.856327] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44990.861606] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.868097] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44990.873898] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.880393] z_wr_int_3 S ffff88bd84c29fa0 0 282994 2 0x00000000 2018-04-08 13:25:08 [44990.887978] Call Trace: 2018-04-08 13:25:08 [44990.890833] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44990.896201] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44990.902607] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44990.908583] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44990.915510] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44990.920792] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.927285] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44990.933086] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.939572] z_wr_int_6 S ffff88bd84ad1fa0 0 282995 2 0x00000000 2018-04-08 13:25:08 [44990.947155] Call Trace: 2018-04-08 13:25:08 [44990.950013] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44990.955379] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44990.961786] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44990.967763] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44990.974690] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44990.979973] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.986465] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44990.992266] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44990.998758] z_wr_int_3 S ffff88bd84ad6eb0 0 282997 2 0x00000000 2018-04-08 13:25:08 [44991.006336] Call Trace: 2018-04-08 13:25:08 [44991.009193] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.014555] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44991.020960] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44991.026936] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44991.033861] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.039142] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.045632] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.051421] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.057907] z_wr_int_3 S ffff88beb7aa8000 0 283000 2 0x00000000 2018-04-08 13:25:08 [44991.065484] Call Trace: 2018-04-08 13:25:08 [44991.068333] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.073700] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44991.080106] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44991.086081] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44991.093007] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.098285] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.104768] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.110558] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.117044] z_wr_int_6 S ffff88bd83ec1fa0 0 283001 2 0x00000000 2018-04-08 13:25:08 [44991.124621] Call Trace: 2018-04-08 13:25:08 [44991.127469] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.132838] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44991.139244] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44991.145218] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44991.152143] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.157426] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.163913] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.169702] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.176188] z_wr_int_3 S ffff88bd83ec0fd0 0 283003 2 0x00000000 2018-04-08 13:25:08 [44991.183765] Call Trace: 2018-04-08 13:25:08 [44991.186615] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.191980] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44991.198386] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44991.204354] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44991.211281] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.216559] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.223054] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.228846] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.235334] z_wr_int_3 S ffff88bd83ec5ee0 0 283004 2 0x00000000 2018-04-08 13:25:08 [44991.242901] Call Trace: 2018-04-08 13:25:08 [44991.245751] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.251117] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44991.257522] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44991.263499] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44991.270426] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.275703] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.282194] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.287984] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.294468] z_wr_int_3 S ffff88bd83ec2f70 0 283005 2 0x00000000 2018-04-08 13:25:08 [44991.302048] Call Trace: 2018-04-08 13:25:08 [44991.304904] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.310269] [] taskq_thread+0x4a2/0x4f0 [spl] 2018-04-08 13:25:08 [44991.316675] [] ? wake_up_state+0x20/0x20 2018-04-08 13:25:08 [44991.322646] [] ? taskq_thread_spawn+0x60/0x60 [spl] 2018-04-08 13:25:08 [44991.329566] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.334848] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.341337] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.347127] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.353612] sshd S ffff88bd752e2f70 0 283060 8954 0x00000000 2018-04-08 13:25:08 [44991.361184] Call Trace: 2018-04-08 13:25:08 [44991.364049] [] ? ipoib_start_xmit+0x2a4/0x640 [ib_ipoib] 2018-04-08 13:25:08 [44991.371411] [] ? reqsk_fastopen_remove+0x140/0x140 2018-04-08 13:25:08 [44991.378256] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.383624] [] schedule_hrtimeout_range_clock+0x12d/0x150 2018-04-08 13:25:08 [44991.391073] [] ? add_wait_queue+0x3c/0x50 2018-04-08 13:25:08 [44991.397142] [] ? tty_write_room+0x1d/0x20 2018-04-08 13:25:08 [44991.403205] [] ? n_tty_poll+0x1b7/0x1d0 2018-04-08 13:25:08 [44991.409090] [] schedule_hrtimeout_range+0x13/0x20 2018-04-08 13:25:08 [44991.415843] [] poll_schedule_timeout+0x55/0xb0 2018-04-08 13:25:08 [44991.422335] [] do_select+0x6d1/0x7c0 2018-04-08 13:25:08 [44991.427962] [] ? ip_finish_output+0x29f/0x780 2018-04-08 13:25:08 [44991.434368] [] ? ip_output+0x73/0xe0 2018-04-08 13:25:08 [44991.439983] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:25:08 [44991.447249] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:25:08 [44991.454505] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:25:08 [44991.461762] [] ? poll_select_copy_remaining+0x150/0x150 2018-04-08 13:25:08 [44991.469004] [] ? _raw_spin_unlock_bh+0x1e/0x20 2018-04-08 13:25:08 [44991.475471] [] ? release_sock+0x118/0x170 2018-04-08 13:25:08 [44991.481505] [] ? tcp_sendmsg+0xd6/0xc30 2018-04-08 13:25:08 [44991.487364] [] ? inet_sendmsg+0x63/0xb0 2018-04-08 13:25:08 [44991.493214] [] core_sys_select+0x1db/0x300 2018-04-08 13:25:08 [44991.499327] [] ? do_sync_write+0x8d/0xd0 2018-04-08 13:25:08 [44991.505264] [] SyS_select+0xba/0x110 2018-04-08 13:25:08 [44991.510855] [] ? posix_get_boottime+0x11/0x20 2018-04-08 13:25:08 [44991.517221] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:25:08 [44991.523590] bash R running task 0 283092 283060 0x00000008 2018-04-08 13:25:08 [44991.531129] Call Trace: 2018-04-08 13:25:08 [44991.533942] [] sched_show_task+0xa8/0x110 2018-04-08 13:25:08 [44991.539967] [] show_state_filter+0x82/0xd0 2018-04-08 13:25:08 [44991.546078] [] sysrq_handle_showstate+0x10/0x20 2018-04-08 13:25:08 [44991.552624] [] __handle_sysrq+0x107/0x170 2018-04-08 13:25:08 [44991.558647] [] write_sysrq_trigger+0x2f/0x40 2018-04-08 13:25:08 [44991.564923] [] proc_reg_write+0x3d/0x80 2018-04-08 13:25:08 [44991.570766] [] vfs_write+0xbd/0x1e0 2018-04-08 13:25:08 [44991.576263] [] SyS_write+0x7f/0xe0 2018-04-08 13:25:08 [44991.581670] [] system_call_fastpath+0x16/0x1b 2018-04-08 13:25:08 [44991.588022] kworker/u896:1 S ffff88bd86e9eeb0 0 283313 2 0x00000000 2018-04-08 13:25:08 [44991.595555] Call Trace: 2018-04-08 13:25:08 [44991.598362] [] ? process_one_work+0x215/0x440 2018-04-08 13:25:08 [44991.604724] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.610048] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:08 [44991.615979] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:08 [44991.622861] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.628099] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.634543] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.640296] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.646736] kworker/14:2 S ffff885ebd97cf10 0 283584 2 0x00000000 2018-04-08 13:25:08 [44991.654268] Call Trace: 2018-04-08 13:25:08 [44991.657067] [] schedule+0x29/0x70 2018-04-08 13:25:08 [44991.662379] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:08 [44991.668301] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:08 [44991.675176] [] kthread+0xcf/0xe0 2018-04-08 13:25:08 [44991.680402] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.686840] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:08 [44991.692590] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:08 [44991.699029] kworker/u896:2 S ffff885e5dcd8000 0 283706 2 0x00000000 2018-04-08 13:25:08 [44991.706567] Call Trace: 2018-04-08 13:25:08 [44991.709370] [] ? process_one_work+0x215/0x440 2018-04-08 13:25:09 [44991.715735] [] schedule+0x29/0x70 2018-04-08 13:25:09 [44991.721058] [] worker_thread+0x1d9/0x3c0 2018-04-08 13:25:09 [44991.726989] [] ? manage_workers.isra.24+0x2a0/0x2a0 2018-04-08 13:25:09 [44991.733879] [] kthread+0xcf/0xe0 2018-04-08 13:25:09 [44991.739129] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:09 [44991.745593] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:09 [44991.751369] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:09 [44991.757837] Sched Debug Version: v0.11, 3.10.0-693.17.1.el7.x86_64 #1 2018-04-08 13:25:09 [44991.764655] ktime : 45100764.005621 2018-04-08 13:25:09 [44991.771472] sched_clk : 44991757.836524 2018-04-08 13:25:09 [44991.778291] cpu_clk : 44991757.836589 2018-04-08 13:25:09 [44991.785101] jiffies : 4339768088 2018-04-08 13:25:09 [44991.791480] sched_clock_stable() : 1 2018-04-08 13:25:09 [44991.797080] 2018-04-08 13:25:09 [44991.798955] sysctl_sched 2018-04-08 13:25:09 [44991.801862] .sysctl_sched_latency : 24.000000 2018-04-08 13:25:09 [44991.808403] .sysctl_sched_min_granularity : 10.000000 2018-04-08 13:25:09 [44991.814934] .sysctl_sched_wakeup_granularity : 15.000000 2018-04-08 13:25:09 [44991.821469] .sysctl_sched_child_runs_first : 0 2018-04-08 13:25:09 [44991.827312] .sysctl_sched_features : 110203 2018-04-08 13:25:09 [44991.833585] .sysctl_sched_tunable_scaling : 1 (logaritmic) 2018-04-08 13:25:09 [44991.840548] 2018-04-08 13:25:09 [44991.842397] cpu#0, 3200.000 MHz 2018-04-08 13:25:09 [44991.845892] .nr_running : 1 2018-04-08 13:25:09 [44991.850865] .load : 1024 2018-04-08 13:25:09 [44991.856094] .nr_switches : 817945459 2018-04-08 13:25:09 [44991.861750] .nr_load_updates : 18613285 2018-04-08 13:25:09 [44991.867315] .nr_uninterruptible : 5 2018-04-08 13:25:09 [44991.872264] .next_balance : 4339.768173 2018-04-08 13:25:09 [44991.878081] .curr->pid : 0 2018-04-08 13:25:09 [44991.883035] .clock : 44991883.028599 2018-04-08 13:25:09 [44991.889197] .cpu_load[0] : 0 2018-04-08 13:25:09 [44991.894137] .cpu_load[1] : 740 2018-04-08 13:25:09 [44991.899254] .cpu_load[2] : 244 2018-04-08 13:25:09 [44991.904366] .cpu_load[3] : 726 2018-04-08 13:25:09 [44991.909469] .cpu_load[4] : 750 2018-04-08 13:25:09 [44991.914562] .avg_idle : 14477 2018-04-08 13:25:09 [44991.919822] .max_idle_balance_cost : 500000 2018-04-08 13:25:09 [44991.925170] 2018-04-08 13:25:09 [44991.925170] cfs_rq[0]:/ 2018-04-08 13:25:09 [44991.929673] .exec_clock : 0.000000 2018-04-08 13:25:09 [44991.935181] .MIN_vruntime : 0.000001 2018-04-08 13:25:09 [44991.940685] .min_vruntime : 7160012.239940 2018-04-08 13:25:09 [44991.946707] .max_vruntime : 0.000001 2018-04-08 13:25:09 [44991.952201] .spread : 0.000000 2018-04-08 13:25:09 [44991.957693] .spread0 : 0.000000 2018-04-08 13:25:09 [44991.963174] .nr_spread_over : 0 2018-04-08 13:25:09 [44991.968047] .nr_running : 0 2018-04-08 13:25:09 [44991.972918] .load : 0 2018-04-08 13:25:09 [44991.977781] .runnable_load_avg : 0 2018-04-08 13:25:09 [44991.982646] .blocked_load_avg : 684 2018-04-08 13:25:09 [44991.987675] .tg_load_avg : 0 2018-04-08 13:25:09 [44991.992530] .tg_load_contrib : 0 2018-04-08 13:25:09 [44991.997385] .tg_runnable_contrib : 0 2018-04-08 13:25:09 [44992.002232] .tg->runnable_avg : 0 2018-04-08 13:25:09 [44992.007077] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:09 [44992.011912] .throttled : 0 2018-04-08 13:25:09 [44992.016746] .throttle_count : 0 2018-04-08 13:25:09 [44992.021578] .avg->runnable_avg_sum : 30174 2018-04-08 13:25:09 [44992.026761] .avg->runnable_avg_period : 46955 2018-04-08 13:25:09 [44992.031945] 2018-04-08 13:25:09 [44992.031945] rt_rq[0]:/ 2018-04-08 13:25:09 [44992.036222] .rt_nr_running : 0 2018-04-08 13:25:09 [44992.041055] .rt_throttled : 0 2018-04-08 13:25:09 [44992.045885] .rt_time : 0.000000 2018-04-08 13:25:09 [44992.051325] .rt_runtime : 900.000000 2018-04-08 13:25:09 [44992.056934] 2018-04-08 13:25:09 [44992.056934] runnable tasks: 2018-04-08 13:25:09 [44992.056934] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:09 [44992.056934] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:09 [44992.083470] ksoftirqd/0 3 7159875.653422 81311 120 0.000000 304.711153 0.000000 0 / 2018-04-08 13:25:09 [44992.094850] kworker/0:0H 5 3204.025455 8 100 0.000000 0.020204 0.000000 0 / 2018-04-08 13:25:09 [44992.106233] migration/0 8 0.000000 342 0 0.000000 1642.650528 0.000000 0 / 2018-04-08 13:25:09 [44992.117624] rcu_bh 9 324.144409 2 120 0.000000 0.000905 0.000000 0 / 2018-04-08 13:25:09 [44992.129019] kswapd0 106 2627.157854 4 120 0.000000 0.161369 0.000000 0 / 2018-04-08 13:25:09 [44992.140420] scsi_eh_6 356 3171.574809 22 120 0.000000 0.153568 0.000000 0 / 2018-04-08 13:25:09 [44992.151815] kworker/0:1H 520 7159875.650833 86205 100 0.000000 126.977141 0.000000 0 / 2018-04-08 13:25:09 [44992.163222] ib_cm 742 4676.421478 2 100 0.000000 0.006321 0.000000 0 / 2018-04-08 13:25:09 [44992.174638] ipoib_flush 745 4688.428719 2 100 0.000000 0.007784 0.000000 0 / 2018-04-08 13:25:09 [44992.186041] irq/148-mei_me 1068 0.000653 14 49 0.000000 0.542179 0.000000 0 / 2018-04-08 13:25:09 [44992.197452] multipathd 4257 0.000000 2 0 0.000000 1.004348 0.000000 0 / 2018-04-08 13:25:09 [44992.208878] multipathd 9264 0.000000 3 0 0.000000 0.457289 0.000000 0 / 2018-04-08 13:25:09 [44992.220309] multipathd 9320 0.000000 7 0 0.000000 0.731167 0.000000 0 / 2018-04-08 13:25:09 [44992.231730] multipathd 9395 0.000000 4 0 0.000000 0.504980 0.000000 0 / 2018-04-08 13:25:09 [44992.243160] kdmwork-253:0 4007 7159875.657239 46663 120 0.000000 1020.103637 0.000000 0 / 2018-04-08 13:25:09 [44992.254595] kdmwork-253:5 4198 7159796.681699 48495 120 0.000000 957.500400 0.000000 0 / 2018-04-08 13:25:09 [44992.266014] kdmwork-253:10 4254 7159796.683342 46012 120 0.000000 1028.206520 0.000000 0 / 2018-04-08 13:25:09 [44992.277441] kworker/0:3 8476 10673.996568 14 120 0.000000 0.043201 0.000000 0 / 2018-04-08 13:25:09 [44992.288883] kworker/0:23 8770 7159885.010048 34274 120 0.000000 247.567736 0.000000 0 / 2018-04-08 13:25:09 [44992.300311] kdmflush 9375 7894.932334 2 100 0.000000 0.005659 0.000000 0 / 2018-04-08 13:25:09 [44992.311754] gmond 14525 7159882.729424 15667 120 0.000000 137353.075155 0.000000 0 / 2018-04-08 13:25:09 [44992.323203] polkitd 15449 11016.087252 80 120 0.000000 14.524405 0.000000 0 / 2018-04-08 13:25:09 [44992.334656] z_null_int 18787 7159875.650878 89394 100 0.000000 601.731866 0.000000 0 / 2018-04-08 13:25:09 [44992.346129] z_rd_int_5 18794 13574.112357 278 100 0.000000 2.404634 0.000000 0 / 2018-04-08 13:25:09 [44992.357596] z_wr_iss 18803 13754.519439 121 101 0.000000 3.487449 0.000000 0 / 2018-04-08 13:25:09 [44992.369071] z_wr_int_5 18815 13754.521624 749 100 0.000000 5.818908 0.000000 0 / 2018-04-08 13:25:09 [44992.380552] txg_sync 18938 7159727.047755 18214 120 0.000000 431.296935 0.000000 0 / 2018-04-08 13:25:09 [44992.392024] z_null_iss 19329 7159875.651133 88942 100 0.000000 4128.998460 0.000000 0 / 2018-04-08 13:25:09 [44992.403494] z_rd_int_0 19332 24609.743555 606 100 0.000000 7.239807 0.000000 0 / 2018-04-08 13:25:09 [44992.414982] z_wr_iss 19345 237852.358195 198 101 0.000000 8.774228 0.000000 0 / 2018-04-08 13:25:09 [44992.426476] z_wr_int_2 19355 237852.359015 925 100 0.000000 9.026173 0.000000 0 / 2018-04-08 13:25:09 [44992.437968] z_wr_int_6 19359 237852.359748 996 100 0.000000 9.626361 0.000000 0 / 2018-04-08 13:25:09 [44992.449458] dp_sync_taskq 19387 237853.404317 146 139 0.000000 2.080130 0.000000 0 / 2018-04-08 13:25:09 [44992.460948] dp_sync_taskq 19388 237853.394281 151 139 0.000000 2.227225 0.000000 0 / 2018-04-08 13:25:09 [44992.472436] z_rd_int_0 19956 22114.020092 713 100 0.000000 7.714849 0.000000 0 / 2018-04-08 13:25:09 [44992.483934] z_rd_int_4 19960 22114.020415 692 100 0.000000 7.741297 0.000000 0 / 2018-04-08 13:25:09 [44992.495430] z_wr_int_0 19977 15058.865468 660 100 0.000000 6.588943 0.000000 0 / 2018-04-08 13:25:09 [44992.506924] z_wr_int_5 19982 15058.867047 641 100 0.000000 6.649645 0.000000 0 / 2018-04-08 13:25:09 [44992.518435] z_wr_iss 21259 14869.342719 72 101 0.000000 3.064179 0.000000 0 / 2018-04-08 13:25:09 [44992.529939] mmp 21405 7159875.659348 88889 120 0.000000 1571.207427 0.000000 0 / 2018-04-08 13:25:09 [44992.541445] z_rd_int_6 21858 7034779.638502 3262 100 0.000000 34.457613 0.000000 0 / 2018-04-08 13:25:09 [44992.552974] z_wr_iss 22438 6985416.221057 666 101 0.000000 21.378483 0.000000 0 / 2018-04-08 13:25:09 [44992.564494] z_wr_iss 22440 6985416.221037 666 101 0.000000 23.045440 0.000000 0 / 2018-04-08 13:25:09 [44992.576012] z_wr_int_1 22452 6985428.224797 3361 100 0.000000 29.962615 0.000000 0 / 2018-04-08 13:25:09 [44992.587539] dp_sync_taskq 22481 6985417.644230 785 139 0.000000 5.461825 0.000000 0 / 2018-04-08 13:25:09 [44992.599061] ptlrpc_hr00_000 23048 612327.805706 4 120 0.000000 0.021672 0.000000 0 / 2018-04-08 13:25:09 [44992.610584] ptlrpcd_00_06 23092 7159779.921038 75029 120 0.000000 1460.831726 0.000000 0 / 2018-04-08 13:25:09 [44992.622109] ldlm_cb00_001 23111 13245.598308 12 120 0.000000 0.248830 0.000000 0 / 2018-04-08 13:25:09 [44992.633615] ldlm_cn00_003 23400 7034729.691386 21418 120 0.000000 296.552681 0.000000 0 / 2018-04-08 13:25:09 [44992.645122] mdt00_004 24110 7146437.141234 102494 120 0.000000 2369.591193 0.000000 0 / 2018-04-08 13:25:09 [44992.656636] osp-pre-1-0 24689 7159200.247868 8822 120 0.000000 160.192360 0.000000 0 / 2018-04-08 13:25:09 [44992.668145] osp-pre-3-0 26750 7159727.024623 8803 120 0.000000 157.330210 0.000000 0 / 2018-04-08 13:25:09 [44992.679660] osp-pre-9-0 26787 7159779.757903 8804 120 0.000000 164.296861 0.000000 0 / 2018-04-08 13:25:09 [44992.691174] osp-pre-12-0 26806 7159779.760452 8804 120 0.000000 160.140221 0.000000 0 / 2018-04-08 13:25:09 [44992.702691] osp-pre-12-1 28775 13550.050747 4 120 0.000000 0.029854 0.000000 0 / 2018-04-08 13:25:10 [44992.714184] lquota_wb_dagg- 29166 7152310.076665 737 120 0.000000 9.017171 0.000000 0 / 2018-04-08 13:25:10 [44992.725688] osp-pre-6-2 30485 13923.169698 4 120 0.000000 0.035777 0.000000 0 / 2018-04-08 13:25:10 [44992.737205] z_wr_int_7 31035 13766.519478 3 100 0.000000 0.013392 0.000000 0 / 2018-04-08 13:25:10 [44992.748710] mdt00_008 32605 7160000.241527 96095 120 0.000000 2185.371038 0.000000 0 / 2018-04-08 13:25:10 [44992.760214] mdt00_009 32612 7160000.279346 91953 120 0.000000 2099.474815 0.000000 0 / 2018-04-08 13:25:10 [44992.771724] mdt_rdpg00_006 32922 6966604.822725 7214 120 0.000000 52.353509 0.000000 0 / 2018-04-08 13:25:10 [44992.783233] z_wr_int_4 34469 14965.363714 2 100 0.000000 0.005482 0.000000 0 / 2018-04-08 13:25:10 [44992.794750] z_wr_int_6 35158 15070.865255 2 100 0.000000 0.005353 0.000000 0 / 2018-04-08 13:25:10 [44992.806275] tx_commit_cb 281689 6967213.770954 5 120 0.000000 0.074970 0.000000 0 / 2018-04-08 13:25:10 [44992.817887] 2018-04-08 13:25:10 [44992.819767] cpu#1, 3200.000 MHz 2018-04-08 13:25:10 [44992.823286] .nr_running : 0 2018-04-08 13:25:10 [44992.828271] .load : 0 2018-04-08 13:25:10 [44992.833253] .nr_switches : 329617366 2018-04-08 13:25:10 [44992.838922] .nr_load_updates : 10698497 2018-04-08 13:25:10 [44992.844505] .nr_uninterruptible : 137 2018-04-08 13:25:10 [44992.849652] .next_balance : 4339.769152 2018-04-08 13:25:10 [44992.855487] .curr->pid : 0 2018-04-08 13:25:10 [44992.860456] .clock : 44992860.149915 2018-04-08 13:25:10 [44992.866635] .cpu_load[0] : 0 2018-04-08 13:25:10 [44992.871594] .cpu_load[1] : 0 2018-04-08 13:25:10 [44992.876552] .cpu_load[2] : 0 2018-04-08 13:25:10 [44992.881498] .cpu_load[3] : 4 2018-04-08 13:25:10 [44992.886440] .cpu_load[4] : 201 2018-04-08 13:25:10 [44992.891555] .avg_idle : 1000000 2018-04-08 13:25:10 [44992.897015] .max_idle_balance_cost : 500000 2018-04-08 13:25:10 [44992.902386] 2018-04-08 13:25:10 [44992.902386] cfs_rq[1]:/ 2018-04-08 13:25:10 [44992.906950] .exec_clock : 0.000000 2018-04-08 13:25:10 [44992.912484] .MIN_vruntime : 0.000001 2018-04-08 13:25:10 [44992.918017] .min_vruntime : 1700543.128543 2018-04-08 13:25:10 [44992.924064] .max_vruntime : 0.000001 2018-04-08 13:25:10 [44992.929593] .spread : 0.000000 2018-04-08 13:25:10 [44992.935112] .spread0 : -5459496.213714 2018-04-08 13:25:10 [44992.941237] .nr_spread_over : 0 2018-04-08 13:25:10 [44992.946150] .nr_running : 0 2018-04-08 13:25:10 [44992.951056] .load : 0 2018-04-08 13:25:10 [44992.955961] .runnable_load_avg : 0 2018-04-08 13:25:10 [44992.960858] .blocked_load_avg : 13433 2018-04-08 13:25:10 [44992.966101] .tg_load_avg : 0 2018-04-08 13:25:10 [44992.970990] .tg_load_contrib : 0 2018-04-08 13:25:10 [44992.975878] .tg_runnable_contrib : 0 2018-04-08 13:25:10 [44992.980760] .tg->runnable_avg : 0 2018-04-08 13:25:10 [44992.985638] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:10 [44992.990514] .throttled : 0 2018-04-08 13:25:10 [44992.995390] .throttle_count : 0 2018-04-08 13:25:10 [44993.000265] .avg->runnable_avg_sum : 7469 2018-04-08 13:25:10 [44993.005401] .avg->runnable_avg_period : 47950 2018-04-08 13:25:10 [44993.010618] 2018-04-08 13:25:10 [44993.010618] rt_rq[1]:/ 2018-04-08 13:25:10 [44993.014946] .rt_nr_running : 0 2018-04-08 13:25:10 [44993.019804] .rt_throttled : 0 2018-04-08 13:25:10 [44993.024659] .rt_time : 0.000000 2018-04-08 13:25:10 [44993.030109] .rt_runtime : 1000.000000 2018-04-08 13:25:10 [44993.035821] 2018-04-08 13:25:10 [44993.035821] runnable tasks: 2018-04-08 13:25:10 [44993.035821] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:10 [44993.035821] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:10 [44993.062374] systemd 1 1700542.951960 41150 120 0.000000 6526.135331 0.000000 1 / 2018-04-08 13:25:10 [44993.073763] migration/1 13 0.000000 388 0 0.000000 938.046436 0.000000 1 / 2018-04-08 13:25:10 [44993.085155] ksoftirqd/1 14 1700448.922872 38374 120 0.000000 272.706263 0.000000 1 / 2018-04-08 13:25:10 [44993.096555] kworker/1:0H 16 1700530.951381 1129815 100 0.000000 6349.177646 0.000000 1 / 2018-04-08 13:25:10 [44993.107955] khungtaskd 92 1699387.976892 377 120 0.000000 55.038159 0.000000 1 / 2018-04-08 13:25:10 [44993.119362] kworker/1:1 100 1700530.949681 349724 120 0.000000 6011.558632 0.000000 1 / 2018-04-08 13:25:10 [44993.130775] multipathd 4273 0.000000 10 0 0.000000 1.574793 0.000000 1 / 2018-04-08 13:25:10 [44993.142199] kdmflush 7784 9182.127593 2 100 0.000000 0.006692 0.000000 1 / 2018-04-08 13:25:10 [44993.153616] bioset 7815 9230.924690 2 100 0.000000 0.005706 0.000000 1 / 2018-04-08 13:25:10 [44993.165042] hfi1_cq0 14385 1700532.663490 19551559 100 0.000000 73008.672710 0.000000 1 / 2018-04-08 13:25:10 [44993.176466] qmgr 14453 1699883.609695 315 120 0.000000 21.425005 0.000000 1 / 2018-04-08 13:25:10 [44993.187905] sssd 14466 1700408.959271 1529 120 0.000000 44.065329 0.000000 1 / 2018-04-08 13:25:10 [44993.199350] kworker/1:1H 17405 1700531.131579 978177 100 0.000000 5417.470635 0.000000 1 / 2018-04-08 13:25:10 [44993.210801] kworker/1:0 18711 19270.123195 7 120 0.000000 0.036932 0.000000 1 / 2018-04-08 13:25:10 [44993.222249] z_rd_int_6 19338 1450696.090639 568 100 0.000000 6.628409 0.000000 1 / 2018-04-08 13:25:10 [44993.233697] z_wr_iss 19965 26987.442618 175 101 0.000000 22.136822 0.000000 1 / 2018-04-08 13:25:10 [44993.245165] z_ioctl_int 19998 26987.440780 37 100 0.000000 0.207898 0.000000 1 / 2018-04-08 13:25:10 [44993.256633] dp_sync_taskq 20586 27011.765175 123 139 0.000000 2.506950 0.000000 1 / 2018-04-08 13:25:10 [44993.268106] dp_sync_taskq 20594 27016.440853 149 139 0.000000 2.410381 0.000000 1 / 2018-04-08 13:25:10 [44993.279570] dp_sync_taskq 20595 27007.418641 124 139 0.000000 1.302327 0.000000 1 / 2018-04-08 13:25:10 [44993.291028] z_null_iss 21245 1700530.951697 88904 100 0.000000 4360.871969 0.000000 1 / 2018-04-08 13:25:10 [44993.302497] z_rd_int_4 21252 1450696.091083 786 100 0.000000 10.019010 0.000000 1 / 2018-04-08 13:25:10 [44993.313956] z_rd_int_7 21255 1675850.604793 793 100 0.000000 9.603099 0.000000 1 / 2018-04-08 13:25:10 [44993.325434] z_wr_iss 21263 26961.275518 61 101 0.000000 3.097916 0.000000 1 / 2018-04-08 13:25:10 [44993.336916] z_wr_int_0 21269 26961.271695 324 100 0.000000 3.121123 0.000000 1 / 2018-04-08 13:25:10 [44993.348399] z_wr_int_5 21274 26961.271519 332 100 0.000000 3.081909 0.000000 1 / 2018-04-08 13:25:10 [44993.359883] z_wr_iss 21860 1675888.525279 13970 101 0.000000 617.777139 0.000000 1 / 2018-04-08 13:25:10 [44993.371376] z_wr_iss 21868 1675888.524592 13934 101 0.000000 620.862750 0.000000 1 / 2018-04-08 13:25:10 [44993.382856] z_wr_int_2 21875 1675936.535787 45799 100 0.000000 548.489030 0.000000 1 / 2018-04-08 13:25:10 [44993.394351] z_wr_int_7 21880 1675936.535256 45618 100 0.000000 547.715490 0.000000 1 / 2018-04-08 13:25:10 [44993.405845] dp_sync_taskq 21909 1675889.737404 6954 139 0.000000 130.215392 0.000000 1 / 2018-04-08 13:25:10 [44993.417337] txg_sync 22015 1700515.444698 35486 120 0.000000 1098.064428 0.000000 1 / 2018-04-08 13:25:10 [44993.428834] z_rd_int_4 22434 1470815.749824 1911 100 0.000000 21.813711 0.000000 1 / 2018-04-08 13:25:10 [44993.440349] ptlrpc_hr01_001 23057 1531304.536142 12395 120 0.000000 60.766272 0.000000 1 / 2018-04-08 13:25:10 [44993.451861] ptlrpc_hr01_002 23058 1531306.210926 12395 120 0.000000 61.197521 0.000000 1 / 2018-04-08 13:25:10 [44993.463370] ptlrpc_hr01_003 23059 1531311.133315 12395 120 0.000000 61.065823 0.000000 1 / 2018-04-08 13:25:10 [44993.474868] ptlrpc_hr01_004 23060 1531311.143029 12395 120 0.000000 61.571555 0.000000 1 / 2018-04-08 13:25:10 [44993.486387] ptlrpc_hr01_005 23061 1531311.742394 12395 120 0.000000 60.520237 0.000000 1 / 2018-04-08 13:25:10 [44993.497891] ptlrpc_hr01_006 23062 1531311.739445 12395 120 0.000000 60.401027 0.000000 1 / 2018-04-08 13:25:10 [44993.509411] ptlrpc_hr01_007 23063 1531311.740413 12395 120 0.000000 61.405083 0.000000 1 / 2018-04-08 13:25:10 [44993.520925] ptlrpcd_01_03 23097 1700420.997416 11534 120 0.000000 181.551518 0.000000 1 / 2018-04-08 13:25:10 [44993.532437] sptlrpc_gc 23103 1664963.590877 26 120 0.000000 0.329311 0.000000 1 / 2018-04-08 13:25:10 [44993.543960] mdt_attr01_000 24018 21622.478870 3 120 0.000000 0.115927 0.000000 1 / 2018-04-08 13:25:10 [44993.555489] mdt_attr01_001 24019 21622.512525 3 120 0.000000 0.040030 0.000000 1 / 2018-04-08 13:25:10 [44993.567005] ldlm_cn01_006 24800 1700515.466629 502381 120 0.000000 3669.004019 0.000000 1 / 2018-04-08 13:25:10 [44993.578533] ldlm_cn01_008 26132 1684264.539048 45933 120 0.000000 439.040097 0.000000 1 / 2018-04-08 13:25:10 [44993.590052] osp-syn-14-0 26821 22338.088622 4 120 0.000000 0.112049 0.000000 1 / 2018-04-08 13:25:10 [44993.601568] mdt_rdpg01_002 27978 1700433.168060 31367 120 0.000000 301.410328 0.000000 1 / 2018-04-08 13:25:10 [44993.613087] osp-syn-8-1 28749 24832.960851 4 120 0.000000 0.142333 0.000000 1 / 2018-04-08 13:25:10 [44993.624587] osp-syn-10-2 30565 25843.535173 7 120 0.000000 0.404456 0.000000 1 / 2018-04-08 13:25:10 [44993.636099] ldlm_cb01_003 31072 27374.531286 9 120 0.000000 0.077707 0.000000 1 / 2018-04-08 13:25:10 [44993.647633] 2018-04-08 13:25:10 [44993.649500] cpu#2, 3200.000 MHz 2018-04-08 13:25:10 [44993.653009] .nr_running : 0 2018-04-08 13:25:10 [44993.657991] .load : 0 2018-04-08 13:25:10 [44993.662961] .nr_switches : 746658675 2018-04-08 13:25:10 [44993.668623] .nr_load_updates : 18032131 2018-04-08 13:25:10 [44993.674195] .nr_uninterruptible : 1069 2018-04-08 13:25:10 [44993.679413] .next_balance : 4339.769984 2018-04-08 13:25:10 [44993.685242] .curr->pid : 0 2018-04-08 13:25:10 [44993.690199] .clock : 44993690.171834 2018-04-08 13:25:10 [44993.696359] .cpu_load[0] : 0 2018-04-08 13:25:10 [44993.701307] .cpu_load[1] : 256 2018-04-08 13:25:10 [44993.706422] .cpu_load[2] : 45 2018-04-08 13:25:11 [44993.711450] .cpu_load[3] : 27 2018-04-08 13:25:11 [44993.716464] .cpu_load[4] : 191 2018-04-08 13:25:11 [44993.721563] .avg_idle : 10009 2018-04-08 13:25:11 [44993.726838] .max_idle_balance_cost : 500000 2018-04-08 13:25:11 [44993.732194] 2018-04-08 13:25:11 [44993.732194] cfs_rq[2]:/ 2018-04-08 13:25:11 [44993.736721] .exec_clock : 0.000000 2018-04-08 13:25:11 [44993.742236] .MIN_vruntime : 0.000001 2018-04-08 13:25:11 [44993.747748] .min_vruntime : 7336413.717555 2018-04-08 13:25:11 [44993.753787] .max_vruntime : 0.000001 2018-04-08 13:25:11 [44993.759297] .spread : 0.000000 2018-04-08 13:25:11 [44993.764802] .spread0 : 176312.645936 2018-04-08 13:25:11 [44993.770737] .nr_spread_over : 0 2018-04-08 13:25:11 [44993.775638] .nr_running : 0 2018-04-08 13:25:11 [44993.780537] .load : 0 2018-04-08 13:25:11 [44993.785422] .runnable_load_avg : 525 2018-04-08 13:25:11 [44993.790475] .blocked_load_avg : 525 2018-04-08 13:25:11 [44993.795530] .tg_load_avg : 0 2018-04-08 13:25:11 [44993.800404] .tg_load_contrib : 0 2018-04-08 13:25:11 [44993.805278] .tg_runnable_contrib : 0 2018-04-08 13:25:11 [44993.810153] .tg->runnable_avg : 0 2018-04-08 13:25:11 [44993.815029] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:11 [44993.819908] .throttled : 0 2018-04-08 13:25:11 [44993.824786] .throttle_count : 0 2018-04-08 13:25:11 [44993.829657] .avg->runnable_avg_sum : 21936 2018-04-08 13:25:11 [44993.834875] .avg->runnable_avg_period : 46283 2018-04-08 13:25:11 [44993.840086] 2018-04-08 13:25:11 [44993.840086] rt_rq[2]:/ 2018-04-08 13:25:11 [44993.844417] .rt_nr_running : 0 2018-04-08 13:25:11 [44993.849273] .rt_throttled : 0 2018-04-08 13:25:11 [44993.854128] .rt_time : 0.000000 2018-04-08 13:25:11 [44993.859579] .rt_runtime : 950.000000 2018-04-08 13:25:11 [44993.865203] 2018-04-08 13:25:11 [44993.865203] runnable tasks: 2018-04-08 13:25:11 [44993.865203] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:11 [44993.865203] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:11 [44993.891755] migration/2 19 0.000000 1790 0 0.000000 956.769298 0.000000 0 / 2018-04-08 13:25:11 [44993.903145] ksoftirqd/2 20 7335627.754784 80283 120 0.000000 311.059463 0.000000 0 / 2018-04-08 13:25:11 [44993.914548] kworker/2:0H 22 1419.934544 9 100 0.000000 0.035558 0.000000 0 / 2018-04-08 13:25:11 [44993.925958] kdevtmpfs 90 51151.941590 305 120 0.000000 2.672295 0.000000 0 / 2018-04-08 13:25:11 [44993.937364] scsi_tmf_4 353 724.046959 2 100 0.000000 0.004912 0.000000 0 / 2018-04-08 13:25:11 [44993.948776] scsi_tmf_6 357 736.066755 2 100 0.000000 0.004924 0.000000 0 / 2018-04-08 13:25:11 [44993.960181] kworker/u897:14 396 86852.080177 34 120 0.000000 5.864594 0.000000 0 / 2018-04-08 13:25:11 [44993.971585] kworker/2:1H 674 7336386.150110 90394 100 0.000000 136.846543 0.000000 0 / 2018-04-08 13:25:11 [44993.983002] iw_cm_wq 975 2660.310290 2 100 0.000000 0.005133 0.000000 0 / 2018-04-08 13:25:11 [44993.994399] kmpath_handlerd 1450 3164.850846 2 100 0.000000 0.003671 0.000000 0 / 2018-04-08 13:25:11 [44994.005807] multipathd 3103 -10.131730 183 0 0.000000 22.277235 0.000000 0 / 2018-04-08 13:25:11 [44994.017217] multipathd 3574 9437.433853 75 120 0.000000 1.181434 0.000000 0 / 2018-04-08 13:25:11 [44994.028642] multipathd 3584 0.000000 76 0 0.000000 20.739343 0.000000 0 / 2018-04-08 13:25:11 [44994.040074] multipathd 4259 0.000000 5 0 0.000000 0.333227 0.000000 0 / 2018-04-08 13:25:11 [44994.051512] multipathd 4264 0.000000 9 0 0.000000 0.290030 0.000000 0 / 2018-04-08 13:25:11 [44994.062947] systemd-logind 9036 7336004.771261 771 120 0.000000 28.562479 0.000000 0 / 2018-04-08 13:25:11 [44994.074385] kworker/2:0 15851 7336384.198360 37655 120 0.000000 318.956278 0.000000 0 / 2018-04-08 13:25:11 [44994.085810] kworker/2:4 15854 16993.815145 11 120 0.000000 0.075116 0.000000 0 / 2018-04-08 13:25:11 [44994.097251] z_rd_iss 18788 29202.137248 2 100 0.000000 0.006423 0.000000 0 / 2018-04-08 13:25:11 [44994.108692] z_wr_iss 18797 83089.903244 122 101 0.000000 3.561767 0.000000 0 / 2018-04-08 13:25:11 [44994.120141] z_wr_iss 18802 83089.902928 122 101 0.000000 3.556781 0.000000 0 / 2018-04-08 13:25:11 [44994.131596] z_wr_iss_h 18809 29454.216981 2 100 0.000000 0.006132 0.000000 0 / 2018-04-08 13:25:11 [44994.143046] z_wr_int_1 18811 83329.986774 759 100 0.000000 6.347646 0.000000 0 / 2018-04-08 13:25:11 [44994.154499] z_wr_int_6 18816 83221.947630 706 100 0.000000 5.728744 0.000000 0 / 2018-04-08 13:25:11 [44994.165943] z_wr_int_h 18818 29562.251016 2 100 0.000000 0.006701 0.000000 0 / 2018-04-08 13:25:11 [44994.177393] z_fr_iss_0 18819 29574.255172 2 100 0.000000 0.007085 0.000000 0 / 2018-04-08 13:25:11 [44994.188850] z_fr_iss_1 18820 29586.259510 2 100 0.000000 0.007212 0.000000 0 / 2018-04-08 13:25:11 [44994.200296] z_fr_iss_2 18821 29598.263395 2 100 0.000000 0.006707 0.000000 0 / 2018-04-08 13:25:11 [44994.211751] z_fr_iss_3 18822 29610.267705 2 100 0.000000 0.007131 0.000000 0 / 2018-04-08 13:25:11 [44994.223207] z_fr_iss_4 18823 29622.272217 2 100 0.000000 0.007400 0.000000 0 / 2018-04-08 13:25:11 [44994.234653] z_fr_iss_5 18824 29634.276093 2 100 0.000000 0.006750 0.000000 0 / 2018-04-08 13:25:11 [44994.246110] z_fr_iss_6 18825 29646.280135 2 100 0.000000 0.006811 0.000000 0 / 2018-04-08 13:25:11 [44994.257564] z_fr_iss_7 18826 29658.283783 2 100 0.000000 0.006916 0.000000 0 / 2018-04-08 13:25:11 [44994.269028] z_fr_int 18827 29670.287448 2 100 0.000000 0.006652 0.000000 0 / 2018-04-08 13:25:11 [44994.280492] z_cl_iss 18828 29682.292249 2 100 0.000000 0.007958 0.000000 0 / 2018-04-08 13:25:11 [44994.291948] z_cl_int 18829 29694.296347 2 100 0.000000 0.007173 0.000000 0 / 2018-04-08 13:25:11 [44994.303412] z_ioctl_iss 18830 29706.300394 2 100 0.000000 0.006911 0.000000 0 / 2018-04-08 13:25:11 [44994.314877] z_upgrade 18833 29742.317021 2 120 0.000000 0.006422 0.000000 0 / 2018-04-08 13:25:11 [44994.326341] dp_sync_taskq 18840 83093.707915 150 139 0.000000 1.128442 0.000000 0 / 2018-04-08 13:25:11 [44994.337811] dp_sync_taskq 18841 83091.192338 154 139 0.000000 1.017525 0.000000 0 / 2018-04-08 13:25:11 [44994.349275] dp_sync_taskq 18843 83089.977736 160 139 0.000000 1.059017 0.000000 0 / 2018-04-08 13:25:11 [44994.360732] dp_sync_taskq 18844 83089.976507 153 139 0.000000 1.131436 0.000000 0 / 2018-04-08 13:25:11 [44994.372197] dp_sync_taskq 18845 83090.621786 155 139 0.000000 1.052707 0.000000 0 / 2018-04-08 13:25:11 [44994.383662] dp_sync_taskq 18846 83090.493080 156 139 0.000000 1.101104 0.000000 0 / 2018-04-08 13:25:11 [44994.395124] dp_sync_taskq 18847 83089.941964 156 139 0.000000 1.119514 0.000000 0 / 2018-04-08 13:25:11 [44994.406600] dp_sync_taskq 18849 83090.008660 157 139 0.000000 1.042933 0.000000 0 / 2018-04-08 13:25:11 [44994.418054] dp_sync_taskq 18850 83089.971387 153 139 0.000000 1.119019 0.000000 0 / 2018-04-08 13:25:11 [44994.429496] z_iput 18852 29949.411893 2 120 0.000000 0.006563 0.000000 0 / 2018-04-08 13:25:11 [44994.440935] txg_quiesce 18937 7335096.813344 17970 120 0.000000 569.986608 0.000000 0 / 2018-04-08 13:25:11 [44994.452376] z_wr_iss 19342 312118.644860 211 101 0.000000 8.625834 0.000000 0 / 2018-04-08 13:25:11 [44994.463812] z_wr_iss_h 19352 33665.709879 2 100 0.000000 0.006446 0.000000 0 / 2018-04-08 13:25:11 [44994.475251] z_wr_int_h 19361 33773.742815 2 100 0.000000 0.006500 0.000000 0 / 2018-04-08 13:25:11 [44994.486697] z_fr_iss_0 19362 33785.746420 2 100 0.000000 0.006394 0.000000 0 / 2018-04-08 13:25:11 [44994.498124] z_fr_iss_1 19363 33797.750284 2 100 0.000000 0.006598 0.000000 0 / 2018-04-08 13:25:11 [44994.509557] z_fr_iss_2 19364 33809.754187 2 100 0.000000 0.006786 0.000000 0 / 2018-04-08 13:25:11 [44994.520984] z_fr_iss_3 19365 33821.758126 2 100 0.000000 0.006875 0.000000 0 / 2018-04-08 13:25:11 [44994.532410] z_fr_iss_4 19366 33833.762027 2 100 0.000000 0.007025 0.000000 0 / 2018-04-08 13:25:11 [44994.543834] z_fr_iss_5 19367 33845.765715 2 100 0.000000 0.006539 0.000000 0 / 2018-04-08 13:25:11 [44994.555250] z_fr_iss_6 19368 33857.769654 2 100 0.000000 0.006757 0.000000 0 / 2018-04-08 13:25:11 [44994.566670] z_fr_iss_7 19369 33869.773719 2 100 0.000000 0.006894 0.000000 0 / 2018-04-08 13:25:11 [44994.578087] z_fr_int 19370 33881.777698 2 100 0.000000 0.006849 0.000000 0 / 2018-04-08 13:25:11 [44994.589491] z_cl_iss 19371 33893.781532 2 100 0.000000 0.006698 0.000000 0 / 2018-04-08 13:25:11 [44994.600896] z_cl_int 19372 33905.785254 2 100 0.000000 0.006724 0.000000 0 / 2018-04-08 13:25:11 [44994.612298] z_ioctl_iss 19373 33917.789431 2 100 0.000000 0.007213 0.000000 0 / 2018-04-08 13:25:11 [44994.623705] z_upgrade 19376 33953.806794 2 120 0.000000 0.006777 0.000000 0 / 2018-04-08 13:25:11 [44994.635107] dp_sync_taskq 19382 312119.844381 153 139 0.000000 2.050838 0.000000 0 / 2018-04-08 13:25:11 [44994.646513] z_iput 19393 34160.721025 2 120 0.000000 0.006493 0.000000 0 / 2018-04-08 13:25:11 [44994.657916] z_wr_iss 19970 99263.439722 158 101 0.000000 5.821160 0.000000 0 / 2018-04-08 13:25:11 [44994.669333] z_wr_iss_h 19976 37203.970421 2 100 0.000000 0.006607 0.000000 0 / 2018-04-08 13:25:11 [44994.680737] z_wr_int_h 19985 37312.002807 2 100 0.000000 0.006487 0.000000 0 / 2018-04-08 13:25:11 [44994.692149] z_fr_iss_0 19986 37324.006356 2 100 0.000000 0.006201 0.000000 0 / 2018-04-08 13:25:11 [44994.703552] z_fr_iss_1 19987 37336.009876 2 100 0.000000 0.006369 0.000000 0 / 2018-04-08 13:25:11 [44994.714960] z_fr_iss_2 19988 37348.013399 2 100 0.000000 0.006406 0.000000 0 / 2018-04-08 13:25:12 [44994.726374] z_fr_iss_3 19989 37360.017037 2 100 0.000000 0.006472 0.000000 0 / 2018-04-08 13:25:12 [44994.737781] z_fr_iss_4 19990 37372.020620 2 100 0.000000 0.006458 0.000000 0 / 2018-04-08 13:25:12 [44994.749176] z_fr_iss_5 19991 37384.023947 2 100 0.000000 0.006286 0.000000 0 / 2018-04-08 13:25:12 [44994.760574] z_fr_iss_6 19992 37396.027515 2 100 0.000000 0.006237 0.000000 0 / 2018-04-08 13:25:12 [44994.771984] z_fr_iss_7 19993 37408.030788 2 100 0.000000 0.006032 0.000000 0 / 2018-04-08 13:25:12 [44994.783382] z_fr_int 19994 37420.034266 2 100 0.000000 0.006361 0.000000 0 / 2018-04-08 13:25:12 [44994.794795] z_cl_iss 19995 37432.037887 2 100 0.000000 0.006375 0.000000 0 / 2018-04-08 13:25:12 [44994.806208] z_cl_int 19996 37444.041598 2 100 0.000000 0.006729 0.000000 0 / 2018-04-08 13:25:12 [44994.817616] z_ioctl_iss 19997 37456.045133 2 100 0.000000 0.006628 0.000000 0 / 2018-04-08 13:25:12 [44994.829013] z_upgrade 20000 37480.058798 2 120 0.000000 0.006521 0.000000 0 / 2018-04-08 13:25:12 [44994.840411] z_iput 20017 37687.049563 2 120 0.000000 0.006152 0.000000 0 / 2018-04-08 13:25:12 [44994.851816] z_rd_int_0 20537 106105.608670 1565 100 0.000000 13.019157 0.000000 0 / 2018-04-08 13:25:12 [44994.863219] z_wr_iss 20547 103170.453421 174 101 0.000000 7.218605 0.000000 0 / 2018-04-08 13:25:12 [44994.874613] z_wr_iss_h 20557 40857.572590 2 100 0.000000 0.006791 0.000000 0 / 2018-04-08 13:25:12 [44994.886019] z_wr_int_h 20566 40965.607683 2 100 0.000000 0.006577 0.000000 0 / 2018-04-08 13:25:12 [44994.897423] z_fr_iss_0 20567 40977.611723 2 100 0.000000 0.007123 0.000000 0 / 2018-04-08 13:25:12 [44994.908827] z_fr_iss_1 20568 40989.615851 2 100 0.000000 0.007094 0.000000 0 / 2018-04-08 13:25:12 [44994.920229] z_fr_iss_2 20569 41001.619700 2 100 0.000000 0.006653 0.000000 0 / 2018-04-08 13:25:12 [44994.931642] z_fr_iss_3 20570 41013.629812 2 100 0.000000 0.013152 0.000000 0 / 2018-04-08 13:25:12 [44994.943047] z_fr_iss_4 20571 41025.634018 2 100 0.000000 0.007146 0.000000 0 / 2018-04-08 13:25:12 [44994.954460] z_fr_iss_5 20572 41037.637940 2 100 0.000000 0.007035 0.000000 0 / 2018-04-08 13:25:12 [44994.965879] z_fr_iss_6 20573 41049.642047 2 100 0.000000 0.007170 0.000000 0 / 2018-04-08 13:25:12 [44994.977288] z_fr_iss_7 20574 41061.646013 2 100 0.000000 0.006961 0.000000 0 / 2018-04-08 13:25:12 [44994.988688] z_fr_int 20575 41073.649737 2 100 0.000000 0.006521 0.000000 0 / 2018-04-08 13:25:12 [44995.000076] z_cl_iss 20576 41085.653630 2 100 0.000000 0.006963 0.000000 0 / 2018-04-08 13:25:12 [44995.011478] z_cl_int 20577 41097.657402 2 100 0.000000 0.006552 0.000000 0 / 2018-04-08 13:25:12 [44995.022881] z_ioctl_iss 20578 41109.661311 2 100 0.000000 0.007013 0.000000 0 / 2018-04-08 13:25:12 [44995.034270] z_upgrade 20581 41145.679154 2 120 0.000000 0.006558 0.000000 0 / 2018-04-08 13:25:12 [44995.045673] z_iput 20598 41352.763255 2 120 0.000000 0.006411 0.000000 0 / 2018-04-08 13:25:12 [44995.057072] z_wr_iss 21265 95238.719956 62 101 0.000000 2.754221 0.000000 0 / 2018-04-08 13:25:12 [44995.068477] dp_sync_taskq 21298 95240.043374 57 139 0.000000 0.611818 0.000000 0 / 2018-04-08 13:25:12 [44995.079874] dp_sync_taskq 21306 95239.081224 52 139 0.000000 0.482406 0.000000 0 / 2018-04-08 13:25:12 [44995.091286] z_null_iss 21849 7336382.890498 89545 100 0.000000 4034.852013 0.000000 0 / 2018-04-08 13:25:12 [44995.102696] z_rd_int_4 21856 7227716.787580 3209 100 0.000000 33.067901 0.000000 0 / 2018-04-08 13:25:12 [44995.114117] z_wr_iss_h 21872 45129.213275 2 100 0.000000 0.007017 0.000000 0 / 2018-04-08 13:25:12 [44995.125530] z_wr_int_h 21881 45237.247201 2 100 0.000000 0.006985 0.000000 0 / 2018-04-08 13:25:12 [44995.136939] z_fr_iss_0 21882 45249.250938 2 100 0.000000 0.006719 0.000000 0 / 2018-04-08 13:25:12 [44995.148354] z_fr_iss_1 21883 45261.254614 2 100 0.000000 0.006870 0.000000 0 / 2018-04-08 13:25:12 [44995.159764] z_fr_iss_2 21884 45273.258358 2 100 0.000000 0.006885 0.000000 0 / 2018-04-08 13:25:12 [44995.171176] z_fr_iss_3 21885 45285.262079 2 100 0.000000 0.007014 0.000000 0 / 2018-04-08 13:25:12 [44995.182589] z_fr_iss_4 21886 45297.265804 2 100 0.000000 0.006720 0.000000 0 / 2018-04-08 13:25:12 [44995.193999] z_fr_iss_5 21887 45309.269592 2 100 0.000000 0.006956 0.000000 0 / 2018-04-08 13:25:12 [44995.205400] z_fr_iss_6 21888 45321.273568 2 100 0.000000 0.007335 0.000000 0 / 2018-04-08 13:25:12 [44995.216791] z_fr_iss_7 21889 45333.277295 2 100 0.000000 0.006659 0.000000 0 / 2018-04-08 13:25:12 [44995.228194] z_fr_int 21890 45345.281135 2 100 0.000000 0.006838 0.000000 0 / 2018-04-08 13:25:12 [44995.239590] z_cl_iss 21891 45357.284882 2 100 0.000000 0.006979 0.000000 0 / 2018-04-08 13:25:12 [44995.250978] z_cl_int 21892 45369.288811 2 100 0.000000 0.007188 0.000000 0 / 2018-04-08 13:25:12 [44995.262370] z_ioctl_iss 21893 45381.292377 2 100 0.000000 0.006530 0.000000 0 / 2018-04-08 13:25:12 [44995.273777] z_zvol 21895 47144.661087 19 120 0.000000 0.699970 0.000000 0 / 2018-04-08 13:25:12 [44995.285184] z_upgrade 21896 45417.310527 2 120 0.000000 0.007566 0.000000 0 / 2018-04-08 13:25:12 [44995.296599] dp_sync_taskq 21906 7228435.580582 6850 139 0.000000 134.890553 0.000000 0 / 2018-04-08 13:25:12 [44995.308015] z_iput 21913 45624.553191 2 120 0.000000 0.006586 0.000000 0 / 2018-04-08 13:25:12 [44995.319435] z_wr_iss 22447 7192018.477069 676 101 0.000000 22.627493 0.000000 0 / 2018-04-08 13:25:12 [44995.330850] z_wr_iss_h 22450 48320.358242 2 100 0.000000 0.006825 0.000000 0 / 2018-04-08 13:25:12 [44995.342268] z_wr_int_h 22459 48428.391034 2 100 0.000000 0.007240 0.000000 0 / 2018-04-08 13:25:12 [44995.353677] z_fr_iss_0 22460 48440.394562 2 100 0.000000 0.006850 0.000000 0 / 2018-04-08 13:25:12 [44995.365090] z_fr_iss_1 22461 48452.398246 2 100 0.000000 0.006775 0.000000 0 / 2018-04-08 13:25:12 [44995.376517] z_fr_iss_2 22462 48464.401636 2 100 0.000000 0.006486 0.000000 0 / 2018-04-08 13:25:12 [44995.387936] z_fr_iss_3 22463 48476.405348 2 100 0.000000 0.007017 0.000000 0 / 2018-04-08 13:25:12 [44995.399352] z_fr_iss_4 22464 48488.409314 2 100 0.000000 0.006746 0.000000 0 / 2018-04-08 13:25:12 [44995.410769] z_fr_iss_5 22465 48500.412888 2 100 0.000000 0.006656 0.000000 0 / 2018-04-08 13:25:12 [44995.422176] z_fr_iss_6 22466 48512.416112 2 100 0.000000 0.006295 0.000000 0 / 2018-04-08 13:25:12 [44995.433570] z_fr_iss_7 22467 48524.419470 2 100 0.000000 0.006268 0.000000 0 / 2018-04-08 13:25:12 [44995.444981] z_fr_int 22468 48536.423084 2 100 0.000000 0.006589 0.000000 0 / 2018-04-08 13:25:12 [44995.456395] z_cl_iss 22469 48548.426519 2 100 0.000000 0.006285 0.000000 0 / 2018-04-08 13:25:12 [44995.467809] z_cl_int 22470 48560.430101 2 100 0.000000 0.007165 0.000000 0 / 2018-04-08 13:25:12 [44995.479219] z_ioctl_iss 22471 48572.433748 2 100 0.000000 0.006689 0.000000 0 / 2018-04-08 13:25:12 [44995.490627] z_zvol 22473 50235.863588 11 120 0.000000 0.890968 0.000000 0 / 2018-04-08 13:25:12 [44995.502041] z_upgrade 22474 48608.451114 2 120 0.000000 0.006800 0.000000 0 / 2018-04-08 13:25:12 [44995.513457] z_iput 22492 48815.865930 2 120 0.000000 0.006798 0.000000 0 / 2018-04-08 13:25:12 [44995.524870] cfs_rh_01 23034 5851109.369105 227 120 0.000000 7.434470 0.000000 0 / 2018-04-08 13:25:12 [44995.536293] cfs_rh_03 23036 5578098.932847 227 120 0.000000 4.262746 0.000000 0 / 2018-04-08 13:25:12 [44995.547706] clio 23045 51175.941212 2 100 0.000000 0.007540 0.000000 0 / 2018-04-08 13:25:12 [44995.559131] ptlrpc_hr00_003 23051 630936.350625 3 120 0.000000 0.012500 0.000000 0 / 2018-04-08 13:25:12 [44995.570564] ptlrpc_hr00_004 23052 51223.972710 2 120 0.000000 0.006442 0.000000 0 / 2018-04-08 13:25:12 [44995.581983] ptlrpc_hr00_005 23053 51235.978855 2 120 0.000000 0.006151 0.000000 0 / 2018-04-08 13:25:12 [44995.593402] ptlrpc_hr00_006 23054 51247.984989 2 120 0.000000 0.006140 0.000000 0 / 2018-04-08 13:25:12 [44995.604817] ptlrpc_hr00_007 23055 51259.991649 2 120 0.000000 0.006666 0.000000 0 / 2018-04-08 13:25:12 [44995.616228] ib_fmr(hfi1_0) 23082 51512.407363 2 120 0.000000 0.005828 0.000000 0 / 2018-04-08 13:25:12 [44995.627651] ib_fmr(hfi1_0) 23083 51524.413301 2 120 0.000000 0.005944 0.000000 0 / 2018-04-08 13:25:12 [44995.639068] router_checker 23084 51536.420822 2 120 0.000000 0.007527 0.000000 0 / 2018-04-08 13:25:12 [44995.650485] ptlrpcd_00_00 23086 7335302.236533 75174 120 0.000000 1472.499989 0.000000 0 / 2018-04-08 13:25:12 [44995.661899] ptlrpcd_00_04 23090 7336030.816201 75058 120 0.000000 1467.511485 0.000000 0 / 2018-04-08 13:25:12 [44995.673321] ldlm_cb00_000 23109 75219.982860 11 120 0.000000 0.053152 0.000000 0 / 2018-04-08 13:25:12 [44995.684739] lc_watchdogd 23110 51800.647996 2 120 0.000000 0.007002 0.000000 0 / 2018-04-08 13:25:12 [44995.696162] ldlm_cn00_000 23114 7175130.244592 11633 120 0.000000 147.812894 0.000000 0 / 2018-04-08 13:25:12 [44995.707589] ldlm_elt 23122 51932.771856 2 120 0.000000 0.006495 0.000000 0 / 2018-04-08 13:25:13 [44995.719014] mgs_params_noti 23128 51956.790151 2 118 0.000000 0.011178 0.000000 0 / 2018-04-08 13:25:13 [44995.730457] ll_evictor 23135 52004.860665 2 120 0.000000 0.007064 0.000000 0 / 2018-04-08 13:25:13 [44995.741890] mdt_rdpg00_001 24013 7333104.211009 11720 120 0.000000 129.962633 0.000000 0 / 2018-04-08 13:25:13 [44995.753332] mdt_attr00_000 24016 56358.197895 2 120 0.000000 0.045940 0.000000 0 / 2018-04-08 13:25:13 [44995.764764] mdt_attr00_001 24017 56370.221943 2 120 0.000000 0.024054 0.000000 0 / 2018-04-08 13:25:13 [44995.776202] mdt_seqs_0000 24024 56454.361793 2 120 0.000000 0.040406 0.000000 0 / 2018-04-08 13:25:13 [44995.787660] mdt_seqs_0001 24025 56466.375772 2 120 0.000000 0.013985 0.000000 0 / 2018-04-08 13:25:13 [44995.799105] mdt_seqm_0000 24026 56478.407584 2 120 0.000000 0.031818 0.000000 0 / 2018-04-08 13:25:13 [44995.810552] mdt_seqm_0001 24027 56490.419879 2 120 0.000000 0.012301 0.000000 0 / 2018-04-08 13:25:13 [44995.822004] qmt_reba_images 24074 56747.565994 2 120 0.000000 0.016153 0.000000 0 / 2018-04-08 13:25:13 [44995.833444] dist_txn-0 24239 57685.837758 2 120 0.000000 0.013026 0.000000 0 / 2018-04-08 13:25:13 [44995.844897] qmt_reba_apps-Q 24673 58621.131858 2 120 0.000000 0.013362 0.000000 0 / 2018-04-08 13:25:13 [44995.856325] osp-syn-0-0 24686 94013.840594 4 120 0.000000 0.134343 0.000000 0 / 2018-04-08 13:25:13 [44995.867762] dist_txn-0 24806 59319.256613 2 120 0.000000 0.016947 0.000000 0 / 2018-04-08 13:25:13 [44995.879198] qmt_reba_home-Q 25282 61307.221200 2 120 0.000000 0.013842 0.000000 0 / 2018-04-08 13:25:13 [44995.890639] osp-pre-2-0 26748 7335098.233499 8803 120 0.000000 157.559959 0.000000 0 / 2018-04-08 13:25:13 [44995.902072] osp-pre-6-0 26767 7335302.220783 8804 120 0.000000 170.783734 0.000000 0 / 2018-04-08 13:25:13 [44995.913521] osp-pre-7-0 26772 7335302.220919 8804 120 0.000000 172.114620 0.000000 0 / 2018-04-08 13:25:13 [44995.924970] osp-syn-9-0 26789 67324.891212 5 120 0.000000 0.127409 0.000000 0 / 2018-04-08 13:25:13 [44995.936428] osp_up2-0 26834 67312.705495 2 120 0.000000 0.013305 0.000000 0 / 2018-04-08 13:25:13 [44995.947870] mdt00_007 28411 7334671.655933 64907 120 0.000000 1454.642062 0.000000 0 / 2018-04-08 13:25:13 [44995.959327] osp_up0-1 28705 74616.505783 2 120 0.000000 0.014302 0.000000 0 / 2018-04-08 13:25:13 [44995.970796] osp-pre-1-1 28710 95610.909327 4 120 0.000000 0.034467 0.000000 0 / 2018-04-08 13:25:13 [44995.982262] osp-pre-3-1 28725 100575.158783 4 120 0.000000 0.021798 0.000000 0 / 2018-04-08 13:25:13 [44995.993727] osp-pre-4-1 28727 79588.013566 4 120 0.000000 0.021158 0.000000 0 / 2018-04-08 13:25:13 [44996.005201] osp-syn-6-1 28738 76188.305681 4 120 0.000000 0.113740 0.000000 0 / 2018-04-08 13:25:13 [44996.016677] osp-pre-15-1 28791 80440.894492 4 120 0.000000 0.027008 0.000000 0 / 2018-04-08 13:25:13 [44996.028150] osp_up2-1 28796 75049.996767 2 120 0.000000 0.011542 0.000000 0 / 2018-04-08 13:25:13 [44996.039623] osp_up0-2 30391 81955.987503 2 120 0.000000 0.021721 0.000000 0 / 2018-04-08 13:25:13 [44996.051092] osp-syn-6-2 30499 82161.275933 5 120 0.000000 0.371226 0.000000 0 / 2018-04-08 13:25:13 [44996.062556] osp-syn-7-2 30514 82173.620971 6 120 0.000000 0.340031 0.000000 0 / 2018-04-08 13:25:13 [44996.074018] osp-syn-8-2 30536 82197.923044 5 120 0.000000 0.358289 0.000000 0 / 2018-04-08 13:25:13 [44996.085490] osp-syn-9-2 30551 82234.195662 6 120 0.000000 0.331580 0.000000 0 / 2018-04-08 13:25:13 [44996.096955] osp-pre-12-2 30589 84965.706237 4 120 0.000000 0.023334 0.000000 0 / 2018-04-08 13:25:13 [44996.108422] osp-syn-14-2 30636 82969.897739 6 120 0.000000 0.387020 0.000000 0 / 2018-04-08 13:25:13 [44996.119887] osp_up1-2 30661 82355.631063 2 120 0.000000 0.012259 0.000000 0 / 2018-04-08 13:25:13 [44996.131356] z_wr_int_4 30994 83365.996459 3 100 0.000000 0.012467 0.000000 0 / 2018-04-08 13:25:13 [44996.142821] z_wr_int_2 31034 83365.993535 2 100 0.000000 0.006480 0.000000 0 / 2018-04-08 13:25:13 [44996.154286] z_wr_int_5 31044 83402.004659 2 100 0.000000 0.006367 0.000000 0 / 2018-04-08 13:25:13 [44996.165747] mdt_rdpg00_002 31986 7175130.215187 2997 120 0.000000 37.233686 0.000000 0 / 2018-04-08 13:25:13 [44996.177218] mdt00_009 32612 7336382.969090 91962 120 0.000000 2099.555744 0.000000 0 / 2018-04-08 13:25:13 [44996.188686] z_wr_int_0 35458 103206.463320 2 100 0.000000 0.007038 0.000000 0 / 2018-04-08 13:25:13 [44996.200166] z_wr_int_1 35470 103230.470252 2 100 0.000000 0.006401 0.000000 0 / 2018-04-08 13:25:13 [44996.211646] mdt_out00_004 37366 7336030.815391 449369498 120 0.000000 10846800.268794 0.000000 0 / 2018-04-08 13:25:13 [44996.223109] mdt_rdpg00_015 37778 7175130.214914 6570 120 0.000000 75.541260 0.000000 0 / 2018-04-08 13:25:13 [44996.234577] mdt_rdpg00_016 276874 7175130.244506 37 120 0.000000 2.718024 0.000000 0 / 2018-04-08 13:25:13 [44996.246148] mdt_rdpg00_019 276879 7175130.416555 4008 120 0.000000 37.759430 0.000000 0 / 2018-04-08 13:25:13 [44996.257713] tx_commit_cb 281692 7176072.820495 5 120 0.000000 0.087250 0.000000 0 / 2018-04-08 13:25:13 [44996.269282] z_wr_int_6 282991 7228555.228203 3 100 0.000000 0.010405 0.000000 0 / 2018-04-08 13:25:13 [44996.280848] z_wr_int_3 282993 7228555.223704 2 100 0.000000 0.006783 0.000000 0 / 2018-04-08 13:25:13 [44996.292403] z_wr_int_3 283005 7228591.236271 2 100 0.000000 0.007099 0.000000 0 / 2018-04-08 13:25:13 [44996.303977] 2018-04-08 13:25:13 [44996.305813] cpu#3, 3200.000 MHz 2018-04-08 13:25:13 [44996.309285] .nr_running : 0 2018-04-08 13:25:13 [44996.314233] .load : 0 2018-04-08 13:25:13 [44996.319176] .nr_switches : 711787848 2018-04-08 13:25:13 [44996.324815] .nr_load_updates : 16603803 2018-04-08 13:25:13 [44996.330363] .nr_uninterruptible : 835 2018-04-08 13:25:13 [44996.335479] .next_balance : 4339.772650 2018-04-08 13:25:13 [44996.341291] .curr->pid : 0 2018-04-08 13:25:13 [44996.346232] .clock : 44996346.204260 2018-04-08 13:25:13 [44996.352377] .cpu_load[0] : 0 2018-04-08 13:25:13 [44996.357310] .cpu_load[1] : 170 2018-04-08 13:25:13 [44996.362415] .cpu_load[2] : 556 2018-04-08 13:25:13 [44996.367513] .cpu_load[3] : 444 2018-04-08 13:25:13 [44996.372609] .cpu_load[4] : 341 2018-04-08 13:25:13 [44996.377697] .avg_idle : 28061 2018-04-08 13:25:13 [44996.382962] .max_idle_balance_cost : 500000 2018-04-08 13:25:13 [44996.388310] 2018-04-08 13:25:13 [44996.388310] cfs_rq[3]:/ 2018-04-08 13:25:13 [44996.392808] .exec_clock : 0.000000 2018-04-08 13:25:13 [44996.398321] .MIN_vruntime : 0.000001 2018-04-08 13:25:13 [44996.403827] .min_vruntime : 5713031.616853 2018-04-08 13:25:13 [44996.409850] .max_vruntime : 0.000001 2018-04-08 13:25:13 [44996.415354] .spread : 0.000000 2018-04-08 13:25:13 [44996.420851] .spread0 : -1448798.473541 2018-04-08 13:25:13 [44996.426956] .nr_spread_over : 0 2018-04-08 13:25:13 [44996.431845] .nr_running : 0 2018-04-08 13:25:13 [44996.436737] .load : 0 2018-04-08 13:25:13 [44996.441627] .runnable_load_avg : 323 2018-04-08 13:25:13 [44996.446685] .blocked_load_avg : 323 2018-04-08 13:25:13 [44996.451742] .tg_load_avg : 0 2018-04-08 13:25:13 [44996.456623] .tg_load_contrib : 0 2018-04-08 13:25:13 [44996.461505] .tg_runnable_contrib : 0 2018-04-08 13:25:13 [44996.466387] .tg->runnable_avg : 0 2018-04-08 13:25:13 [44996.471264] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:13 [44996.476139] .throttled : 0 2018-04-08 13:25:13 [44996.481011] .throttle_count : 0 2018-04-08 13:25:13 [44996.485883] .avg->runnable_avg_sum : 14349 2018-04-08 13:25:13 [44996.491092] .avg->runnable_avg_period : 46364 2018-04-08 13:25:13 [44996.496305] 2018-04-08 13:25:13 [44996.496305] rt_rq[3]:/ 2018-04-08 13:25:13 [44996.500626] .rt_nr_running : 0 2018-04-08 13:25:13 [44996.505469] .rt_throttled : 0 2018-04-08 13:25:13 [44996.510316] .rt_time : 0.000000 2018-04-08 13:25:13 [44996.515758] .rt_runtime : 950.000000 2018-04-08 13:25:13 [44996.521374] 2018-04-08 13:25:13 [44996.521374] runnable tasks: 2018-04-08 13:25:13 [44996.521374] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:13 [44996.521374] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:13 [44996.547931] migration/3 24 0.000000 2526 0 0.000000 997.559552 0.000000 1 / 2018-04-08 13:25:13 [44996.559317] ksoftirqd/3 25 5712989.467209 18570 120 0.000000 110.226976 0.000000 1 / 2018-04-08 13:25:13 [44996.570717] kworker/3:0H 27 2235.201898 9 100 0.000000 0.019206 0.000000 1 / 2018-04-08 13:25:13 [44996.582110] writeback 93 47.495986 2 100 0.000000 0.006042 0.000000 1 / 2018-04-08 13:25:13 [44996.593496] kintegrityd 94 59.501245 2 100 0.000000 0.005695 0.000000 1 / 2018-04-08 13:25:13 [44996.604894] bioset 95 71.506042 2 100 0.000000 0.005196 0.000000 1 / 2018-04-08 13:25:13 [44996.616296] kblockd 96 83.511263 2 100 0.000000 0.005636 0.000000 1 / 2018-04-08 13:25:13 [44996.627689] md 98 107.520701 2 100 0.000000 0.005940 0.000000 1 / 2018-04-08 13:25:13 [44996.639085] kworker/3:1 101 5712989.468223 31603 120 0.000000 278.660325 0.000000 1 / 2018-04-08 13:25:13 [44996.650482] kswapd1 107 693.524110 3 120 0.000000 0.012683 0.000000 1 / 2018-04-08 13:25:13 [44996.661900] ksmd 108 585.283768 2 125 0.000000 0.011401 0.000000 1 / 2018-04-08 13:25:13 [44996.673309] crypto 110 609.353549 2 100 0.000000 0.010376 0.000000 1 / 2018-04-08 13:25:13 [44996.684733] kthrotld 118 705.522730 2 100 0.000000 0.010283 0.000000 1 / 2018-04-08 13:25:13 [44996.696147] kmpath_rdacd 120 717.538060 2 100 0.000000 0.015643 0.000000 1 / 2018-04-08 13:25:14 [44996.707563] ib-comp-wq 332 1364.327026 2 100 0.000000 0.007154 0.000000 1 / 2018-04-08 13:25:14 [44996.718984] ib_addr 333 1376.332654 2 100 0.000000 0.006187 0.000000 1 / 2018-04-08 13:25:14 [44996.730412] ib_mcast 334 1388.338418 2 100 0.000000 0.006354 0.000000 1 / 2018-04-08 13:25:14 [44996.741845] ib_nl_sa_wq 335 1400.343994 2 100 0.000000 0.006089 0.000000 1 / 2018-04-08 13:25:14 [44996.753266] scsi_tmf_2 349 1502.819400 2 100 0.000000 0.006237 0.000000 1 / 2018-04-08 13:25:14 [44996.764681] scsi_eh_3 350 1534.236138 22 120 0.000000 0.194832 0.000000 1 / 2018-04-08 13:25:14 [44996.776113] bnx2x_iov 400 1544.821931 2 100 0.000000 0.006855 0.000000 1 / 2018-04-08 13:25:14 [44996.787544] bond0 491 1848.888257 2 100 0.000000 0.011202 0.000000 1 / 2018-04-08 13:25:14 [44996.798986] poll_mpt3sas0_s 601 2065.544537 2 100 0.000000 0.046977 0.000000 1 / 2018-04-08 13:25:14 [44996.810428] kworker/3:1H 685 5712989.464339 21045 100 0.000000 57.082198 0.000000 1 / 2018-04-08 13:25:14 [44996.821876] kworker/u898:3 1128 81428.551693 94 120 0.000000 2.316404 0.000000 1 / 2018-04-08 13:25:14 [44996.833322] multipathd 4274 0.000000 171344 0 0.000000 4219.841830 0.000000 1 / 2018-04-08 13:25:14 [44996.844783] kdmwork-253:0 4007 5712989.474040 46665 120 0.000000 1020.119756 0.000000 1 / 2018-04-08 13:25:14 [44996.856250] lvmetad 4144 6634.526419 7 120 0.000000 3.295485 0.000000 1 / 2018-04-08 13:25:14 [44996.867714] kworker/3:2 4256 6861.272168 4 120 0.000000 0.011609 0.000000 1 / 2018-04-08 13:25:14 [44996.879180] ttm_swap 4461 6986.321107 2 100 0.000000 0.007050 0.000000 1 / 2018-04-08 13:25:14 [44996.890659] zed 9141 58883.518735 61 120 0.000000 1.586111 0.000000 1 / 2018-04-08 13:25:14 [44996.902132] sshd 8954 5643372.393134 22 120 0.000000 9.283669 0.000000 1 / 2018-04-08 13:25:14 [44996.913617] agetty 9048 21598.635383 36 120 0.000000 8.686304 0.000000 1 / 2018-04-08 13:25:14 [44996.925094] z_vdev_file 9129 15309.472218 2 139 0.000000 0.009466 0.000000 1 / 2018-04-08 13:25:14 [44996.936576] kdmwork-253:15 9316 5712370.609217 46487 120 0.000000 1059.080124 0.000000 1 / 2018-04-08 13:25:14 [44996.948075] irq/99-hfi1_0 k 14361 0.000000 2 49 0.000000 0.012343 0.000000 1 / 2018-04-08 13:25:14 [44996.959566] irq/100-hfi1_0 14362 0.000000 2 49 0.000000 0.006602 0.000000 1 / 2018-04-08 13:25:14 [44996.971068] irq/101-hfi1_0 14363 0.000000 2 49 0.000000 0.006035 0.000000 1 / 2018-04-08 13:25:14 [44996.982555] irq/102-hfi1_0 14364 0.000000 2 49 0.000000 0.006419 0.000000 1 / 2018-04-08 13:25:14 [44996.994054] ib_mad1 14414 20259.026604 2 100 0.000000 0.006590 0.000000 1 / 2018-04-08 13:25:14 [44997.005553] ipoib_wq 14419 20271.032735 2 100 0.000000 0.006562 0.000000 1 / 2018-04-08 13:25:14 [44997.017038] pcsd 14509 5713089.427812 22544 120 0.000000 894.534920 0.000000 1 / 2018-04-08 13:25:14 [44997.028533] gmain 15450 24782.718738 5 120 0.000000 0.146707 0.000000 1 / 2018-04-08 13:25:14 [44997.040035] JS GC Helper 15452 24806.952449 3 120 0.000000 0.060989 0.000000 1 / 2018-04-08 13:25:14 [44997.051543] JS Sour~ Thread 15453 24819.055323 6 120 0.000000 0.075046 0.000000 1 / 2018-04-08 13:25:14 [44997.063055] polkitd 15454 24831.056326 3 120 0.000000 0.037112 0.000000 1 / 2018-04-08 13:25:14 [44997.074559] z_null_int 18787 5712989.464161 89397 100 0.000000 601.752775 0.000000 1 / 2018-04-08 13:25:14 [44997.086067] txg_sync 18938 5712989.511695 18216 120 0.000000 431.344530 0.000000 1 / 2018-04-08 13:25:14 [44997.097564] mmp 19595 5712989.473865 88919 120 0.000000 1518.050581 0.000000 1 / 2018-04-08 13:25:14 [44997.109053] z_wr_iss 20551 91258.450552 180 101 0.000000 6.230422 0.000000 1 / 2018-04-08 13:25:14 [44997.120536] z_rd_int_2 21250 4697555.812341 830 100 0.000000 10.172998 0.000000 1 / 2018-04-08 13:25:14 [44997.132026] z_rd_int_6 21254 4697555.812293 797 100 0.000000 9.497345 0.000000 1 / 2018-04-08 13:25:14 [44997.143512] z_wr_iss_h 21268 54084.343282 2 100 0.000000 0.007248 0.000000 1 / 2018-04-08 13:25:14 [44997.155004] z_wr_int_2 21271 88899.873591 342 100 0.000000 3.149736 0.000000 1 / 2018-04-08 13:25:14 [44997.166496] z_wr_int_7 21276 88899.872350 326 100 0.000000 2.891576 0.000000 1 / 2018-04-08 13:25:14 [44997.177985] z_wr_int_h 21277 54192.384133 2 100 0.000000 0.007378 0.000000 1 / 2018-04-08 13:25:14 [44997.189464] z_fr_iss_0 21278 54204.388591 2 100 0.000000 0.007777 0.000000 1 / 2018-04-08 13:25:14 [44997.200942] z_fr_iss_1 21279 54216.392965 2 100 0.000000 0.007061 0.000000 1 / 2018-04-08 13:25:14 [44997.212431] z_fr_iss_2 21280 54228.397545 2 100 0.000000 0.007673 0.000000 1 / 2018-04-08 13:25:14 [44997.223918] z_fr_iss_3 21281 54240.405820 2 100 0.000000 0.011215 0.000000 1 / 2018-04-08 13:25:14 [44997.235389] z_fr_iss_4 21282 54252.410447 2 100 0.000000 0.008159 0.000000 1 / 2018-04-08 13:25:14 [44997.246861] z_fr_iss_5 21283 54264.414862 2 100 0.000000 0.007378 0.000000 1 / 2018-04-08 13:25:14 [44997.258333] z_fr_iss_6 21284 54276.418893 2 100 0.000000 0.007440 0.000000 1 / 2018-04-08 13:25:14 [44997.269802] z_fr_iss_7 21285 54288.423463 2 100 0.000000 0.007882 0.000000 1 / 2018-04-08 13:25:14 [44997.281267] z_fr_int 21286 54300.427960 2 100 0.000000 0.007459 0.000000 1 / 2018-04-08 13:25:14 [44997.292747] z_cl_iss 21287 54312.433056 2 100 0.000000 0.008410 0.000000 1 / 2018-04-08 13:25:14 [44997.304210] z_cl_int 21288 54324.437669 2 100 0.000000 0.007730 0.000000 1 / 2018-04-08 13:25:14 [44997.315671] z_ioctl_iss 21289 54336.442109 2 100 0.000000 0.007231 0.000000 1 / 2018-04-08 13:25:14 [44997.327141] z_ioctl_int 21290 88899.872426 31 100 0.000000 0.117588 0.000000 1 / 2018-04-08 13:25:14 [44997.338606] z_upgrade 21292 54372.460644 2 120 0.000000 0.007033 0.000000 1 / 2018-04-08 13:25:14 [44997.350072] z_iput 21310 54579.943360 2 120 0.000000 0.008191 0.000000 1 / 2018-04-08 13:25:14 [44997.361532] z_wr_iss 21865 5636663.964677 13879 101 0.000000 626.255055 0.000000 1 / 2018-04-08 13:25:14 [44997.373006] dp_sync_taskq 21904 5636664.356331 6920 139 0.000000 131.156048 0.000000 1 / 2018-04-08 13:25:14 [44997.384464] dp_sync_taskq 21911 5636664.431561 6834 139 0.000000 129.190389 0.000000 1 / 2018-04-08 13:25:14 [44997.395928] mmp 22585 5712989.477049 88872 120 0.000000 1224.382225 0.000000 1 / 2018-04-08 13:25:14 [44997.407390] cfs_rh_00 23033 4533470.530150 230 120 0.000000 3.083393 0.000000 1 / 2018-04-08 13:25:14 [44997.418856] ptlrpc_hr01_000 23056 5131440.039626 12396 120 0.000000 60.287160 0.000000 1 / 2018-04-08 13:25:14 [44997.430324] ldlm_cb01_000 23112 76298.248175 6 120 0.000000 0.068671 0.000000 1 / 2018-04-08 13:25:14 [44997.441782] mdt_rdpg01_000 24014 5590642.650265 13453 120 0.000000 133.150419 0.000000 1 / 2018-04-08 13:25:14 [44997.453252] osp-pre-0-0 24084 5712989.472121 8814 120 0.000000 164.919065 0.000000 1 / 2018-04-08 13:25:14 [44997.464710] osp-syn-1-0 24107 66629.935176 4 120 0.000000 0.153078 0.000000 1 / 2018-04-08 13:25:14 [44997.476171] tx_commit_cb 24564 88899.881188 6 120 0.000000 0.377957 0.000000 1 / 2018-04-08 13:25:14 [44997.487623] mdt01_005 24567 5713089.708666 832045 120 0.000000 11749.359063 0.000000 1 / 2018-04-08 13:25:14 [44997.499089] dist_txn-0 25501 64274.241755 2 120 0.000000 0.013739 0.000000 1 / 2018-04-08 13:25:14 [44997.510558] qmt_reba_dagg-Q 26729 98572.322188 4 120 0.000000 0.058525 0.000000 1 / 2018-04-08 13:25:14 [44997.522035] osp-syn-1-0 26745 85334.623235 4 120 0.000000 0.114951 0.000000 1 / 2018-04-08 13:25:14 [44997.533510] osp-pre-3-0 26750 5712989.476086 8804 120 0.000000 157.342196 0.000000 1 / 2018-04-08 13:25:14 [44997.544985] osp-pre-12-0 26806 5712989.472329 8805 120 0.000000 160.148450 0.000000 1 / 2018-04-08 13:25:14 [44997.556455] dist_txn-0 27005 67494.186575 2 120 0.000000 0.016976 0.000000 1 / 2018-04-08 13:25:14 [44997.567923] osp-pre-14-1 28787 74591.393972 4 120 0.000000 0.028707 0.000000 1 / 2018-04-08 13:25:14 [44997.579402] osp-pre-5-2 30468 79228.730165 4 120 0.000000 0.033432 0.000000 1 / 2018-04-08 13:25:14 [44997.590876] osp-pre-7-2 30506 79228.721922 4 120 0.000000 0.019735 0.000000 1 / 2018-04-08 13:25:14 [44997.602344] osp-pre-8-2 30525 79254.251565 4 120 0.000000 0.030084 0.000000 1 / 2018-04-08 13:25:14 [44997.613818] ldlm_cb01_002 31071 98572.287026 12 120 0.000000 0.045325 0.000000 1 / 2018-04-08 13:25:14 [44997.625272] tx_commit_cb 31563 91258.459243 12 120 0.000000 1.179666 0.000000 1 / 2018-04-08 13:25:14 [44997.636735] mdt_fld_0002 31987 91642.998794 6 120 0.000000 0.036638 0.000000 1 / 2018-04-08 13:25:14 [44997.648209] mdt_rdpg01_006 32913 5589256.210543 168639 120 0.000000 1721.225563 0.000000 1 / 2018-04-08 13:25:14 [44997.659673] z_wr_int_4 34470 88887.863673 2 100 0.000000 0.006749 0.000000 1 / 2018-04-08 13:25:14 [44997.671145] z_wr_int_4 35149 90981.549272 2 100 0.000000 0.006298 0.000000 1 / 2018-04-08 13:25:14 [44997.682601] z_wr_int_4 35150 90993.553409 2 100 0.000000 0.006636 0.000000 1 / 2018-04-08 13:25:14 [44997.694070] z_wr_int_4 35151 91005.557058 2 100 0.000000 0.006031 0.000000 1 / 2018-04-08 13:25:14 [44997.705532] z_wr_int_6 35152 91041.571690 3 100 0.000000 0.010189 0.000000 1 / 2018-04-08 13:25:14 [44997.716996] z_wr_int_6 35154 91041.567963 2 100 0.000000 0.005922 0.000000 1 / 2018-04-08 13:25:15 [44997.728443] z_wr_int_5 282331 5604542.846001 2 100 0.000000 0.007607 0.000000 1 / 2018-04-08 13:25:15 [44997.739998] z_wr_int_4 282336 5604566.855521 2 100 0.000000 0.007452 0.000000 1 / 2018-04-08 13:25:15 [44997.751557] z_wr_int_4 282337 5604578.859780 2 100 0.000000 0.006378 0.000000 1 / 2018-04-08 13:25:15 [44997.763107] z_wr_int_3 282338 5604590.864146 2 100 0.000000 0.007155 0.000000 1 / 2018-04-08 13:25:15 [44997.774665] z_wr_int_3 282339 5604602.868984 2 100 0.000000 0.006715 0.000000 1 / 2018-04-08 13:25:15 [44997.786223] z_wr_int_0 282343 5604650.888014 2 100 0.000000 0.007247 0.000000 1 / 2018-04-08 13:25:15 [44997.797791] 2018-04-08 13:25:15 [44997.799624] cpu#4, 3200.000 MHz 2018-04-08 13:25:15 [44997.803102] .nr_running : 0 2018-04-08 13:25:15 [44997.808053] .load : 0 2018-04-08 13:25:15 [44997.813005] .nr_switches : 755348130 2018-04-08 13:25:15 [44997.818643] .nr_load_updates : 17998204 2018-04-08 13:25:15 [44997.824192] .nr_uninterruptible : -269 2018-04-08 13:25:15 [44997.829395] .next_balance : 4339.774144 2018-04-08 13:25:15 [44997.835207] .curr->pid : 0 2018-04-08 13:25:15 [44997.840152] .clock : 44997840.022849 2018-04-08 13:25:15 [44997.846303] .cpu_load[0] : 0 2018-04-08 13:25:15 [44997.851244] .cpu_load[1] : 0 2018-04-08 13:25:15 [44997.856177] .cpu_load[2] : 0 2018-04-08 13:25:15 [44997.861104] .cpu_load[3] : 0 2018-04-08 13:25:15 [44997.866025] .cpu_load[4] : 0 2018-04-08 13:25:15 [44997.870942] .avg_idle : 1000000 2018-04-08 13:25:15 [44997.876375] .max_idle_balance_cost : 500000 2018-04-08 13:25:15 [44997.881713] 2018-04-08 13:25:15 [44997.881713] cfs_rq[4]:/ 2018-04-08 13:25:15 [44997.886205] .exec_clock : 0.000000 2018-04-08 13:25:15 [44997.891702] .MIN_vruntime : 0.000001 2018-04-08 13:25:15 [44997.897196] .min_vruntime : 6691771.435493 2018-04-08 13:25:15 [44997.903201] .max_vruntime : 0.000001 2018-04-08 13:25:15 [44997.908685] .spread : 0.000000 2018-04-08 13:25:15 [44997.914163] .spread0 : -470177.953228 2018-04-08 13:25:15 [44997.920163] .nr_spread_over : 0 2018-04-08 13:25:15 [44997.925034] .nr_running : 0 2018-04-08 13:25:15 [44997.929895] .load : 0 2018-04-08 13:25:15 [44997.934750] .runnable_load_avg : 0 2018-04-08 13:25:15 [44997.939608] .blocked_load_avg : 0 2018-04-08 13:25:15 [44997.944465] .tg_load_avg : 0 2018-04-08 13:25:15 [44997.949324] .tg_load_contrib : 0 2018-04-08 13:25:15 [44997.954179] .tg_runnable_contrib : 0 2018-04-08 13:25:15 [44997.959026] .tg->runnable_avg : 0 2018-04-08 13:25:15 [44997.963871] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:15 [44997.968709] .throttled : 0 2018-04-08 13:25:15 [44997.973545] .throttle_count : 0 2018-04-08 13:25:15 [44997.978376] .avg->runnable_avg_sum : 88 2018-04-08 13:25:15 [44997.983296] .avg->runnable_avg_period : 47775 2018-04-08 13:25:15 [44997.988477] 2018-04-08 13:25:15 [44997.988477] rt_rq[4]:/ 2018-04-08 13:25:15 [44997.992753] .rt_nr_running : 0 2018-04-08 13:25:15 [44997.997583] .rt_throttled : 0 2018-04-08 13:25:15 [44998.002415] .rt_time : 0.000000 2018-04-08 13:25:15 [44998.007856] .rt_runtime : 950.000000 2018-04-08 13:25:15 [44998.013466] 2018-04-08 13:25:15 [44998.013466] runnable tasks: 2018-04-08 13:25:15 [44998.013466] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:15 [44998.013466] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:15 [44998.040002] rcu_sched 10 6691759.454448 1749500 120 0.000000 13921.319193 0.000000 0 / 2018-04-08 13:25:15 [44998.051392] migration/4 29 0.000000 813 0 0.000000 1836.737246 0.000000 0 / 2018-04-08 13:25:15 [44998.062785] ksoftirqd/4 30 6690654.365111 78248 120 0.000000 274.417237 0.000000 0 / 2018-04-08 13:25:15 [44998.074174] kworker/4:0H 32 3337.470256 9 100 0.000000 0.024805 0.000000 0 / 2018-04-08 13:25:15 [44998.085567] khugepaged 109 6690455.169527 4517 139 0.000000 150.080079 0.000000 0 / 2018-04-08 13:25:15 [44998.096972] scsi_eh_4 352 409.729942 22 120 0.000000 0.132865 0.000000 0 / 2018-04-08 13:25:15 [44998.108388] scsi_tmf_13 385 381.070802 2 100 0.000000 0.004985 0.000000 0 / 2018-04-08 13:25:15 [44998.119792] scsi_tmf_15 389 405.078440 2 100 0.000000 0.003830 0.000000 0 / 2018-04-08 13:25:15 [44998.131195] rdma_cm 1010 1171.194334 2 100 0.000000 0.006086 0.000000 0 / 2018-04-08 13:25:15 [44998.142609] multipathd 3585 0.000000 9070 0 0.000000 129.852888 0.000000 0 / 2018-04-08 13:25:15 [44998.154019] multipathd 4258 0.000000 3 0 0.000000 0.690104 0.000000 0 / 2018-04-08 13:25:15 [44998.165436] multipathd 4265 0.000000 10 0 0.000000 1.112942 0.000000 0 / 2018-04-08 13:25:15 [44998.176858] multipathd 4275 0.000000 254 0 0.000000 21.767142 0.000000 0 / 2018-04-08 13:25:15 [44998.188280] kvm-irqfd-clean 3561 2890.592996 2 100 0.000000 0.006440 0.000000 0 / 2018-04-08 13:25:15 [44998.199697] spl_system_task 3582 11432.692743 67 100 0.000000 2.908395 0.000000 0 / 2018-04-08 13:25:15 [44998.211130] spl_delay_taskq 3610 2951.032718 2 100 0.000000 0.016760 0.000000 0 / 2018-04-08 13:25:15 [44998.222561] bioset 4185 3034.441285 2 100 0.000000 0.007667 0.000000 0 / 2018-04-08 13:25:15 [44998.234003] kdmflush 4194 3042.561804 2 100 0.000000 0.007035 0.000000 0 / 2018-04-08 13:25:15 [44998.245436] bioset 4197 3042.564104 2 100 0.000000 0.007377 0.000000 0 / 2018-04-08 13:25:15 [44998.256872] bioset 4206 3042.568812 2 100 0.000000 0.006953 0.000000 0 / 2018-04-08 13:25:15 [44998.268292] kdmflush 4213 3042.600574 2 100 0.000000 0.006710 0.000000 0 / 2018-04-08 13:25:15 [44998.279722] bioset 4217 3042.602863 2 100 0.000000 0.006589 0.000000 0 / 2018-04-08 13:25:15 [44998.291153] bioset 4229 3042.607442 2 100 0.000000 0.006938 0.000000 0 / 2018-04-08 13:25:15 [44998.302598] kdmflush 4237 3042.612220 2 100 0.000000 0.007462 0.000000 0 / 2018-04-08 13:25:15 [44998.314026] bioset 4238 3042.614561 2 100 0.000000 0.007005 0.000000 0 / 2018-04-08 13:25:15 [44998.325460] kdmflush 4248 3042.619176 2 100 0.000000 0.007128 0.000000 0 / 2018-04-08 13:25:15 [44998.336900] bioset 4252 3042.621733 2 100 0.000000 0.007488 0.000000 0 / 2018-04-08 13:25:15 [44998.348345] kworker/4:1H 6116 6691415.285564 89430 100 0.000000 133.652196 0.000000 0 / 2018-04-08 13:25:15 [44998.359783] mcelog 9068 4808.133648 1 120 0.000000 1.955530 0.000000 0 / 2018-04-08 13:25:15 [44998.371234] kworker/4:16 12501 6691759.437741 37240 120 0.000000 293.278795 0.000000 0 / 2018-04-08 13:25:15 [44998.382685] kworker/4:17 12502 6295.522373 3 120 0.000000 0.008555 0.000000 0 / 2018-04-08 13:25:15 [44998.394153] sssd_nss 14468 6691415.293971 9479 120 0.000000 228.199635 0.000000 0 / 2018-04-08 13:25:15 [44998.405623] pcsd 14516 6682002.277506 154 120 0.000000 5.086131 0.000000 0 / 2018-04-08 13:25:15 [44998.417098] z_wr_iss 18799 13849.484552 125 101 0.000000 3.383814 0.000000 0 / 2018-04-08 13:25:15 [44998.428571] z_wr_int_3 18813 13861.488985 765 100 0.000000 6.175023 0.000000 0 / 2018-04-08 13:25:15 [44998.440050] z_wr_int_7 18817 13861.489852 753 100 0.000000 6.275750 0.000000 0 / 2018-04-08 13:25:15 [44998.451531] z_zvol 18832 10074.694978 17 120 0.000000 0.738462 0.000000 0 / 2018-04-08 13:25:15 [44998.463015] dp_sync_taskq 18842 13849.548737 154 139 0.000000 1.100132 0.000000 0 / 2018-04-08 13:25:15 [44998.474490] dp_sync_taskq 18851 13850.207236 158 139 0.000000 1.113791 0.000000 0 / 2018-04-08 13:25:15 [44998.485967] z_rd_int_4 19336 5530038.404178 586 100 0.000000 8.011595 0.000000 0 / 2018-04-08 13:25:15 [44998.497451] z_wr_iss 19344 221051.515437 207 101 0.000000 7.997456 0.000000 0 / 2018-04-08 13:25:15 [44998.508944] z_wr_iss 19350 221051.518073 202 101 0.000000 8.497037 0.000000 0 / 2018-04-08 13:25:15 [44998.520437] z_zvol 19375 10419.138548 17 120 0.000000 0.711604 0.000000 0 / 2018-04-08 13:25:15 [44998.531928] dp_sync_taskq 19383 221053.642279 156 139 0.000000 1.404621 0.000000 0 / 2018-04-08 13:25:15 [44998.543421] dp_sync_taskq 19384 221052.778023 153 139 0.000000 2.546840 0.000000 0 / 2018-04-08 13:25:15 [44998.554921] dp_sync_taskq 19389 221053.196534 149 139 0.000000 1.597445 0.000000 0 / 2018-04-08 13:25:15 [44998.566406] dp_sync_taskq 19390 221054.118149 154 139 0.000000 2.319949 0.000000 0 / 2018-04-08 13:25:15 [44998.577891] z_wr_iss 19969 15290.038810 172 101 0.000000 5.967512 0.000000 0 / 2018-04-08 13:25:15 [44998.589365] z_wr_int_1 19978 15290.605074 644 100 0.000000 6.114061 0.000000 0 / 2018-04-08 13:25:15 [44998.600835] z_zvol 19999 10521.241045 13 120 0.000000 0.882285 0.000000 0 / 2018-04-08 13:25:15 [44998.612304] dp_sync_taskq 20008 15295.017633 108 139 0.000000 1.593691 0.000000 0 / 2018-04-08 13:25:15 [44998.623778] dp_sync_taskq 20009 15292.609763 122 139 0.000000 1.479050 0.000000 0 / 2018-04-08 13:25:15 [44998.635231] z_wr_iss 20553 16521.681144 176 101 0.000000 7.270022 0.000000 0 / 2018-04-08 13:25:15 [44998.646694] z_wr_int_0 20558 16521.681127 707 100 0.000000 7.662283 0.000000 0 / 2018-04-08 13:25:15 [44998.658155] z_wr_int_2 20560 16521.681218 727 100 0.000000 7.806736 0.000000 0 / 2018-04-08 13:25:15 [44998.669615] dp_sync_taskq 21301 15079.811931 53 139 0.000000 0.824289 0.000000 0 / 2018-04-08 13:25:15 [44998.681080] dp_sync_taskq 21307 15080.320654 55 139 0.000000 0.569315 0.000000 0 / 2018-04-08 13:25:15 [44998.692538] z_rd_iss 21851 6569390.888326 41 100 0.000000 0.709605 0.000000 0 / 2018-04-08 13:25:15 [44998.703996] z_rd_int_0 21852 6569406.082072 3290 100 0.000000 34.354666 0.000000 0 / 2018-04-08 13:25:16 [44998.715465] z_rd_int_3 21855 6569406.133369 3276 100 0.000000 33.800400 0.000000 0 / 2018-04-08 13:25:16 [44998.726931] dp_sync_taskq 21903 6570130.868767 6835 139 0.000000 137.126501 0.000000 0 / 2018-04-08 13:25:16 [44998.738387] dp_sync_taskq 21912 6570132.402037 7045 139 0.000000 136.943922 0.000000 0 / 2018-04-08 13:25:16 [44998.749855] z_rd_iss 22429 5072728.598666 64 100 0.000000 1.011154 0.000000 0 / 2018-04-08 13:25:16 [44998.761322] z_wr_int_3 22454 6518441.984761 3422 100 0.000000 30.628324 0.000000 0 / 2018-04-08 13:25:16 [44998.772796] z_wr_int_7 22458 6518453.987566 3342 100 0.000000 30.981233 0.000000 0 / 2018-04-08 13:25:16 [44998.784268] cfs_rh_02 23035 5373787.779427 228 120 0.000000 3.589824 0.000000 0 / 2018-04-08 13:25:16 [44998.795746] ptlrpcd_00_07 23093 6691759.470145 75516 120 0.000000 1439.587919 0.000000 0 / 2018-04-08 13:25:16 [44998.807222] ldlm_poold 23123 6691759.443682 44246 120 0.000000 869.005640 0.000000 0 / 2018-04-08 13:25:16 [44998.818707] ll_cfg_requeue 23136 14735.317146 48 120 0.000000 1.442236 0.000000 0 / 2018-04-08 13:25:16 [44998.830185] mdt00_001 24007 6691759.457524 67878 120 0.000000 1536.754381 0.000000 0 / 2018-04-08 13:25:16 [44998.841680] mdt_out00_001 24021 5864909.258205 357245030 120 0.000000 7712384.280144 0.000000 0 / 2018-04-08 13:25:16 [44998.853165] mdt_fld_0000 24028 14116.820586 6 120 0.000000 0.059054 0.000000 0 / 2018-04-08 13:25:16 [44998.864663] osp-pre-0-0 24679 6691415.278170 8814 120 0.000000 160.739013 0.000000 0 / 2018-04-08 13:25:16 [44998.876163] osp-pre-0-0 26735 6691375.496645 8804 120 0.000000 156.479453 0.000000 0 / 2018-04-08 13:25:16 [44998.887664] osp-pre-8-0 26779 6691415.276383 8805 120 0.000000 165.366866 0.000000 0 / 2018-04-08 13:25:16 [44998.899157] osp-pre-11-0 26801 6691415.280052 8805 120 0.000000 168.588818 0.000000 0 / 2018-04-08 13:25:16 [44998.910653] osp-pre-13-0 26813 6691415.277403 8805 120 0.000000 164.441145 0.000000 0 / 2018-04-08 13:25:16 [44998.922139] osp-pre-15-0 26826 6691415.278706 8805 120 0.000000 170.423912 0.000000 0 / 2018-04-08 13:25:16 [44998.933626] lquota_wb_dagg- 27000 6690462.917988 738 120 0.000000 9.188630 0.000000 0 / 2018-04-08 13:25:16 [44998.945107] osp-syn-0-1 28708 14970.752350 4 120 0.000000 0.177206 0.000000 0 / 2018-04-08 13:25:16 [44998.956589] osp-syn-2-1 28720 15188.228055 4 120 0.000000 0.121431 0.000000 0 / 2018-04-08 13:25:16 [44998.968084] osp-syn-4-1 28728 13094.735807 4 120 0.000000 0.094444 0.000000 0 / 2018-04-08 13:25:16 [44998.979573] osp-syn-5-1 28734 13094.690096 4 120 0.000000 0.102080 0.000000 0 / 2018-04-08 13:25:16 [44998.991064] osp-syn-7-1 28743 13488.631730 4 120 0.000000 0.106727 0.000000 0 / 2018-04-08 13:25:16 [44999.002534] osp-syn-9-1 28754 13082.716669 4 120 0.000000 0.088081 0.000000 0 / 2018-04-08 13:25:16 [44999.014020] osp-syn-13-1 28784 13094.716857 4 120 0.000000 0.092461 0.000000 0 / 2018-04-08 13:25:16 [44999.025497] tx_commit_cb 29903 15290.616630 10 120 0.000000 0.903154 0.000000 0 / 2018-04-08 13:25:16 [44999.036974] osp-syn-0-2 30394 14862.592875 7 120 0.000000 0.423942 0.000000 0 / 2018-04-08 13:25:16 [44999.048438] osp-syn-1-2 30410 14862.578428 7 120 0.000000 0.383564 0.000000 0 / 2018-04-08 13:25:16 [44999.059909] osp-syn-4-2 30464 13777.207887 6 120 0.000000 0.332741 0.000000 0 / 2018-04-08 13:25:16 [44999.071372] osp-syn-11-2 30582 13801.435794 6 120 0.000000 0.343456 0.000000 0 / 2018-04-08 13:25:16 [44999.082850] z_wr_int_6 31002 13861.489009 3 100 0.000000 0.016139 0.000000 0 / 2018-04-08 13:25:16 [44999.094335] z_wr_int_7 31033 13861.488968 3 100 0.000000 0.012927 0.000000 0 / 2018-04-08 13:25:16 [44999.105817] qsd_reint_1.dag 31307 16980.856131 84 120 0.000000 1.166582 0.000000 0 / 2018-04-08 13:25:16 [44999.117291] mdt_rdpg00_010 34595 6688484.055364 12210 120 0.000000 125.980032 0.000000 0 / 2018-04-08 13:25:16 [44999.128764] mdt_rdpg00_014 37777 6569152.390002 18821 120 0.000000 173.235054 0.000000 0 / 2018-04-08 13:25:16 [44999.140247] ldlm_cn00_008 276907 6691415.275437 1870 120 0.000000 28.039827 0.000000 0 / 2018-04-08 13:25:16 [44999.151812] tx_commit_cb 281686 6496900.857427 5 120 0.000000 0.114069 0.000000 0 / 2018-04-08 13:25:16 [44999.163379] z_wr_int_6 282330 6518465.987533 3 100 0.000000 0.016583 0.000000 0 / 2018-04-08 13:25:16 [44999.174949] z_wr_int_4 282334 6518477.990431 2 100 0.000000 0.006079 0.000000 0 / 2018-04-08 13:25:16 [44999.186522] z_wr_int_6 282987 6570238.270185 3 100 0.000000 0.020823 0.000000 0 / 2018-04-08 13:25:16 [44999.198098] z_wr_int_6 282992 6570238.266197 2 100 0.000000 0.007300 0.000000 0 / 2018-04-08 13:25:16 [44999.209665] z_wr_int_6 282995 6570250.270012 2 100 0.000000 0.006577 0.000000 0 / 2018-04-08 13:25:16 [44999.221238] z_wr_int_6 283001 6570262.272735 2 100 0.000000 0.005439 0.000000 0 / 2018-04-08 13:25:16 [44999.232809] 2018-04-08 13:25:16 [44999.234650] cpu#5, 3200.000 MHz 2018-04-08 13:25:16 [44999.238135] .nr_running : 0 2018-04-08 13:25:16 [44999.243090] .load : 1024 2018-04-08 13:25:16 [44999.248300] .nr_switches : 649782753 2018-04-08 13:25:16 [44999.253936] .nr_load_updates : 15710269 2018-04-08 13:25:16 [44999.259484] .nr_uninterruptible : -229 2018-04-08 13:25:16 [44999.264685] .next_balance : 4339.775588 2018-04-08 13:25:16 [44999.270497] .curr->pid : 0 2018-04-08 13:25:16 [44999.275438] .clock : 44999275.434931 2018-04-08 13:25:16 [44999.281583] .cpu_load[0] : 0 2018-04-08 13:25:16 [44999.286513] .cpu_load[1] : 74 2018-04-08 13:25:16 [44999.291522] .cpu_load[2] : 411 2018-04-08 13:25:16 [44999.296616] .cpu_load[3] : 280 2018-04-08 13:25:16 [44999.301703] .cpu_load[4] : 335 2018-04-08 13:25:16 [44999.306779] .avg_idle : 26682 2018-04-08 13:25:16 [44999.312023] .max_idle_balance_cost : 500000 2018-04-08 13:25:16 [44999.317358] 2018-04-08 13:25:16 [44999.317358] cfs_rq[5]:/ 2018-04-08 13:25:16 [44999.321840] .exec_clock : 0.000000 2018-04-08 13:25:16 [44999.327337] .MIN_vruntime : 0.000001 2018-04-08 13:25:16 [44999.332835] .min_vruntime : 4360063.542662 2018-04-08 13:25:16 [44999.338848] .max_vruntime : 0.000001 2018-04-08 13:25:16 [44999.344340] .spread : 0.000000 2018-04-08 13:25:16 [44999.349829] .spread0 : -2802447.291990 2018-04-08 13:25:16 [44999.355925] .nr_spread_over : 0 2018-04-08 13:25:16 [44999.360810] .nr_running : 0 2018-04-08 13:25:16 [44999.365692] .load : 1024 2018-04-08 13:25:16 [44999.370834] .runnable_load_avg : 0 2018-04-08 13:25:16 [44999.375712] .blocked_load_avg : 0 2018-04-08 13:25:16 [44999.380593] .tg_load_avg : 0 2018-04-08 13:25:16 [44999.385464] .tg_load_contrib : 0 2018-04-08 13:25:16 [44999.390332] .tg_runnable_contrib : 0 2018-04-08 13:25:16 [44999.395207] .tg->runnable_avg : 0 2018-04-08 13:25:16 [44999.400069] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:16 [44999.404936] .throttled : 0 2018-04-08 13:25:16 [44999.409807] .throttle_count : 0 2018-04-08 13:25:16 [44999.414666] .avg->runnable_avg_sum : 14797 2018-04-08 13:25:16 [44999.419869] .avg->runnable_avg_period : 46757 2018-04-08 13:25:16 [44999.425071] 2018-04-08 13:25:16 [44999.425071] rt_rq[5]:/ 2018-04-08 13:25:16 [44999.429367] .rt_nr_running : 0 2018-04-08 13:25:16 [44999.434208] .rt_throttled : 0 2018-04-08 13:25:16 [44999.439040] .rt_time : 0.000000 2018-04-08 13:25:16 [44999.444476] .rt_runtime : 950.000000 2018-04-08 13:25:16 [44999.450088] 2018-04-08 13:25:16 [44999.450088] runnable tasks: 2018-04-08 13:25:16 [44999.450088] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:16 [44999.450088] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:16 [44999.476644] migration/5 34 0.000000 737 0 0.000000 1135.136757 0.000000 1 / 2018-04-08 13:25:16 [44999.488024] ksoftirqd/5 35 4350607.933777 18069 120 0.000000 90.404893 0.000000 1 / 2018-04-08 13:25:16 [44999.499414] kworker/5:0H 37 9507.000129 9 100 0.000000 0.026295 0.000000 1 / 2018-04-08 13:25:16 [44999.510817] kworker/u898:1 119 4300054.936480 329 120 0.000000 33.719788 0.000000 1 / 2018-04-08 13:25:16 [44999.522213] kworker/5:1 122 4360022.191399 28820 120 0.000000 638.448077 0.000000 1 / 2018-04-08 13:25:16 [44999.533620] scsi_eh_0 336 1047.151397 2 120 0.000000 0.005978 0.000000 1 / 2018-04-08 13:25:16 [44999.545035] scsi_tmf_0 337 1059.156712 2 100 0.000000 0.005958 0.000000 1 / 2018-04-08 13:25:16 [44999.556445] scsi_eh_2 348 1245.950817 22 120 0.000000 0.147930 0.000000 1 / 2018-04-08 13:25:16 [44999.567859] scsi_eh_12 382 1246.182717 22 120 0.000000 0.352351 0.000000 1 / 2018-04-08 13:25:16 [44999.579265] bnx2x 399 1161.823977 2 100 0.000000 0.006552 0.000000 1 / 2018-04-08 13:25:16 [44999.590670] kworker/5:2 605 14581.091341 8 120 0.000000 0.054535 0.000000 1 / 2018-04-08 13:25:16 [44999.602100] spl_dynamic_tas 3615 4294673.079376 253318 100 0.000000 1045.997752 0.000000 1 / 2018-04-08 13:25:16 [44999.613537] kworker/5:1H 6146 4356458.476852 18203 100 0.000000 24.573214 0.000000 1 / 2018-04-08 13:25:16 [44999.624980] kdmflush 7794 11486.700332 2 100 0.000000 0.006199 0.000000 1 / 2018-04-08 13:25:16 [44999.636424] arc_prune 8666 12702.536471 2 120 0.000000 0.009982 0.000000 1 / 2018-04-08 13:25:16 [44999.647872] ntpd 14369 4356458.326212 1355 120 0.000000 83.039600 0.000000 1 / 2018-04-08 13:25:16 [44999.659310] sssd_pam 14469 4359263.764153 9010 120 0.000000 166.897459 0.000000 1 / 2018-04-08 13:25:16 [44999.670767] txg_quiesce 18937 4359164.359856 17972 120 0.000000 570.066473 0.000000 1 / 2018-04-08 13:25:16 [44999.682223] z_rd_int_5 19337 132019.661374 610 100 0.000000 7.337444 0.000000 1 / 2018-04-08 13:25:16 [44999.693681] z_wr_iss 19341 151649.986877 206 101 0.000000 21.392046 0.000000 1 / 2018-04-08 13:25:17 [44999.705149] z_wr_int_3 19356 151649.982963 986 100 0.000000 9.821276 0.000000 1 / 2018-04-08 13:25:17 [44999.716613] z_wr_iss 20550 25507.946463 166 101 0.000000 7.712882 0.000000 1 / 2018-04-08 13:25:17 [44999.728086] dp_sync_taskq 20597 25509.128572 142 139 0.000000 2.746740 0.000000 1 / 2018-04-08 13:25:17 [44999.739561] z_rd_int_5 21253 4294434.211821 777 100 0.000000 9.471433 0.000000 1 / 2018-04-08 13:25:17 [44999.751020] z_zvol 21291 19624.599019 18 120 0.000000 0.889776 0.000000 1 / 2018-04-08 13:25:17 [44999.762491] z_ioctl_int 21894 4294673.072260 1716 100 0.000000 7.781246 0.000000 1 / 2018-04-08 13:25:17 [44999.773974] dp_sync_taskq 21908 4294663.540594 6793 139 0.000000 129.893230 0.000000 1 / 2018-04-08 13:25:17 [44999.785460] dp_sync_taskq 21910 4294662.357670 6913 139 0.000000 131.870929 0.000000 1 / 2018-04-08 13:25:17 [44999.796952] txg_quiesce 22014 4359164.322244 17782 120 0.000000 598.864725 0.000000 1 / 2018-04-08 13:25:17 [44999.808445] txg_sync 22015 4359164.301720 35488 120 0.000000 1098.088275 0.000000 1 / 2018-04-08 13:25:17 [44999.819940] z_rd_int_0 22430 3645166.600829 1845 100 0.000000 20.985865 0.000000 1 / 2018-04-08 13:25:17 [44999.831444] z_rd_int_3 22433 3645545.625879 1944 100 0.000000 21.137362 0.000000 1 / 2018-04-08 13:25:17 [44999.842936] z_rd_int_7 22437 3645545.625742 1845 100 0.000000 20.695441 0.000000 1 / 2018-04-08 13:25:17 [44999.854433] z_wr_int_2 22453 4260656.676461 3373 100 0.000000 29.964021 0.000000 1 / 2018-04-08 13:25:17 [44999.865936] ptlrpcd_01_04 23098 4356327.373696 11374 120 0.000000 180.925628 0.000000 1 / 2018-04-08 13:25:17 [44999.877455] ldlm_cn01_002 23119 4359539.106027 57911 120 0.000000 529.990107 0.000000 1 / 2018-04-08 13:25:17 [44999.888976] mgs_dagg_notify 23156 23224.102951 54 118 0.000000 4.473876 0.000000 1 / 2018-04-08 13:25:17 [44999.900491] mdt_out01_000 24022 3912464.297484 459073982 120 0.000000 9274455.790561 0.000000 1 / 2018-04-08 13:25:17 [44999.912019] lquota_wb_home- 25500 4353633.884851 798 120 0.000000 10.325846 0.000000 1 / 2018-04-08 13:25:17 [44999.923551] tx_commit_cb 25905 4294673.091310 642 120 0.000000 255.932041 0.000000 1 / 2018-04-08 13:25:17 [44999.935095] osp-syn-0-0 26737 24575.612851 4 120 0.000000 0.230843 0.000000 1 / 2018-04-08 13:25:17 [44999.946637] osp-pre-8-1 28747 22103.335515 4 120 0.000000 0.025829 0.000000 1 / 2018-04-08 13:25:17 [44999.958186] dist_txn-1 29205 21839.262329 2 120 0.000000 0.016729 0.000000 1 / 2018-04-08 13:25:17 [44999.969724] osp-pre-3-2 30430 24791.567341 4 120 0.000000 0.032894 0.000000 1 / 2018-04-08 13:25:17 [44999.981270] osp-pre-9-2 30543 23333.168474 4 120 0.000000 0.024717 0.000000 1 / 2018-04-08 13:25:17 [44999.992820] osp-pre-10-2 30554 23333.162449 4 120 0.000000 0.026636 0.000000 1 / 2018-04-08 13:25:17 [45000.004362] z_wr_int_4 30990 22359.626823 3 100 0.000000 0.012630 0.000000 1 / 2018-04-08 13:25:17 [45000.015906] z_wr_int_2 31036 22383.630361 2 100 0.000000 0.008464 0.000000 1 / 2018-04-08 13:25:17 [45000.027433] z_wr_int_7 31039 22407.908460 2 100 0.000000 0.004821 0.000000 1 / 2018-04-08 13:25:17 [45000.038956] z_wr_int_7 31040 22419.910982 2 100 0.000000 0.004828 0.000000 1 / 2018-04-08 13:25:17 [45000.050457] z_wr_int_7 31041 22431.913287 2 100 0.000000 0.004535 0.000000 1 / 2018-04-08 13:25:17 [45000.061969] lod0002_rec0000 31314 4360292.892357 1109980072 120 0.000000 13987169.970921 0.000000 1 / 2018-04-08 13:25:17 [45000.073577] mdt_rdpg01_009 32916 4245246.342941 70894 120 0.000000 784.078371 0.000000 1 / 2018-04-08 13:25:17 [45000.085101] mdt_rdpg01_015 77247 4244929.567203 106518 120 0.000000 988.266803 0.000000 1 / 2018-04-08 13:25:17 [45000.096617] sshd 283060 4350818.894953 218 120 0.000000 16.586647 0.000000 1 / 2018-04-08 13:25:17 [45000.108235] 2018-04-08 13:25:17 [45000.110124] cpu#6, 3200.000 MHz 2018-04-08 13:25:17 [45000.113661] .nr_running : 5 2018-04-08 13:25:17 [45000.118667] .load : 91833 2018-04-08 13:25:17 [45000.124013] .nr_switches : 630766037 2018-04-08 13:25:17 [45000.129698] .nr_load_updates : 15719290 2018-04-08 13:25:17 [45000.135296] .nr_uninterruptible : -431 2018-04-08 13:25:17 [45000.140544] .next_balance : 4339.776578 2018-04-08 13:25:17 [45000.146395] .curr->pid : 283092 2018-04-08 13:25:17 [45000.151812] .clock : 44905110.842832 2018-04-08 13:25:17 [45000.158001] .cpu_load[0] : 91833 2018-04-08 13:25:17 [45000.163323] .cpu_load[1] : 91833 2018-04-08 13:25:17 [45000.168641] .cpu_load[2] : 91833 2018-04-08 13:25:17 [45000.173954] .cpu_load[3] : 91833 2018-04-08 13:25:17 [45000.179265] .cpu_load[4] : 91833 2018-04-08 13:25:17 [45000.184565] .avg_idle : 163293 2018-04-08 13:25:17 [45000.189948] .max_idle_balance_cost : 500000 2018-04-08 13:25:17 [45000.195331] 2018-04-08 13:25:17 [45000.195331] cfs_rq[6]:/ 2018-04-08 13:25:17 [45000.199897] .exec_clock : 0.000000 2018-04-08 13:25:17 [45000.205434] .MIN_vruntime : 5215780.400665 2018-04-08 13:25:17 [45000.211494] .min_vruntime : 5215792.400665 2018-04-08 13:25:17 [45000.217551] .max_vruntime : 5215780.400665 2018-04-08 13:25:17 [45000.223593] .spread : 0.000000 2018-04-08 13:25:17 [45000.229118] .spread0 : -1946745.867403 2018-04-08 13:25:17 [45000.235248] .nr_spread_over : 0 2018-04-08 13:25:17 [45000.240165] .nr_running : 4 2018-04-08 13:25:17 [45000.245078] .load : 91833 2018-04-08 13:25:17 [45000.250331] .runnable_load_avg : 740 2018-04-08 13:25:17 [45000.255412] .blocked_load_avg : 0 2018-04-08 13:25:17 [45000.260306] .tg_load_avg : 0 2018-04-08 13:25:17 [45000.265199] .tg_load_contrib : 0 2018-04-08 13:25:17 [45000.270078] .tg_runnable_contrib : 0 2018-04-08 13:25:17 [45000.274958] .tg->runnable_avg : 0 2018-04-08 13:25:17 [45000.279832] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:17 [45000.284708] .throttled : 0 2018-04-08 13:25:17 [45000.289583] .throttle_count : 0 2018-04-08 13:25:17 [45000.294456] .avg->runnable_avg_sum : 34417 2018-04-08 13:25:17 [45000.299671] .avg->runnable_avg_period : 47075 2018-04-08 13:25:17 [45000.304889] 2018-04-08 13:25:17 [45000.304889] rt_rq[6]:/ 2018-04-08 13:25:17 [45000.309227] .rt_nr_running : 0 2018-04-08 13:25:17 [45000.314096] .rt_throttled : 0 2018-04-08 13:25:17 [45000.318962] .rt_time : 0.000000 2018-04-08 13:25:17 [45000.324425] .rt_runtime : 950.000000 2018-04-08 13:25:17 [45000.330054] 2018-04-08 13:25:17 [45000.330054] runnable tasks: 2018-04-08 13:25:17 [45000.330054] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:17 [45000.330054] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:17 [45000.356616] migration/6 39 0.000000 422 0 0.000000 966.512960 0.000000 0 / 2018-04-08 13:25:17 [45000.367992] ksoftirqd/6 40 5215780.400665 109052 120 0.000000 389.331638 0.000000 0 / 2018-04-08 13:25:17 [45000.379383] kworker/6:0H 42 5235.307047 12 100 0.000000 0.028846 0.000000 0 / 2018-04-08 13:25:17 [45000.390793] netns 91 55.216684 2 100 0.000000 0.006412 0.000000 0 / 2018-04-08 13:25:17 [45000.402188] ata_sff 339 279.755864 2 100 0.000000 0.005215 0.000000 0 / 2018-04-08 13:25:17 [45000.413583] scsi_eh_10 378 415.865898 22 120 0.000000 0.255155 0.000000 0 / 2018-04-08 13:25:17 [45000.424989] nfit 1026 845.919645 2 100 0.000000 0.005341 0.000000 0 / 2018-04-08 13:25:17 [45000.436400] multipathd 4260 0.000000 9 0 0.000000 0.680801 0.000000 0 / 2018-04-08 13:25:17 [45000.447806] bioset 4005 3330.638358 2 100 0.000000 0.006137 0.000000 0 / 2018-04-08 13:25:17 [45000.459221] kdmflush 4019 3332.500190 2 100 0.000000 0.004943 0.000000 0 / 2018-04-08 13:25:17 [45000.470620] kdmflush 4157 3332.502349 2 100 0.000000 0.007365 0.000000 0 / 2018-04-08 13:25:17 [45000.482042] bioset 4163 3332.504661 2 100 0.000000 0.006788 0.000000 0 / 2018-04-08 13:25:17 [45000.493465] kdmflush 4172 3332.509288 2 100 0.000000 0.006630 0.000000 0 / 2018-04-08 13:25:17 [45000.504881] bioset 4175 3332.511507 2 100 0.000000 0.006414 0.000000 0 / 2018-04-08 13:25:17 [45000.516304] kworker/6:11 6624 10350.306819 21 120 0.000000 0.058547 0.000000 0 / 2018-04-08 13:25:17 [45000.527736] bioset 9315 5065.879039 2 100 0.000000 0.005689 0.000000 0 / 2018-04-08 13:25:17 [45000.539158] kworker/6:1H 9586 5215780.400665 100863 100 0.000000 151.848142 0.000000 0 / 2018-04-08 13:25:17 [45000.550586] kworker/6:0 17547 5215780.400665 257659 120 0.000000 4544.246373 0.000000 0 / 2018-04-08 13:25:17 [45000.562025] z_rd_int_3 18792 12691.542899 259 100 0.000000 2.692143 0.000000 0 / 2018-04-08 13:25:17 [45000.573468] z_rd_int_6 18795 12691.542693 276 100 0.000000 2.665551 0.000000 0 / 2018-04-08 13:25:17 [45000.584906] z_wr_iss 18801 12704.175637 122 101 0.000000 3.408837 0.000000 0 / 2018-04-08 13:25:17 [45000.596342] z_wr_iss 18804 12704.176060 116 101 0.000000 3.688753 0.000000 0 / 2018-04-08 13:25:17 [45000.607782] z_wr_iss 19340 137354.301451 207 101 0.000000 8.550079 0.000000 0 / 2018-04-08 13:25:17 [45000.619226] z_wr_int_4 19357 137366.302474 973 100 0.000000 9.569187 0.000000 0 / 2018-04-08 13:25:17 [45000.630658] metaslab_group_ 19377 138964.800930 40 100 0.000000 0.583223 0.000000 0 / 2018-04-08 13:25:17 [45000.642099] z_rd_int_3 19959 18705.107611 666 100 0.000000 7.199769 0.000000 0 / 2018-04-08 13:25:17 [45000.653550] z_wr_iss 19964 14092.542854 178 101 0.000000 5.256766 0.000000 0 / 2018-04-08 13:25:17 [45000.665001] metaslab_group_ 20001 14834.574237 23 100 0.000000 0.270087 0.000000 0 / 2018-04-08 13:25:17 [45000.676461] dp_sync_taskq 20007 14097.063578 96 139 0.000000 0.973087 0.000000 0 / 2018-04-08 13:25:17 [45000.687928] dp_sync_taskq 20010 14097.295107 88 139 0.000000 1.256395 0.000000 0 / 2018-04-08 13:25:17 [45000.699401] dp_sync_taskq 20012 14095.373940 146 139 0.000000 1.485431 0.000000 0 / 2018-04-08 13:25:18 [45000.710878] z_rd_int_0 21248 5136848.067696 777 100 0.000000 10.052325 0.000000 0 / 2018-04-08 13:25:18 [45000.722345] z_rd_int_3 21251 5137080.692071 817 100 0.000000 9.337464 0.000000 0 / 2018-04-08 13:25:18 [45000.733804] dp_sync_taskq 21303 14059.344327 51 139 0.000000 0.924639 0.000000 0 / 2018-04-08 13:25:18 [45000.745287] z_wr_iss 21864 5137098.600662 13942 101 0.000000 620.457213 0.000000 0 / 2018-04-08 13:25:18 [45000.756766] z_wr_iss 21869 5137098.600618 13867 101 0.000000 612.127574 0.000000 0 / 2018-04-08 13:25:18 [45000.768246] metaslab_group_ 21897 5138270.050200 734 100 0.000000 3.565535 0.000000 0 / 2018-04-08 13:25:18 [45000.779734] dp_sync_taskq 21907 5137099.827029 6885 139 0.000000 128.925067 0.000000 0 / 2018-04-08 13:25:18 [45000.791225] z_wr_iss 22439 5100030.085581 684 101 0.000000 38.411941 0.000000 0 / 2018-04-08 13:25:18 [45000.802731] z_wr_iss 22443 5100030.086999 668 101 0.000000 22.281088 0.000000 0 / 2018-04-08 13:25:18 [45000.814229] z_wr_iss 22445 5100030.086027 688 101 0.000000 21.673063 0.000000 0 / 2018-04-08 13:25:18 [45000.825722] z_ioctl_int 22472 5100042.088513 258 100 0.000000 1.135391 0.000000 0 / 2018-04-08 13:25:18 [45000.837223] ptlrpc_hr00_001 23049 417004.633136 3 120 0.000000 0.014711 0.000000 0 / 2018-04-08 13:25:18 [45000.848716] ptlrpc_hr00_002 23050 417004.631204 3 120 0.000000 0.012852 0.000000 0 / 2018-04-08 13:25:18 [45000.860226] mgs_home_notify 23142 11760.074208 34 118 0.000000 2.258901 0.000000 0 / 2018-04-08 13:25:18 [45000.871726] mgs_apps_notify 23195 11703.670086 41 118 0.000000 1.931638 0.000000 0 / 2018-04-08 13:25:18 [45000.883229] ldlm_cn00_004 23401 5085705.591788 16622 120 0.000000 211.336753 0.000000 0 / 2018-04-08 13:25:18 [45000.894711] osp-syn-0-0 24100 14002.824241 4 120 0.000000 0.117074 0.000000 0 / 2018-04-08 13:25:18 [45000.906203] osp-syn-1-0 24699 12003.038052 4 120 0.000000 0.116842 0.000000 0 / 2018-04-08 13:25:18 [45000.917672] osp-syn-10-0 26796 12006.665186 4 120 0.000000 0.102745 0.000000 0 / 2018-04-08 13:25:18 [45000.929149] tx_commit_cb 27954 5086155.807230 111 120 0.000000 3.835829 0.000000 0 / 2018-04-08 13:25:18 [45000.940624] osp-pre-0-1 28706 14058.649417 4 120 0.000000 0.035174 0.000000 0 / 2018-04-08 13:25:18 [45000.952115] osp-pre-2-1 28717 14375.917374 4 120 0.000000 0.037787 0.000000 0 / 2018-04-08 13:25:18 [45000.963597] osp-pre-9-1 28751 12675.853457 4 120 0.000000 0.022811 0.000000 0 / 2018-04-08 13:25:18 [45000.975075] osp-syn-10-1 28762 12608.542351 4 120 0.000000 0.104295 0.000000 0 / 2018-04-08 13:25:18 [45000.986562] osp-syn-11-1 28769 12363.789643 4 120 0.000000 0.103893 0.000000 0 / 2018-04-08 13:25:18 [45000.998033] ldlm_bl_03 29065 5083233.457642 34420 120 0.000000 788.345084 0.000000 0 / 2018-04-08 13:25:18 [45001.009518] osp-syn-2-2 30427 14006.929700 7 120 0.000000 0.437688 0.000000 0 / 2018-04-08 13:25:18 [45001.020997] osp-syn-3-2 30445 14006.810012 7 120 0.000000 0.440379 0.000000 0 / 2018-04-08 13:25:18 [45001.032488] osp-syn-5-2 30480 12703.882926 6 120 0.000000 0.395022 0.000000 0 / 2018-04-08 13:25:18 [45001.043978] osp-syn-12-2 30599 12703.956582 5 120 0.000000 0.374768 0.000000 0 / 2018-04-08 13:25:18 [45001.055459] osp-syn-13-2 30620 12704.172723 6 120 0.000000 0.343792 0.000000 0 / 2018-04-08 13:25:18 [45001.066949] mdt_rdpg00_007 32923 5085705.592116 12379 120 0.000000 130.945890 0.000000 0 / 2018-04-08 13:25:18 [45001.078436] mdt_rdpg00_008 32924 5085705.840260 8141 120 0.000000 83.146617 0.000000 0 / 2018-04-08 13:25:18 [45001.089924] z_wr_int_4 282335 5100054.088412 2 100 0.000000 0.005489 0.000000 0 / 2018-04-08 13:25:18 [45001.101506] z_wr_int_6 282989 5137110.605108 3 100 0.000000 0.010272 0.000000 0 / 2018-04-08 13:25:18 [45001.113072] R bash 283092 5215815.279609 126 120 0.000000 139.373109 0.000000 0 / 2018-04-08 13:25:18 [45001.124663] 2018-04-08 13:25:18 [45001.126515] cpu#7, 3200.000 MHz 2018-04-08 13:25:18 [45001.130013] .nr_running : 0 2018-04-08 13:25:18 [45001.134982] .load : 0 2018-04-08 13:25:18 [45001.139943] .nr_switches : 899548804 2018-04-08 13:25:18 [45001.145594] .nr_load_updates : 19961836 2018-04-08 13:25:18 [45001.151158] .nr_uninterruptible : -417 2018-04-08 13:25:18 [45001.156369] .next_balance : 4339.777482 2018-04-08 13:25:18 [45001.162186] .curr->pid : 0 2018-04-08 13:25:18 [45001.167136] .clock : 45001167.098219 2018-04-08 13:25:18 [45001.173293] .cpu_load[0] : 0 2018-04-08 13:25:18 [45001.178240] .cpu_load[1] : 680 2018-04-08 13:25:18 [45001.183359] .cpu_load[2] : 425 2018-04-08 13:25:18 [45001.188474] .cpu_load[3] : 271 2018-04-08 13:25:18 [45001.193575] .cpu_load[4] : 297 2018-04-08 13:25:18 [45001.198669] .avg_idle : 25984 2018-04-08 13:25:18 [45001.203943] .max_idle_balance_cost : 500000 2018-04-08 13:25:18 [45001.209301] 2018-04-08 13:25:18 [45001.209301] cfs_rq[7]:/ 2018-04-08 13:25:18 [45001.213813] .exec_clock : 0.000000 2018-04-08 13:25:18 [45001.219326] .MIN_vruntime : 0.000001 2018-04-08 13:25:18 [45001.224841] .min_vruntime : 6984305.337273 2018-04-08 13:25:18 [45001.230872] .max_vruntime : 0.000001 2018-04-08 13:25:18 [45001.236373] .spread : 0.000000 2018-04-08 13:25:18 [45001.241882] .spread0 : -178241.159022 2018-04-08 13:25:18 [45001.247905] .nr_spread_over : 0 2018-04-08 13:25:18 [45001.252804] .nr_running : 0 2018-04-08 13:25:18 [45001.257691] .load : 1024 2018-04-08 13:25:18 [45001.262829] .runnable_load_avg : 0 2018-04-08 13:25:18 [45001.267714] .blocked_load_avg : 309 2018-04-08 13:25:18 [45001.272772] .tg_load_avg : 0 2018-04-08 13:25:18 [45001.277653] .tg_load_contrib : 0 2018-04-08 13:25:18 [45001.282524] .tg_runnable_contrib : 0 2018-04-08 13:25:18 [45001.287397] .tg->runnable_avg : 0 2018-04-08 13:25:18 [45001.292264] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:18 [45001.297133] .throttled : 0 2018-04-08 13:25:18 [45001.302008] .throttle_count : 0 2018-04-08 13:25:18 [45001.306870] .avg->runnable_avg_sum : 13226 2018-04-08 13:25:18 [45001.312079] .avg->runnable_avg_period : 46464 2018-04-08 13:25:18 [45001.317287] 2018-04-08 13:25:18 [45001.317287] rt_rq[7]:/ 2018-04-08 13:25:18 [45001.321615] .rt_nr_running : 0 2018-04-08 13:25:18 [45001.326471] .rt_throttled : 0 2018-04-08 13:25:18 [45001.331325] .rt_time : 0.000000 2018-04-08 13:25:18 [45001.336778] .rt_runtime : 950.000000 2018-04-08 13:25:18 [45001.342399] 2018-04-08 13:25:18 [45001.342399] runnable tasks: 2018-04-08 13:25:18 [45001.342399] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:18 [45001.342399] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:18 [45001.368960] migration/7 44 0.000000 470 0 0.000000 1367.859002 0.000000 1 / 2018-04-08 13:25:18 [45001.380343] ksoftirqd/7 45 6984277.580937 14419 120 0.000000 89.463431 0.000000 1 / 2018-04-08 13:25:18 [45001.391734] kworker/7:0 46 6984277.580786 27965 120 0.000000 286.470851 0.000000 1 / 2018-04-08 13:25:18 [45001.403131] kworker/7:0H 47 6257.087386 9 100 0.000000 0.031096 0.000000 1 / 2018-04-08 13:25:18 [45001.414533] scsi_eh_5 354 508.178044 22 120 0.000000 0.163158 0.000000 1 / 2018-04-08 13:25:18 [45001.425944] scsi_tmf_5 355 399.200412 2 100 0.000000 0.005871 0.000000 1 / 2018-04-08 13:25:18 [45001.437349] scsi_tmf_7 359 411.206279 2 100 0.000000 0.006538 0.000000 1 / 2018-04-08 13:25:18 [45001.448760] scsi_tmf_8 375 435.784995 2 100 0.000000 0.005768 0.000000 1 / 2018-04-08 13:25:18 [45001.460163] scsi_tmf_11 381 459.796236 2 100 0.000000 0.006200 0.000000 1 / 2018-04-08 13:25:18 [45001.471570] kdmwork-253:9 4239 6984277.584310 51809 120 0.000000 928.581666 0.000000 1 / 2018-04-08 13:25:18 [45001.482970] kworker/7:1H 6162 6984277.577983 14390 100 0.000000 22.067256 0.000000 1 / 2018-04-08 13:25:18 [45001.494378] arc_reclaim 8667 6984277.580249 45067 120 0.000000 472.334862 0.000000 1 / 2018-04-08 13:25:18 [45001.505804] dbuf_evict 8862 6984277.679076 45239 139 0.000000 333.078919 0.000000 1 / 2018-04-08 13:25:18 [45001.517231] agetty 9049 11286.258980 5 120 0.000000 20.895383 0.000000 1 / 2018-04-08 13:25:18 [45001.528649] kdmwork-253:15 9316 6984255.166762 46488 120 0.000000 1059.095605 0.000000 1 / 2018-04-08 13:25:18 [45001.540083] pcsd 14515 6979859.470977 7346 120 0.000000 2182.202433 0.000000 1 / 2018-04-08 13:25:18 [45001.551524] rpcbind 15248 6983595.280541 1499 120 0.000000 54.208269 0.000000 1 / 2018-04-08 13:25:18 [45001.562978] kworker/7:1 17606 12300.725034 2 120 0.000000 0.004341 0.000000 1 / 2018-04-08 13:25:18 [45001.574417] z_null_iss 18786 6984277.578102 88962 100 0.000000 3067.676690 0.000000 1 / 2018-04-08 13:25:18 [45001.585864] z_wr_iss 19351 200231.220649 202 101 0.000000 9.163923 0.000000 1 / 2018-04-08 13:25:18 [45001.597321] z_wr_int_1 19354 200231.221257 935 100 0.000000 10.117480 0.000000 1 / 2018-04-08 13:25:18 [45001.608778] z_ioctl_int 19374 200231.217810 59 100 0.000000 0.272291 0.000000 1 / 2018-04-08 13:25:18 [45001.620237] mmp 19595 6984277.588253 88923 120 0.000000 1518.086465 0.000000 1 / 2018-04-08 13:25:18 [45001.631710] z_rd_int_1 20538 19656.851914 1643 100 0.000000 13.018420 0.000000 1 / 2018-04-08 13:25:18 [45001.643182] z_rd_int_5 20542 19656.852460 1513 100 0.000000 12.242486 0.000000 1 / 2018-04-08 13:25:18 [45001.654656] z_wr_iss 20555 19379.975220 170 101 0.000000 7.216901 0.000000 1 / 2018-04-08 13:25:18 [45001.666143] z_wr_int_1 20559 19391.978841 781 100 0.000000 7.835546 0.000000 1 / 2018-04-08 13:25:18 [45001.677627] z_wr_int_3 20561 19391.980179 750 100 0.000000 7.464033 0.000000 1 / 2018-04-08 13:25:18 [45001.689115] dp_sync_taskq 20588 19380.654358 134 139 0.000000 2.147771 0.000000 1 / 2018-04-08 13:25:19 [45001.700599] dp_sync_taskq 20589 19380.242574 149 139 0.000000 2.039335 0.000000 1 / 2018-04-08 13:25:19 [45001.712082] dp_sync_taskq 20593 19384.953791 133 139 0.000000 1.817107 0.000000 1 / 2018-04-08 13:25:19 [45001.723573] dp_sync_taskq 20596 19380.218476 122 139 0.000000 2.146276 0.000000 1 / 2018-04-08 13:25:19 [45001.735055] z_rd_iss 21247 5524055.427968 16 100 0.000000 0.249684 0.000000 1 / 2018-04-08 13:25:19 [45001.746542] z_wr_iss 21266 18681.302528 63 101 0.000000 2.514816 0.000000 1 / 2018-04-08 13:25:19 [45001.758034] z_wr_int_3 21272 18681.299703 305 100 0.000000 3.081681 0.000000 1 / 2018-04-08 13:25:19 [45001.769537] dp_sync_taskq 21308 18682.619630 60 139 0.000000 0.710339 0.000000 1 / 2018-04-08 13:25:19 [45001.781038] z_null_int 22428 6984277.578030 95376 100 0.000000 593.740839 0.000000 1 / 2018-04-08 13:25:19 [45001.792549] z_rd_int_1 22431 5987789.415565 1829 100 0.000000 20.611407 0.000000 1 / 2018-04-08 13:25:19 [45001.804057] z_wr_int_0 22451 6819974.628204 3357 100 0.000000 30.567843 0.000000 1 / 2018-04-08 13:25:19 [45001.815571] kiblnd_sd_01_00 23078 6984386.268176 8997570 120 0.000000 43696.909442 0.000000 1 / 2018-04-08 13:25:19 [45001.827073] ptlrpcd_01_00 23094 6984238.210921 11358 120 0.000000 180.515199 0.000000 1 / 2018-04-08 13:25:19 [45001.838586] ptlrpcd_01_05 23099 6983604.376810 11609 120 0.000000 181.635899 0.000000 1 / 2018-04-08 13:25:19 [45001.850103] ptlrpcd_01_06 23100 6984238.177090 11375 120 0.000000 182.604447 0.000000 1 / 2018-04-08 13:25:19 [45001.861625] mdt01_000 24009 6984277.581081 904659 120 0.000000 12786.489679 0.000000 1 / 2018-04-08 13:25:19 [45001.873151] mdt_rdpg01_001 24015 6796178.325849 17208 120 0.000000 148.441885 0.000000 1 / 2018-04-08 13:25:19 [45001.884691] mdt01_006 24571 6984278.488981 892978 120 0.000000 12579.602641 0.000000 1 / 2018-04-08 13:25:19 [45001.896220] osp-syn-5-0 26763 15196.188153 4 120 0.000000 0.108949 0.000000 1 / 2018-04-08 13:25:19 [45001.907744] osp-pre-6-1 28737 16367.921191 4 120 0.000000 0.023277 0.000000 1 / 2018-04-08 13:25:19 [45001.919248] osp-pre-4-2 30450 16959.610917 4 120 0.000000 0.025649 0.000000 1 / 2018-04-08 13:25:19 [45001.930762] osp-pre-11-2 30572 16959.614520 4 120 0.000000 0.024729 0.000000 1 / 2018-04-08 13:25:19 [45001.942259] osp-pre-15-2 30639 16959.613165 4 120 0.000000 0.021036 0.000000 1 / 2018-04-08 13:25:19 [45001.953754] mdt01_014 32616 6984277.578754 748888 120 0.000000 10451.496535 0.000000 1 / 2018-04-08 13:25:19 [45001.965246] mdt_rdpg01_008 32915 6796178.376413 1810 120 0.000000 19.530202 0.000000 1 / 2018-04-08 13:25:19 [45001.976755] mdt_rdpg01_010 32917 6983396.431233 492761 120 0.000000 4764.856237 0.000000 1 / 2018-04-08 13:25:19 [45001.988249] z_wr_int_4 40034 200231.217760 4 100 0.000000 0.016804 0.000000 1 / 2018-04-08 13:25:19 [45001.999769] z_wr_int_5 282328 6819974.627164 4 100 0.000000 0.019537 0.000000 1 / 2018-04-08 13:25:19 [45002.011378] kworker/u896:1 283313 6984229.602686 1399 120 0.000000 53.373019 0.000000 1 / 2018-04-08 13:25:19 [45002.022989] 2018-04-08 13:25:19 [45002.024870] cpu#8, 3200.000 MHz 2018-04-08 13:25:19 [45002.028397] .nr_running : 1 2018-04-08 13:25:19 [45002.033383] .load : 1024 2018-04-08 13:25:19 [45002.038625] .nr_switches : 807145197 2018-04-08 13:25:19 [45002.044302] .nr_load_updates : 18855268 2018-04-08 13:25:19 [45002.049881] .nr_uninterruptible : -188 2018-04-08 13:25:19 [45002.055117] .next_balance : 4339.778380 2018-04-08 13:25:19 [45002.060952] .curr->pid : 0 2018-04-08 13:25:19 [45002.065920] .clock : 45002065.904044 2018-04-08 13:25:19 [45002.072101] .cpu_load[0] : 1024 2018-04-08 13:25:19 [45002.077325] .cpu_load[1] : 732 2018-04-08 13:25:19 [45002.082459] .cpu_load[2] : 838 2018-04-08 13:25:19 [45002.087589] .cpu_load[3] : 703 2018-04-08 13:25:19 [45002.092706] .cpu_load[4] : 569 2018-04-08 13:25:19 [45002.097824] .avg_idle : 11225 2018-04-08 13:25:19 [45002.103110] .max_idle_balance_cost : 500000 2018-04-08 13:25:19 [45002.108479] 2018-04-08 13:25:19 [45002.108479] cfs_rq[8]:/ 2018-04-08 13:25:19 [45002.113038] .exec_clock : 0.000000 2018-04-08 13:25:19 [45002.118578] .MIN_vruntime : 0.000001 2018-04-08 13:25:19 [45002.124109] .min_vruntime : 7007707.376246 2018-04-08 13:25:19 [45002.130163] .max_vruntime : 0.000001 2018-04-08 13:25:19 [45002.135688] .spread : 0.000000 2018-04-08 13:25:19 [45002.141210] .spread0 : -154839.120049 2018-04-08 13:25:19 [45002.147253] .nr_spread_over : 0 2018-04-08 13:25:19 [45002.152169] .nr_running : 0 2018-04-08 13:25:19 [45002.157081] .load : 0 2018-04-08 13:25:19 [45002.161987] .runnable_load_avg : 0 2018-04-08 13:25:19 [45002.166886] .blocked_load_avg : 0 2018-04-08 13:25:19 [45002.171783] .tg_load_avg : 0 2018-04-08 13:25:19 [45002.176671] .tg_load_contrib : 0 2018-04-08 13:25:19 [45002.181560] .tg_runnable_contrib : 0 2018-04-08 13:25:19 [45002.186444] .tg->runnable_avg : 0 2018-04-08 13:25:19 [45002.191324] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:19 [45002.196207] .throttled : 0 2018-04-08 13:25:19 [45002.201078] .throttle_count : 0 2018-04-08 13:25:19 [45002.205951] .avg->runnable_avg_sum : 23956 2018-04-08 13:25:19 [45002.211160] .avg->runnable_avg_period : 46251 2018-04-08 13:25:19 [45002.216374] 2018-04-08 13:25:19 [45002.216374] rt_rq[8]:/ 2018-04-08 13:25:19 [45002.220714] .rt_nr_running : 0 2018-04-08 13:25:19 [45002.225574] .rt_throttled : 0 2018-04-08 13:25:19 [45002.230427] .rt_time : 0.000000 2018-04-08 13:25:19 [45002.235881] .rt_runtime : 950.000000 2018-04-08 13:25:19 [45002.241503] 2018-04-08 13:25:19 [45002.241503] runnable tasks: 2018-04-08 13:25:19 [45002.241503] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:19 [45002.241503] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:19 [45002.268062] migration/8 49 0.000000 304 0 0.000000 942.327224 0.000000 0 / 2018-04-08 13:25:19 [45002.279450] ksoftirqd/8 50 7007647.152975 82467 120 0.000000 305.622362 0.000000 0 / 2018-04-08 13:25:19 [45002.290841] kworker/8:0H 52 4851.050175 11 100 0.000000 0.024509 0.000000 0 / 2018-04-08 13:25:19 [45002.302233] kpsmoused 125 1169.139878 2 100 0.000000 0.005028 0.000000 0 / 2018-04-08 13:25:19 [45002.313630] ipv6_addrconf 126 1181.144085 2 100 0.000000 0.004580 0.000000 0 / 2018-04-08 13:25:19 [45002.325035] deferwq 145 1265.467631 2 100 0.000000 0.008172 0.000000 0 / 2018-04-08 13:25:19 [45002.336440] scsi_eh_7 358 1405.804904 22 120 0.000000 0.142793 0.000000 0 / 2018-04-08 13:25:19 [45002.347833] scsi_eh_13 384 1405.920379 22 120 0.000000 0.262802 0.000000 0 / 2018-04-08 13:25:19 [45002.359230] kworker/8:1 413 7720.383371 246 120 0.000000 1.815674 0.000000 0 / 2018-04-08 13:25:19 [45002.370628] multipathd 4266 0.000000 11 0 0.000000 1.085092 0.000000 0 / 2018-04-08 13:25:19 [45002.382039] kdmwork-253:3 4176 7007646.888744 46641 120 0.000000 1080.138455 0.000000 0 / 2018-04-08 13:25:19 [45002.393466] kworker/8:4 7062 7007056.113985 36280 120 0.000000 217.836573 0.000000 0 / 2018-04-08 13:25:19 [45002.404886] master 9169 6997444.468285 2612 120 0.000000 72.981527 0.000000 0 / 2018-04-08 13:25:19 [45002.416308] kdmflush 9305 4569.108255 2 100 0.000000 0.004362 0.000000 0 / 2018-04-08 13:25:19 [45002.427725] bioset 9388 4620.377431 2 100 0.000000 0.005140 0.000000 0 / 2018-04-08 13:25:19 [45002.439153] kworker/8:1H 9891 7007647.149676 90238 100 0.000000 130.911083 0.000000 0 / 2018-04-08 13:25:19 [45002.450588] irqbalance 14463 7006312.942989 4510 120 0.000000 12127.168325 0.000000 0 / 2018-04-08 13:25:19 [45002.462025] z_rd_int_1 18790 9831.378247 262 100 0.000000 2.822767 0.000000 0 / 2018-04-08 13:25:19 [45002.473475] z_rd_int_2 18791 9831.379135 271 100 0.000000 3.002021 0.000000 0 / 2018-04-08 13:25:19 [45002.484934] z_rd_int_7 18796 9831.378163 264 100 0.000000 2.667617 0.000000 0 / 2018-04-08 13:25:19 [45002.496378] z_wr_iss 18805 9899.395996 118 101 0.000000 3.934584 0.000000 0 / 2018-04-08 13:25:19 [45002.507820] z_wr_int_4 18814 9911.397504 744 100 0.000000 6.013190 0.000000 0 / 2018-04-08 13:25:19 [45002.519275] z_rd_int_3 19335 5836040.389256 593 100 0.000000 8.390229 0.000000 0 / 2018-04-08 13:25:19 [45002.530728] z_wr_iss 19349 204676.791512 207 101 0.000000 8.841718 0.000000 0 / 2018-04-08 13:25:19 [45002.542195] z_wr_int_5 19358 204700.799219 949 100 0.000000 9.430200 0.000000 0 / 2018-04-08 13:25:19 [45002.553665] dp_sync_taskq 19385 204677.280209 148 139 0.000000 2.058874 0.000000 0 / 2018-04-08 13:25:19 [45002.565142] dp_sync_taskq 19386 204685.296829 146 139 0.000000 2.787665 0.000000 0 / 2018-04-08 13:25:19 [45002.576614] dp_sync_taskq 19391 204682.318834 148 139 0.000000 1.996513 0.000000 0 / 2018-04-08 13:25:19 [45002.588079] z_null_iss 19953 7007646.883651 88935 100 0.000000 4377.797011 0.000000 0 / 2018-04-08 13:25:19 [45002.599541] z_rd_int_5 19961 17582.234565 695 100 0.000000 7.219828 0.000000 0 / 2018-04-08 13:25:19 [45002.611017] z_wr_iss 19966 10868.266405 176 101 0.000000 5.532624 0.000000 0 / 2018-04-08 13:25:19 [45002.622512] z_wr_int_2 19979 10868.264060 647 100 0.000000 6.683212 0.000000 0 / 2018-04-08 13:25:19 [45002.634004] z_wr_int_4 19981 10868.266862 634 100 0.000000 6.477428 0.000000 0 / 2018-04-08 13:25:19 [45002.645495] dp_sync_taskq 20005 10869.964069 135 139 0.000000 1.442656 0.000000 0 / 2018-04-08 13:25:19 [45002.656978] dp_sync_taskq 20011 10871.784008 104 139 0.000000 1.320088 0.000000 0 / 2018-04-08 13:25:19 [45002.668468] dp_sync_taskq 20014 10869.858128 142 139 0.000000 1.262731 0.000000 0 / 2018-04-08 13:25:19 [45002.679967] z_rd_iss 20536 17582.233247 27 100 0.000000 0.382637 0.000000 0 / 2018-04-08 13:25:19 [45002.691471] z_zvol 20580 7951.558233 13 120 0.000000 1.369214 0.000000 0 / 2018-04-08 13:25:20 [45002.702964] z_wr_iss 21256 10553.990619 73 101 0.000000 2.755314 0.000000 0 / 2018-04-08 13:25:20 [45002.714469] z_wr_int_0 21873 6884398.432445 45623 100 0.000000 551.425966 0.000000 0 / 2018-04-08 13:25:20 [45002.725979] z_wr_iss 22441 6825086.950984 675 101 0.000000 23.718878 0.000000 0 / 2018-04-08 13:25:20 [45002.737485] dp_sync_taskq 22480 6825087.145734 778 139 0.000000 5.674628 0.000000 0 / 2018-04-08 13:25:20 [45002.748993] dp_sync_taskq 22482 6825087.405693 774 139 0.000000 5.141750 0.000000 0 / 2018-04-08 13:25:20 [45002.760519] dp_sync_taskq 22483 6825088.076479 782 139 0.000000 5.418341 0.000000 0 / 2018-04-08 13:25:20 [45002.772035] dp_sync_taskq 22486 6825087.252434 787 139 0.000000 5.435437 0.000000 0 / 2018-04-08 13:25:20 [45002.783552] dp_sync_taskq 22490 6825089.583414 789 139 0.000000 5.323523 0.000000 0 / 2018-04-08 13:25:20 [45002.795068] kiblnd_sd_00_00 23074 7007978.183018 847013 120 0.000000 9183.957306 0.000000 0 / 2018-04-08 13:25:20 [45002.806570] ptlrpcd_00_04 23090 7007646.981330 75064 120 0.000000 1467.589868 0.000000 0 / 2018-04-08 13:25:20 [45002.818067] ldlm_bl_02 23121 7007056.111361 24007 120 0.000000 504.848798 0.000000 0 / 2018-04-08 13:25:20 [45002.829564] ldlm_poold 23123 7007056.122459 44248 120 0.000000 869.025935 0.000000 0 / 2018-04-08 13:25:20 [45002.841047] mdt_fld_0001 24029 17698.485292 11 120 0.000000 0.358684 0.000000 0 / 2018-04-08 13:25:20 [45002.852545] mdt00_003 24060 7006783.925261 70370 120 0.000000 1561.372206 0.000000 0 / 2018-04-08 13:25:20 [45002.864029] osp-pre-1-0 24102 7007646.887454 8820 120 0.000000 157.988878 0.000000 0 / 2018-04-08 13:25:20 [45002.875529] osp-pre-0-0 25292 7007646.887621 10099 120 0.000000 216.139878 0.000000 0 / 2018-04-08 13:25:20 [45002.887025] osp-pre-1-0 26744 7007008.035033 8805 120 0.000000 157.591666 0.000000 0 / 2018-04-08 13:25:20 [45002.898516] osp-syn-8-0 26781 8995.239580 4 120 0.000000 0.108708 0.000000 0 / 2018-04-08 13:25:20 [45002.910014] osp-pre-13-0 26813 7007646.885814 8806 120 0.000000 164.443629 0.000000 0 / 2018-04-08 13:25:20 [45002.921505] osp-syn-1-1 28712 10322.316410 4 120 0.000000 0.115017 0.000000 0 / 2018-04-08 13:25:20 [45002.932985] osp-syn-3-1 28726 10666.222951 4 120 0.000000 0.111571 0.000000 0 / 2018-04-08 13:25:20 [45002.944474] osp-pre-7-1 28741 9831.350045 4 120 0.000000 0.022026 0.000000 0 / 2018-04-08 13:25:20 [45002.955968] osp-pre-11-1 28766 9824.780810 4 120 0.000000 0.023597 0.000000 0 / 2018-04-08 13:25:20 [45002.967459] ldlm_cb00_002 29064 9824.781335 3 120 0.000000 0.067237 0.000000 0 / 2018-04-08 13:25:20 [45002.978939] osp-pre-2-2 30416 10638.036859 4 120 0.000000 0.102427 0.000000 0 / 2018-04-08 13:25:20 [45002.990411] osp-pre-13-2 30609 10007.432089 4 120 0.000000 0.023139 0.000000 0 / 2018-04-08 13:25:20 [45003.001899] lquota_wb_dagg- 31308 6997460.282432 737 120 0.000000 8.502377 0.000000 0 / 2018-04-08 13:25:20 [45003.013386] mdt00_009 32612 7007978.158824 91985 120 0.000000 2099.887132 0.000000 0 / 2018-04-08 13:25:20 [45003.024882] kworker/u897:0 32659 6990310.276777 154 120 0.000000 2.307753 0.000000 0 / 2018-04-08 13:25:20 [45003.036368] mdt_rdpg00_009 32925 6799332.985163 6648 120 0.000000 72.706056 0.000000 0 / 2018-04-08 13:25:20 [45003.047866] mdt_rdpg00_012 34604 6882981.226170 5224 120 0.000000 54.083261 0.000000 0 / 2018-04-08 13:25:20 [45003.059367] z_wr_int_5 40051 204724.799556 2 100 0.000000 0.005603 0.000000 0 / 2018-04-08 13:25:20 [45003.070868] tx_commit_cb 274911 6884398.443146 13 120 0.000000 2.665761 0.000000 0 / 2018-04-08 13:25:20 [45003.082456] mdt_rdpg00_018 276876 6799332.786064 38 120 0.000000 1.472410 0.000000 0 / 2018-04-08 13:25:20 [45003.094046] tx_commit_cb 281691 6799743.590830 5 120 0.000000 0.060067 0.000000 0 / 2018-04-08 13:25:20 [45003.105640] 2018-04-08 13:25:20 [45003.107504] cpu#9, 3200.000 MHz 2018-04-08 13:25:20 [45003.111017] .nr_running : 0 2018-04-08 13:25:20 [45003.115992] .load : 0 2018-04-08 13:25:20 [45003.120970] .nr_switches : 933854743 2018-04-08 13:25:20 [45003.126639] .nr_load_updates : 20680244 2018-04-08 13:25:20 [45003.132212] .nr_uninterruptible : -105 2018-04-08 13:25:20 [45003.137443] .next_balance : 4339.779479 2018-04-08 13:25:20 [45003.143276] .curr->pid : 0 2018-04-08 13:25:20 [45003.148248] .clock : 45003148.096693 2018-04-08 13:25:20 [45003.154434] .cpu_load[0] : 0 2018-04-08 13:25:20 [45003.159398] .cpu_load[1] : 0 2018-04-08 13:25:20 [45003.164356] .cpu_load[2] : 0 2018-04-08 13:25:20 [45003.169311] .cpu_load[3] : 0 2018-04-08 13:25:20 [45003.174260] .cpu_load[4] : 0 2018-04-08 13:25:20 [45003.179199] .avg_idle : 1000000 2018-04-08 13:25:20 [45003.184659] .max_idle_balance_cost : 500000 2018-04-08 13:25:20 [45003.190031] 2018-04-08 13:25:20 [45003.190031] cfs_rq[9]:/ 2018-04-08 13:25:20 [45003.194587] .exec_clock : 0.000000 2018-04-08 13:25:20 [45003.200124] .MIN_vruntime : 0.000001 2018-04-08 13:25:20 [45003.205659] .min_vruntime : 7074864.202916 2018-04-08 13:25:20 [45003.211708] .max_vruntime : 0.000001 2018-04-08 13:25:20 [45003.217237] .spread : 0.000000 2018-04-08 13:25:20 [45003.222758] .spread0 : -87682.293379 2018-04-08 13:25:20 [45003.228709] .nr_spread_over : 0 2018-04-08 13:25:20 [45003.233616] .nr_running : 0 2018-04-08 13:25:20 [45003.238523] .load : 0 2018-04-08 13:25:20 [45003.243423] .runnable_load_avg : 0 2018-04-08 13:25:20 [45003.248322] .blocked_load_avg : 0 2018-04-08 13:25:20 [45003.253221] .tg_load_avg : 0 2018-04-08 13:25:20 [45003.258110] .tg_load_contrib : 0 2018-04-08 13:25:20 [45003.262993] .tg_runnable_contrib : 0 2018-04-08 13:25:20 [45003.267878] .tg->runnable_avg : 0 2018-04-08 13:25:20 [45003.272763] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:20 [45003.277647] .throttled : 0 2018-04-08 13:25:20 [45003.282532] .throttle_count : 0 2018-04-08 13:25:20 [45003.287411] .avg->runnable_avg_sum : 8 2018-04-08 13:25:20 [45003.292287] .avg->runnable_avg_period : 47629 2018-04-08 13:25:20 [45003.297504] 2018-04-08 13:25:20 [45003.297504] rt_rq[9]:/ 2018-04-08 13:25:20 [45003.301833] .rt_nr_running : 0 2018-04-08 13:25:20 [45003.306687] .rt_throttled : 0 2018-04-08 13:25:20 [45003.311533] .rt_time : 0.000000 2018-04-08 13:25:20 [45003.316982] .rt_runtime : 950.000000 2018-04-08 13:25:20 [45003.322595] 2018-04-08 13:25:20 [45003.322595] runnable tasks: 2018-04-08 13:25:20 [45003.322595] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:20 [45003.322595] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:20 [45003.349137] migration/9 54 0.000000 468 0 0.000000 938.284337 0.000000 1 / 2018-04-08 13:25:20 [45003.360514] ksoftirqd/9 55 7074852.206687 14512 120 0.000000 72.515833 0.000000 1 / 2018-04-08 13:25:20 [45003.371896] kworker/9:0H 57 8061.819733 8 100 0.000000 0.022031 0.000000 1 / 2018-04-08 13:25:20 [45003.383297] scsi_tmf_3 351 1146.446150 2 100 0.000000 0.006843 0.000000 1 / 2018-04-08 13:25:20 [45003.394684] scsi_tmf_9 377 1204.370640 2 100 0.000000 0.005378 0.000000 1 / 2018-04-08 13:25:20 [45003.406077] scsi_tmf_10 379 1216.374948 2 100 0.000000 0.004953 0.000000 1 / 2018-04-08 13:25:20 [45003.417475] scsi_tmf_12 383 1248.390805 2 100 0.000000 0.005731 0.000000 1 / 2018-04-08 13:25:20 [45003.428868] scsi_tmf_14 387 1272.401301 2 100 0.000000 0.005938 0.000000 1 / 2018-04-08 13:25:20 [45003.440271] kworker/9:2 572 7074852.207158 31352 120 0.000000 283.438120 0.000000 1 / 2018-04-08 13:25:20 [45003.451671] kdmwork-253:0 4007 7074852.209888 46670 120 0.000000 1020.152306 0.000000 1 / 2018-04-08 13:25:20 [45003.463071] kworker/9:1H 8178 7074852.202927 14387 100 0.000000 21.677300 0.000000 1 / 2018-04-08 13:25:20 [45003.474489] irq/103-hfi1_0 14365 0.000000 4 49 0.000000 9.179610 0.000000 1 / 2018-04-08 13:25:20 [45003.485907] z_null_int 18787 7074852.203019 89403 100 0.000000 601.789140 0.000000 1 / 2018-04-08 13:25:20 [45003.497339] z_wr_iss 19348 236136.578689 203 101 0.000000 8.319543 0.000000 1 / 2018-04-08 13:25:20 [45003.508773] z_rd_int_2 20539 26331.300994 1542 100 0.000000 12.354687 0.000000 1 / 2018-04-08 13:25:20 [45003.520210] z_rd_int_7 20544 26331.301490 1586 100 0.000000 12.895108 0.000000 1 / 2018-04-08 13:25:20 [45003.531630] z_wr_iss 20554 26210.269342 158 101 0.000000 6.167802 0.000000 1 / 2018-04-08 13:25:20 [45003.543065] dp_sync_taskq 20587 26211.846784 141 139 0.000000 1.773602 0.000000 1 / 2018-04-08 13:25:20 [45003.554498] kworker/9:1 21172 14538.835659 2 120 0.000000 0.005068 0.000000 1 / 2018-04-08 13:25:20 [45003.565949] z_wr_iss 21258 25458.234593 69 101 0.000000 2.515445 0.000000 1 / 2018-04-08 13:25:20 [45003.577397] z_wr_iss 21264 25458.236467 74 101 0.000000 2.767678 0.000000 1 / 2018-04-08 13:25:20 [45003.588839] metaslab_group_ 21293 26082.382613 21 100 0.000000 0.221753 0.000000 1 / 2018-04-08 13:25:20 [45003.600290] dp_sync_taskq 21299 25461.886520 57 139 0.000000 0.571535 0.000000 1 / 2018-04-08 13:25:20 [45003.611739] dp_sync_taskq 21300 25466.660816 55 139 0.000000 0.535194 0.000000 1 / 2018-04-08 13:25:20 [45003.623176] dp_sync_taskq 21304 25467.013675 57 139 0.000000 0.519326 0.000000 1 / 2018-04-08 13:25:20 [45003.634633] mmp 21405 7074852.212214 88898 120 0.000000 1571.285759 0.000000 1 / 2018-04-08 13:25:20 [45003.646097] z_wr_iss 21871 6977324.242706 13928 101 0.000000 620.017950 0.000000 1 / 2018-04-08 13:25:20 [45003.657564] dp_sync_taskq 21901 6977325.600940 6949 139 0.000000 132.968496 0.000000 1 / 2018-04-08 13:25:20 [45003.669040] txg_quiesce 22014 7074852.237747 17784 120 0.000000 598.901231 0.000000 1 / 2018-04-08 13:25:20 [45003.680526] kiblnd_sd_01_02 23080 7074854.486406 8996265 120 0.000000 43667.871460 0.000000 1 / 2018-04-08 13:25:21 [45003.692018] ptlrpcd_01_07 23101 7074852.226931 11599 120 0.000000 178.810470 0.000000 1 / 2018-04-08 13:25:21 [45003.703510] ldlm_cb01_001 23113 23482.917673 6 120 0.000000 0.072018 0.000000 1 / 2018-04-08 13:25:21 [45003.715005] ldlm_cn01_001 23118 7074294.543974 574846 120 0.000000 4222.688848 0.000000 1 / 2018-04-08 13:25:21 [45003.726506] ldlm_cn01_004 23402 6895529.995421 403664 120 0.000000 2968.781487 0.000000 1 / 2018-04-08 13:25:21 [45003.737992] mdt_out01_001 24023 7074867.991248 89791970 120 0.000000 1872157.952462 0.000000 1 / 2018-04-08 13:25:21 [45003.749504] mdt01_003 24252 7074843.062482 878096 120 0.000000 12234.007824 0.000000 1 / 2018-04-08 13:25:21 [45003.761006] mdt01_005 24567 7074852.212102 832100 120 0.000000 11750.237027 0.000000 1 / 2018-04-08 13:25:21 [45003.772520] osp-syn-3-0 26752 26110.002722 8 120 0.000000 0.219028 0.000000 1 / 2018-04-08 13:25:21 [45003.784024] osp-pre-5-0 26762 7074852.210917 8806 120 0.000000 168.583113 0.000000 1 / 2018-04-08 13:25:21 [45003.795548] z_rd_int_5 30343 19931.947541 2 100 0.000000 0.006323 0.000000 1 / 2018-04-08 13:25:21 [45003.807067] z_rd_int_5 30344 19943.950201 2 100 0.000000 0.005205 0.000000 1 / 2018-04-08 13:25:21 [45003.818594] z_rd_int_5 30349 20003.964449 2 100 0.000000 0.005224 0.000000 1 / 2018-04-08 13:25:21 [45003.830111] osp-pre-14-2 30621 24335.094902 4 120 0.000000 0.021300 0.000000 1 / 2018-04-08 13:25:21 [45003.841649] mdt01_010 32594 7074843.062335 681438 120 0.000000 9107.473349 0.000000 1 / 2018-04-08 13:25:21 [45003.853186] mdt_rdpg01_013 32920 6895364.164487 7514 120 0.000000 80.229461 0.000000 1 / 2018-04-08 13:25:21 [45003.864724] tx_commit_cb 276394 6976820.447379 8 120 0.000000 0.745769 0.000000 1 / 2018-04-08 13:25:21 [45003.876344] z_wr_int_1 282983 6977396.695263 3 100 0.000000 0.008621 0.000000 1 / 2018-04-08 13:25:21 [45003.887952] z_wr_int_1 282985 6977348.684055 2 100 0.000000 0.005932 0.000000 1 / 2018-04-08 13:25:21 [45003.899558] z_wr_int_6 282988 6977408.700453 3 100 0.000000 0.010851 0.000000 1 / 2018-04-08 13:25:21 [45003.911158] z_wr_int_3 282990 6977396.695232 2 100 0.000000 0.005419 0.000000 1 / 2018-04-08 13:25:21 [45003.922757] z_wr_int_3 282994 6977408.697713 2 100 0.000000 0.006055 0.000000 1 / 2018-04-08 13:25:21 [45003.934357] z_wr_int_3 282997 6977420.700390 2 100 0.000000 0.005476 0.000000 1 / 2018-04-08 13:25:21 [45003.945950] z_wr_int_3 283000 6977444.706014 2 100 0.000000 0.005230 0.000000 1 / 2018-04-08 13:25:21 [45003.957544] z_wr_int_3 283003 6977456.708665 2 100 0.000000 0.005750 0.000000 1 / 2018-04-08 13:25:21 [45003.969134] z_wr_int_3 283004 6977468.711318 2 100 0.000000 0.005127 0.000000 1 / 2018-04-08 13:25:21 [45003.980737] 2018-04-08 13:25:21 [45003.982596] cpu#10, 3200.000 MHz 2018-04-08 13:25:21 [45003.986188] .nr_running : 1 2018-04-08 13:25:21 [45003.991156] .load : 1024 2018-04-08 13:25:21 [45003.996381] .nr_switches : 776343551 2018-04-08 13:25:21 [45004.002031] .nr_load_updates : 18346431 2018-04-08 13:25:21 [45004.007595] .nr_uninterruptible : -134 2018-04-08 13:25:21 [45004.012804] .next_balance : 4339.780343 2018-04-08 13:25:21 [45004.018627] .curr->pid : 890 2018-04-08 13:25:21 [45004.023749] .clock : 45004023.747760 2018-04-08 13:25:21 [45004.029913] .cpu_load[0] : 0 2018-04-08 13:25:21 [45004.034861] .cpu_load[1] : 0 2018-04-08 13:25:21 [45004.039801] .cpu_load[2] : 0 2018-04-08 13:25:21 [45004.044732] .cpu_load[3] : 0 2018-04-08 13:25:21 [45004.049663] .cpu_load[4] : 0 2018-04-08 13:25:21 [45004.054590] .avg_idle : 1000000 2018-04-08 13:25:21 [45004.060034] .max_idle_balance_cost : 500000 2018-04-08 13:25:21 [45004.065392] 2018-04-08 13:25:21 [45004.065392] cfs_rq[10]:/ 2018-04-08 13:25:21 [45004.070005] .exec_clock : 0.000000 2018-04-08 13:25:21 [45004.075520] .MIN_vruntime : 0.000001 2018-04-08 13:25:21 [45004.081030] .min_vruntime : 6614370.239683 2018-04-08 13:25:21 [45004.087052] .max_vruntime : 0.000001 2018-04-08 13:25:21 [45004.092553] .spread : 0.000000 2018-04-08 13:25:21 [45004.098046] .spread0 : -548599.821315 2018-04-08 13:25:21 [45004.104051] .nr_spread_over : 0 2018-04-08 13:25:21 [45004.108936] .nr_running : 0 2018-04-08 13:25:21 [45004.113814] .load : 0 2018-04-08 13:25:21 [45004.118684] .runnable_load_avg : 0 2018-04-08 13:25:21 [45004.123548] .blocked_load_avg : 4 2018-04-08 13:25:21 [45004.128410] .tg_load_avg : 0 2018-04-08 13:25:21 [45004.133266] .tg_load_contrib : 0 2018-04-08 13:25:21 [45004.138120] .tg_runnable_contrib : 0 2018-04-08 13:25:21 [45004.142976] .tg->runnable_avg : 0 2018-04-08 13:25:21 [45004.147831] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:21 [45004.152686] .throttled : 0 2018-04-08 13:25:21 [45004.157531] .throttle_count : 0 2018-04-08 13:25:21 [45004.162376] .avg->runnable_avg_sum : 411 2018-04-08 13:25:21 [45004.167382] .avg->runnable_avg_period : 46439 2018-04-08 13:25:21 [45004.172558] 2018-04-08 13:25:21 [45004.172558] rt_rq[10]:/ 2018-04-08 13:25:21 [45004.176917] .rt_nr_running : 0 2018-04-08 13:25:21 [45004.181746] .rt_throttled : 0 2018-04-08 13:25:21 [45004.186578] .rt_time : 0.000000 2018-04-08 13:25:21 [45004.192011] .rt_runtime : 950.000000 2018-04-08 13:25:21 [45004.197619] 2018-04-08 13:25:21 [45004.197619] runnable tasks: 2018-04-08 13:25:21 [45004.197619] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:21 [45004.197619] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:21 [45004.224164] migration/10 59 0.000000 390 0 0.000000 945.483871 0.000000 0 / 2018-04-08 13:25:21 [45004.235556] ksoftirqd/10 60 6614044.720709 83128 120 0.000000 294.407335 0.000000 0 / 2018-04-08 13:25:21 [45004.246940] kworker/10:0H 62 2991.056539 8 100 0.000000 0.022079 0.000000 0 / 2018-04-08 13:25:21 [45004.258340] kworker/10:1 341 6417.470228 109 120 0.000000 2.978583 0.000000 0 / 2018-04-08 13:25:21 [45004.269737] scsi_eh_1 345 85.522060 2 120 0.000000 0.004982 0.000000 0 / 2018-04-08 13:25:21 [45004.281135] systemd-journal 890 6614359.203456 15881 120 0.000000 385.160187 0.000000 0 / 2018-04-08 13:25:21 [45004.292532] multipathd 4267 0.000000 8 0 0.000000 4.883929 0.000000 0 / 2018-04-08 13:25:21 [45004.303931] kworker/10:1H 4241 6614211.391737 90853 100 0.000000 128.197991 0.000000 0 / 2018-04-08 13:25:21 [45004.315348] kworker/10:4 6846 6614335.238494 36693 120 0.000000 223.968870 0.000000 0 / 2018-04-08 13:25:21 [45004.326755] kdmflush 7813 3261.570690 2 100 0.000000 0.004835 0.000000 0 / 2018-04-08 13:25:21 [45004.338175] zed 8932 8229.853746 191 120 0.000000 26.665811 0.000000 0 / 2018-04-08 13:25:21 [45004.349614] z_rd_int_4 18793 9049.592450 265 100 0.000000 2.300331 0.000000 0 / 2018-04-08 13:25:21 [45004.361039] z_wr_iss 18806 9172.745516 122 101 0.000000 3.929290 0.000000 0 / 2018-04-08 13:25:21 [45004.372482] z_wr_iss 18807 9172.747747 117 101 0.000000 3.994657 0.000000 0 / 2018-04-08 13:25:21 [45004.383926] z_wr_iss 18808 9172.745763 126 101 0.000000 3.186234 0.000000 0 / 2018-04-08 13:25:21 [45004.395356] z_wr_int_2 18812 9196.751743 698 100 0.000000 6.234644 0.000000 0 / 2018-04-08 13:25:21 [45004.406804] dp_sync_taskq 18848 9173.992542 156 139 0.000000 1.193173 0.000000 0 / 2018-04-08 13:25:21 [45004.418250] z_wr_iss 19346 163071.099366 202 101 0.000000 8.984409 0.000000 0 / 2018-04-08 13:25:21 [45004.429690] txg_quiesce 19593 6614211.432518 17761 120 0.000000 601.339572 0.000000 0 / 2018-04-08 13:25:21 [45004.441150] z_rd_int_2 19958 17221.076557 685 100 0.000000 7.546576 0.000000 0 / 2018-04-08 13:25:21 [45004.452612] z_wr_iss 19967 10836.422171 149 101 0.000000 6.021378 0.000000 0 / 2018-04-08 13:25:21 [45004.464069] dp_sync_taskq 20006 10836.832635 123 139 0.000000 1.238394 0.000000 0 / 2018-04-08 13:25:21 [45004.475539] dp_sync_taskq 20016 10840.992510 136 139 0.000000 1.608927 0.000000 0 / 2018-04-08 13:25:21 [45004.487011] z_wr_iss 20548 13139.870659 176 101 0.000000 6.981073 0.000000 0 / 2018-04-08 13:25:21 [45004.498485] metaslab_group_ 20582 18072.578086 27 100 0.000000 0.221459 0.000000 0 / 2018-04-08 13:25:21 [45004.509963] txg_quiesce 20779 6614211.430701 17760 120 0.000000 567.933096 0.000000 0 / 2018-04-08 13:25:21 [45004.521441] txg_sync 20780 6614211.422364 18036 120 0.000000 387.965165 0.000000 0 / 2018-04-08 13:25:21 [45004.532935] z_wr_iss 21261 10341.384624 66 101 0.000000 2.777956 0.000000 0 / 2018-04-08 13:25:21 [45004.544423] z_rd_int_1 21853 6503201.472706 3305 100 0.000000 33.444497 0.000000 0 / 2018-04-08 13:25:21 [45004.555923] z_rd_int_2 21854 6503201.472616 3297 100 0.000000 33.091696 0.000000 0 / 2018-04-08 13:25:21 [45004.567416] z_rd_int_5 21857 6503201.472545 3230 100 0.000000 33.600636 0.000000 0 / 2018-04-08 13:25:21 [45004.578915] z_rd_int_7 21859 6503201.473857 3281 100 0.000000 33.773513 0.000000 0 / 2018-04-08 13:25:21 [45004.590416] z_wr_iss 22442 6455071.704002 661 101 0.000000 23.242380 0.000000 0 / 2018-04-08 13:25:21 [45004.601916] z_wr_int_5 22456 6455071.705498 3321 100 0.000000 30.380485 0.000000 0 / 2018-04-08 13:25:21 [45004.613425] dp_sync_taskq 22484 6455074.113642 779 139 0.000000 5.251092 0.000000 0 / 2018-04-08 13:25:21 [45004.624936] dp_sync_taskq 22485 6455074.954138 777 139 0.000000 5.638004 0.000000 0 / 2018-04-08 13:25:21 [45004.636425] dp_sync_taskq 22488 6455074.640248 792 139 0.000000 5.232902 0.000000 0 / 2018-04-08 13:25:21 [45004.647917] txg_quiesce 22583 6614211.433413 17753 120 0.000000 605.478196 0.000000 0 / 2018-04-08 13:25:21 [45004.659424] txg_sync 22584 6614211.423559 19179 120 0.000000 450.694095 0.000000 0 / 2018-04-08 13:25:21 [45004.670938] kiblnd_sd_00_00 23074 6614358.264246 847042 120 0.000000 9184.084077 0.000000 0 / 2018-04-08 13:25:21 [45004.682459] ptlrpcd_00_03 23089 6614211.459721 75273 120 0.000000 1437.786010 0.000000 0 / 2018-04-08 13:25:22 [45004.693981] mgs_images_noti 23209 8257.005669 24 118 0.000000 0.760773 0.000000 0 / 2018-04-08 13:25:22 [45004.705503] lquota_wb_image 24237 6612337.222174 739 120 0.000000 9.581841 0.000000 0 / 2018-04-08 13:25:22 [45004.717031] mdt00_005 24569 6614044.719549 95841 120 0.000000 2182.730892 0.000000 0 / 2018-04-08 13:25:22 [45004.728569] osp-pre-9-0 26787 6614211.397297 8806 120 0.000000 164.308122 0.000000 0 / 2018-04-08 13:25:22 [45004.740099] osp-pre-10-1 28761 9039.634742 4 120 0.000000 0.027350 0.000000 0 / 2018-04-08 13:25:22 [45004.751639] osp-pre-13-1 28781 9039.631589 4 120 0.000000 0.020558 0.000000 0 / 2018-04-08 13:25:22 [45004.763174] qsd_reint_1.dag 29158 10351.165503 67 120 0.000000 0.779691 0.000000 0 / 2018-04-08 13:25:22 [45004.774681] tgt_recover_1 29650 6605551.310923 862 120 0.000000 1917.507269 0.000000 0 / 2018-04-08 13:25:22 [45004.786196] osp-pre-0-2 30392 10259.091859 4 120 0.000000 0.081206 0.000000 0 / 2018-04-08 13:25:22 [45004.797723] osp-pre-1-2 30401 10259.091877 4 120 0.000000 0.039045 0.000000 0 / 2018-04-08 13:25:22 [45004.809235] tgt_recover_2 31538 6607206.524124 862 120 0.000000 117.489843 0.000000 0 / 2018-04-08 13:25:22 [45004.820750] mdt_rdpg00_004 31989 6440983.475195 3368 120 0.000000 43.166244 0.000000 0 / 2018-04-08 13:25:22 [45004.832258] mdt00_008 32605 6614335.238487 96128 120 0.000000 2185.812709 0.000000 0 / 2018-04-08 13:25:22 [45004.843773] mdt00_009 32612 6614358.258186 91991 120 0.000000 2099.953135 0.000000 0 / 2018-04-08 13:25:22 [45004.855278] mdt_out00_003 35475 6614347.236407 112017091 120 0.000000 2235873.401430 0.000000 0 / 2018-04-08 13:25:22 [45004.866793] mdt_out00_004 37366 6977761.313560 449409586 120 0.000000 10846870.781127 0.000000 0 / 2018-04-08 13:25:22 [45004.878309] z_wr_int_7 282318 6455083.703571 4 100 0.000000 0.020088 0.000000 0 / 2018-04-08 13:25:22 [45004.889917] z_wr_int_7 282961 6503333.640744 4 100 0.000000 0.011725 0.000000 0 / 2018-04-08 13:25:22 [45004.901519] 2018-04-08 13:25:22 [45004.903389] cpu#11, 3200.000 MHz 2018-04-08 13:25:22 [45004.906998] .nr_running : 0 2018-04-08 13:25:22 [45004.911987] .load : 0 2018-04-08 13:25:22 [45004.916973] .nr_switches : 958613093 2018-04-08 13:25:22 [45004.922650] .nr_load_updates : 21771612 2018-04-08 13:25:22 [45004.928241] .nr_uninterruptible : -89 2018-04-08 13:25:22 [45004.933388] .next_balance : 4339.781279 2018-04-08 13:25:22 [45004.939233] .curr->pid : 0 2018-04-08 13:25:22 [45004.944206] .clock : 45004943.723932 2018-04-08 13:25:22 [45004.950388] .cpu_load[0] : 0 2018-04-08 13:25:22 [45004.955357] .cpu_load[1] : 0 2018-04-08 13:25:22 [45004.960323] .cpu_load[2] : 0 2018-04-08 13:25:22 [45004.965278] .cpu_load[3] : 0 2018-04-08 13:25:22 [45004.970224] .cpu_load[4] : 0 2018-04-08 13:25:22 [45004.975162] .avg_idle : 1000000 2018-04-08 13:25:22 [45004.980615] .max_idle_balance_cost : 500000 2018-04-08 13:25:22 [45004.985980] 2018-04-08 13:25:22 [45004.985980] cfs_rq[11]:/ 2018-04-08 13:25:22 [45004.990629] .exec_clock : 0.000000 2018-04-08 13:25:22 [45004.996165] .MIN_vruntime : 0.000001 2018-04-08 13:25:22 [45005.001704] .min_vruntime : 8259934.616191 2018-04-08 13:25:22 [45005.007753] .max_vruntime : 0.000001 2018-04-08 13:25:22 [45005.013281] .spread : 0.000000 2018-04-08 13:25:22 [45005.018804] .spread0 : 1096497.013033 2018-04-08 13:25:22 [45005.024848] .nr_spread_over : 0 2018-04-08 13:25:22 [45005.029763] .nr_running : 0 2018-04-08 13:25:22 [45005.034678] .load : 0 2018-04-08 13:25:22 [45005.039583] .runnable_load_avg : 0 2018-04-08 13:25:22 [45005.044489] .blocked_load_avg : 0 2018-04-08 13:25:22 [45005.049384] .tg_load_avg : 0 2018-04-08 13:25:22 [45005.054273] .tg_load_contrib : 0 2018-04-08 13:25:22 [45005.059160] .tg_runnable_contrib : 0 2018-04-08 13:25:22 [45005.064041] .tg->runnable_avg : 0 2018-04-08 13:25:22 [45005.068922] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:22 [45005.073802] .throttled : 0 2018-04-08 13:25:22 [45005.078683] .throttle_count : 0 2018-04-08 13:25:22 [45005.083552] .avg->runnable_avg_sum : 122 2018-04-08 13:25:22 [45005.088589] .avg->runnable_avg_period : 46606 2018-04-08 13:25:22 [45005.093802] 2018-04-08 13:25:22 [45005.093802] rt_rq[11]:/ 2018-04-08 13:25:22 [45005.098218] .rt_nr_running : 0 2018-04-08 13:25:22 [45005.103074] .rt_throttled : 0 2018-04-08 13:25:22 [45005.107922] .rt_time : 0.000000 2018-04-08 13:25:22 [45005.113371] .rt_runtime : 950.000000 2018-04-08 13:25:22 [45005.118987] 2018-04-08 13:25:22 [45005.118987] runnable tasks: 2018-04-08 13:25:22 [45005.118987] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:22 [45005.118987] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:22 [45005.145528] migration/11 64 0.000000 478 0 0.000000 948.860579 0.000000 1 / 2018-04-08 13:25:22 [45005.156902] ksoftirqd/11 65 8259740.206672 13620 120 0.000000 59.550489 0.000000 1 / 2018-04-08 13:25:22 [45005.168296] kworker/11:0H 67 9229.238221 8 100 0.000000 0.022697 0.000000 1 / 2018-04-08 13:25:22 [45005.179687] scsi_eh_8 374 395.471384 22 120 0.000000 0.098870 0.000000 1 / 2018-04-08 13:25:22 [45005.191083] scsi_eh_9 376 395.562765 22 120 0.000000 0.200381 0.000000 1 / 2018-04-08 13:25:22 [45005.202486] kworker/11:1 415 8259922.619068 30047 120 0.000000 268.347684 0.000000 1 / 2018-04-08 13:25:22 [45005.213884] kworker/11:2 655 633.379009 2 120 0.000000 0.004157 0.000000 1 / 2018-04-08 13:25:22 [45005.225289] kdmflush 3746 3556.385712 2 100 0.000000 0.007042 0.000000 1 / 2018-04-08 13:25:22 [45005.236684] bioset 4147 4425.596710 2 100 0.000000 0.006743 0.000000 1 / 2018-04-08 13:25:22 [45005.248082] kworker/11:1H 7860 8259740.202548 13392 100 0.000000 19.667479 0.000000 1 / 2018-04-08 13:25:22 [45005.259493] zed 9142 13487.409769 41 120 0.000000 4.175878 0.000000 1 / 2018-04-08 13:25:22 [45005.270912] kdmflush 9244 10157.078193 2 100 0.000000 0.003890 0.000000 1 / 2018-04-08 13:25:22 [45005.282330] bioset 9257 10169.472293 2 100 0.000000 0.004553 0.000000 1 / 2018-04-08 13:25:22 [45005.293758] z_rd_int_2 19334 231300.257330 639 100 0.000000 7.291984 0.000000 1 / 2018-04-08 13:25:22 [45005.305196] z_rd_iss 19955 30372.553034 23 100 0.000000 0.350809 0.000000 1 / 2018-04-08 13:25:22 [45005.316628] z_rd_int_7 19963 30372.651008 699 100 0.000000 7.764012 0.000000 1 / 2018-04-08 13:25:22 [45005.328067] z_wr_iss 19975 29419.287001 169 101 0.000000 5.901843 0.000000 1 / 2018-04-08 13:25:22 [45005.339511] z_wr_int_6 19983 29419.282856 637 100 0.000000 6.392281 0.000000 1 / 2018-04-08 13:25:22 [45005.350949] z_rd_int_3 20540 30372.932984 1569 100 0.000000 12.451140 0.000000 1 / 2018-04-08 13:25:22 [45005.362391] z_rd_int_4 20541 30372.809364 1540 100 0.000000 12.262240 0.000000 1 / 2018-04-08 13:25:22 [45005.373837] z_rd_int_6 20543 30372.777557 1583 100 0.000000 12.269883 0.000000 1 / 2018-04-08 13:25:22 [45005.385277] z_wr_iss 20546 30224.049033 181 101 0.000000 25.550442 0.000000 1 / 2018-04-08 13:25:22 [45005.396710] z_wr_iss 20552 30224.048469 182 101 0.000000 6.921447 0.000000 1 / 2018-04-08 13:25:22 [45005.408157] z_wr_int_5 20563 30224.043549 715 100 0.000000 7.144960 0.000000 1 / 2018-04-08 13:25:22 [45005.419605] z_wr_iss 21267 28967.022518 63 101 0.000000 2.774166 0.000000 1 / 2018-04-08 13:25:22 [45005.431056] z_wr_iss 21863 8114286.959664 13818 101 0.000000 614.427172 0.000000 1 / 2018-04-08 13:25:22 [45005.442506] z_wr_iss 21870 8114286.958331 13855 101 0.000000 624.517344 0.000000 1 / 2018-04-08 13:25:22 [45005.453971] z_wr_int_1 21874 8114286.958700 45715 100 0.000000 548.980943 0.000000 1 / 2018-04-08 13:25:22 [45005.465432] z_wr_int_6 22457 8069347.548913 3330 100 0.000000 31.835662 0.000000 1 / 2018-04-08 13:25:22 [45005.476897] obd_zombid 23042 18659.117968 2 120 0.000000 0.007382 0.000000 1 / 2018-04-08 13:25:22 [45005.488371] ldlm_cn01_003 23399 8044301.465727 38920 120 0.000000 300.549263 0.000000 1 / 2018-04-08 13:25:22 [45005.499845] ldlm_cn01_005 23517 8044301.465370 797013 120 0.000000 5822.318643 0.000000 1 / 2018-04-08 13:25:22 [45005.511320] mdt01_002 24011 8259922.682718 860780 120 0.000000 11958.080429 0.000000 1 / 2018-04-08 13:25:22 [45005.522804] mdt_out01_001 24023 8259936.795699 89814365 120 0.000000 1872192.737539 0.000000 1 / 2018-04-08 13:25:22 [45005.534287] mdt01_004 24565 8259582.301035 591442 120 0.000000 8288.222410 0.000000 1 / 2018-04-08 13:25:22 [45005.545774] mdt01_005 24567 8259922.626164 832103 120 0.000000 11750.247000 0.000000 1 / 2018-04-08 13:25:22 [45005.557258] mdt01_007 25153 8259582.300889 715037 120 0.000000 9788.502980 0.000000 1 / 2018-04-08 13:25:22 [45005.568750] osp-syn-0-0 25301 7345467.750993 15595 120 0.000000 370.252231 0.000000 1 / 2018-04-08 13:25:22 [45005.580227] osp-pre-12-0 26806 8259740.004250 8806 120 0.000000 160.153523 0.000000 1 / 2018-04-08 13:25:22 [45005.591739] mdt_rdpg01_003 27979 8044301.476455 4826 120 0.000000 55.647433 0.000000 1 / 2018-04-08 13:25:22 [45005.603255] osp-syn-15-2 30648 28029.563196 6 120 0.000000 0.402096 0.000000 1 / 2018-04-08 13:25:22 [45005.614767] mdt01_009 32593 8259582.300957 926470 120 0.000000 13053.504508 0.000000 1 / 2018-04-08 13:25:22 [45005.626294] mdt_rdpg01_007 32914 8044301.465692 11543 120 0.000000 104.525868 0.000000 1 / 2018-04-08 13:25:22 [45005.637827] z_wr_int_5 282327 8069347.548691 3 100 0.000000 0.016546 0.000000 1 / 2018-04-08 13:25:22 [45005.649447] kworker/u896:0 282576 8259923.291216 12810 120 0.000000 523.821201 0.000000 1 / 2018-04-08 13:25:22 [45005.661073] 2018-04-08 13:25:22 [45005.662969] cpu#12, 3200.000 MHz 2018-04-08 13:25:22 [45005.666585] .nr_running : 1 2018-04-08 13:25:22 [45005.671573] .load : 1024 2018-04-08 13:25:22 [45005.676817] .nr_switches : 829948198 2018-04-08 13:25:23 [45005.682494] .nr_load_updates : 19309431 2018-04-08 13:25:23 [45005.688078] .nr_uninterruptible : 27 2018-04-08 13:25:23 [45005.693144] .next_balance : 4339.782027 2018-04-08 13:25:23 [45005.698984] .curr->pid : 29210 2018-04-08 13:25:23 [45005.704307] .clock : 45005704.303001 2018-04-08 13:25:23 [45005.710490] .cpu_load[0] : 0 2018-04-08 13:25:23 [45005.715457] .cpu_load[1] : 0 2018-04-08 13:25:23 [45005.720421] .cpu_load[2] : 266 2018-04-08 13:25:23 [45005.725549] .cpu_load[3] : 186 2018-04-08 13:25:23 [45005.730671] .cpu_load[4] : 295 2018-04-08 13:25:23 [45005.735795] .avg_idle : 10848 2018-04-08 13:25:23 [45005.741084] .max_idle_balance_cost : 500000 2018-04-08 13:25:23 [45005.746460] 2018-04-08 13:25:23 [45005.746460] cfs_rq[12]:/ 2018-04-08 13:25:23 [45005.751112] .exec_clock : 0.000000 2018-04-08 13:25:23 [45005.756647] .MIN_vruntime : 0.000001 2018-04-08 13:25:23 [45005.762177] .min_vruntime : 6978049.753737 2018-04-08 13:25:23 [45005.768231] .max_vruntime : 0.000001 2018-04-08 13:25:23 [45005.773762] .spread : 0.000000 2018-04-08 13:25:23 [45005.779294] .spread0 : -185397.538217 2018-04-08 13:25:23 [45005.785347] .nr_spread_over : 0 2018-04-08 13:25:23 [45005.790271] .nr_running : 1 2018-04-08 13:25:23 [45005.795186] .load : 1024 2018-04-08 13:25:23 [45005.800362] .runnable_load_avg : 0 2018-04-08 13:25:23 [45005.805271] .blocked_load_avg : 520 2018-04-08 13:25:23 [45005.810355] .tg_load_avg : 0 2018-04-08 13:25:23 [45005.815260] .tg_load_contrib : 0 2018-04-08 13:25:23 [45005.820166] .tg_runnable_contrib : 0 2018-04-08 13:25:23 [45005.825063] .tg->runnable_avg : 0 2018-04-08 13:25:23 [45005.829962] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:23 [45005.834856] .throttled : 0 2018-04-08 13:25:23 [45005.839745] .throttle_count : 0 2018-04-08 13:25:23 [45005.844634] .avg->runnable_avg_sum : 22871 2018-04-08 13:25:23 [45005.849864] .avg->runnable_avg_period : 47041 2018-04-08 13:25:23 [45005.855091] 2018-04-08 13:25:23 [45005.855091] rt_rq[12]:/ 2018-04-08 13:25:23 [45005.859534] .rt_nr_running : 0 2018-04-08 13:25:23 [45005.864403] .rt_throttled : 0 2018-04-08 13:25:23 [45005.869267] .rt_time : 0.000000 2018-04-08 13:25:23 [45005.874727] .rt_runtime : 950.000000 2018-04-08 13:25:23 [45005.880357] 2018-04-08 13:25:23 [45005.880357] runnable tasks: 2018-04-08 13:25:23 [45005.880357] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:23 [45005.880357] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:23 [45005.906923] migration/12 69 0.000000 336 0 0.000000 940.301050 0.000000 0 / 2018-04-08 13:25:23 [45005.918310] ksoftirqd/12 70 6977739.971018 75836 120 0.000000 265.388490 0.000000 0 / 2018-04-08 13:25:23 [45005.929709] kworker/12:0H 72 181.798054 8 100 0.000000 0.023297 0.000000 0 / 2018-04-08 13:25:23 [45005.941100] khugepaged 109 6977475.617262 4518 139 0.000000 150.120261 0.000000 0 / 2018-04-08 13:25:23 [45005.952502] kworker/12:1H 600 6977750.904741 87648 100 0.000000 124.686282 0.000000 0 / 2018-04-08 13:25:23 [45005.963906] systemd-udevd 931 8665.535760 1361 120 0.000000 918.795428 0.000000 0 / 2018-04-08 13:25:23 [45005.975315] kworker/12:2 2952 6977750.625654 38893 120 0.000000 230.636471 0.000000 0 / 2018-04-08 13:25:23 [45005.986720] multipathd 4269 0.000000 7 0 0.000000 38.026119 0.000000 0 / 2018-04-08 13:25:23 [45005.998138] kdmwork-253:2 4165 6977473.082614 47288 120 0.000000 1016.203101 0.000000 0 / 2018-04-08 13:25:23 [45006.009554] kdmflush 4183 2718.026584 2 100 0.000000 0.005300 0.000000 0 / 2018-04-08 13:25:23 [45006.020984] kdmwork-253:4 4186 6977739.956946 46984 120 0.000000 1042.983833 0.000000 0 / 2018-04-08 13:25:23 [45006.032417] kdmflush 4204 2730.030934 2 100 0.000000 0.004796 0.000000 0 / 2018-04-08 13:25:23 [45006.043867] kdmwork-253:7 4218 6977750.625552 98523 120 0.000000 1210.172915 0.000000 0 / 2018-04-08 13:25:23 [45006.055326] kdmflush 4227 2742.034986 2 100 0.000000 0.004417 0.000000 0 / 2018-04-08 13:25:23 [45006.066778] kdmwork-253:8 4230 6977750.627510 50750 120 0.000000 924.925151 0.000000 0 / 2018-04-08 13:25:23 [45006.078239] dbu_evict 8861 6103544.992037 1489 120 0.000000 39.113616 0.000000 0 / 2018-04-08 13:25:23 [45006.089688] rsyslogd 8904 6965306.296851 79 120 0.000000 5.377606 0.000000 0 / 2018-04-08 13:25:23 [45006.101168] dbus-daemon 8915 11356.676007 444 120 0.000000 24.662637 0.000000 0 / 2018-04-08 13:25:23 [45006.112632] kworker/12:4 12475 5462.145839 7 120 0.000000 0.020979 0.000000 0 / 2018-04-08 13:25:23 [45006.124112] z_rd_int_0 18789 11220.114340 252 100 0.000000 2.212371 0.000000 0 / 2018-04-08 13:25:23 [45006.135597] z_wr_int_0 18810 11284.299754 721 100 0.000000 6.186578 0.000000 0 / 2018-04-08 13:25:23 [45006.147081] z_rd_iss 19331 17585.688333 34 100 0.000000 0.860936 0.000000 0 / 2018-04-08 13:25:23 [45006.158564] z_wr_iss 19347 190474.108020 196 101 0.000000 8.686688 0.000000 0 / 2018-04-08 13:25:23 [45006.170059] z_wr_int_0 19353 190474.106070 959 100 0.000000 9.570204 0.000000 0 / 2018-04-08 13:25:23 [45006.181558] z_wr_iss 19973 12568.749985 147 101 0.000000 5.577638 0.000000 0 / 2018-04-08 13:25:23 [45006.193051] z_wr_int_7 19984 12604.757921 623 100 0.000000 6.296415 0.000000 0 / 2018-04-08 13:25:23 [45006.204553] dp_sync_taskq 20015 12568.952292 113 139 0.000000 1.162933 0.000000 0 / 2018-04-08 13:25:23 [45006.216059] z_wr_int_4 20562 16472.419787 705 100 0.000000 7.216376 0.000000 0 / 2018-04-08 13:25:23 [45006.227568] z_wr_iss 21257 11753.455022 68 101 0.000000 5.245507 0.000000 0 / 2018-04-08 13:25:23 [45006.239078] txg_quiesce 21403 6977750.659042 17760 120 0.000000 589.483188 0.000000 0 / 2018-04-08 13:25:23 [45006.250599] txg_sync 21404 6977750.647100 17919 120 0.000000 387.126738 0.000000 0 / 2018-04-08 13:25:23 [45006.262110] z_wr_iss 21866 6865482.427919 13769 101 0.000000 619.797374 0.000000 0 / 2018-04-08 13:25:23 [45006.273629] z_wr_int_4 21877 6865482.426954 44922 100 0.000000 545.020004 0.000000 0 / 2018-04-08 13:25:23 [45006.285148] z_wr_iss 22448 6812272.936078 677 101 0.000000 21.695995 0.000000 0 / 2018-04-08 13:25:23 [45006.296676] z_wr_iss 22449 6812272.936291 667 101 0.000000 22.626556 0.000000 0 / 2018-04-08 13:25:23 [45006.308203] metaslab_group_ 22475 6813286.444463 155 100 0.000000 1.490295 0.000000 0 / 2018-04-08 13:25:23 [45006.319730] dp_sync_taskq 22491 6812273.333751 796 139 0.000000 5.503989 0.000000 0 / 2018-04-08 13:25:23 [45006.331261] ptlrpcd_00_02 23088 6977576.288485 75155 120 0.000000 1478.114461 0.000000 0 / 2018-04-08 13:25:23 [45006.342806] ll_ping 23102 6975239.833684 1846 120 0.000000 183.773548 0.000000 0 / 2018-04-08 13:25:23 [45006.354361] ll_mgs_0000 23132 6978318.192082 101575 120 0.000000 2552.175609 0.000000 0 / 2018-04-08 13:25:23 [45006.365907] tx_commit_cb 23398 11284.306300 18 120 0.000000 0.093993 0.000000 0 / 2018-04-08 13:25:23 [45006.377455] mdt00_000 24006 6978189.213441 99114 120 0.000000 2289.869275 0.000000 0 / 2018-04-08 13:25:23 [45006.389005] mdt_rdpg00_000 24012 6790740.474816 2655 120 0.000000 27.066968 0.000000 0 / 2018-04-08 13:25:23 [45006.400567] lquota_wb_apps- 24805 6968931.350046 738 120 0.000000 10.102675 0.000000 0 / 2018-04-08 13:25:23 [45006.412139] tx_commit_cb 25137 6812272.946088 93 120 0.000000 2.054804 0.000000 0 / 2018-04-08 13:25:23 [45006.423719] osp-pre-1-0 25308 6977690.783075 10102 120 0.000000 205.812349 0.000000 0 / 2018-04-08 13:25:23 [45006.435285] osp-pre-4-0 26756 6977576.290878 8806 120 0.000000 173.096444 0.000000 0 / 2018-04-08 13:25:23 [45006.446843] osp-pre-14-0 26819 6977576.293609 8806 120 0.000000 165.257097 0.000000 0 / 2018-04-08 13:25:23 [45006.458399] ldlm_cn00_007 28412 6810628.880171 26249 120 0.000000 362.635282 0.000000 0 / 2018-04-08 13:25:23 [45006.469949] osp-pre-5-1 28731 11216.578357 4 120 0.000000 0.024473 0.000000 0 / 2018-04-08 13:25:23 [45006.481498] osp-syn-12-1 28777 11212.453748 4 120 0.000000 0.098117 0.000000 0 / 2018-04-08 13:25:23 [45006.493039] osp-syn-15-1 28793 11212.459108 4 120 0.000000 0.102551 0.000000 0 / 2018-04-08 13:25:23 [45006.504585] dist_txn-2 31311 11344.338677 2 120 0.000000 0.030185 0.000000 0 / 2018-04-08 13:25:23 [45006.516133] mdt_rdpg00_005 31990 6790740.475415 5957 120 0.000000 85.396744 0.000000 0 / 2018-04-08 13:25:23 [45006.527675] mdt00_012 32615 6977483.110931 103025 120 0.000000 2272.326529 0.000000 0 / 2018-04-08 13:25:23 [45006.539207] mdt_rdpg00_011 34602 6790740.475207 2060 120 0.000000 25.068311 0.000000 0 / 2018-04-08 13:25:23 [45006.550749] z_wr_int_6 35156 12592.751816 2 100 0.000000 0.005398 0.000000 0 / 2018-04-08 13:25:23 [45006.562291] z_rd_int_3 37649 19590.169289 2 100 0.000000 0.007268 0.000000 0 / 2018-04-08 13:25:23 [45006.573813] mdt_rdpg00_017 276875 6790740.615974 40 120 0.000000 1.510185 0.000000 0 / 2018-04-08 13:25:23 [45006.585425] pickup 279397 6970404.217873 54 120 0.000000 9.646413 0.000000 0 / 2018-04-08 13:25:23 [45006.597035] z_wr_int_1 282311 6812272.935772 5 100 0.000000 0.020748 0.000000 0 / 2018-04-08 13:25:23 [45006.608665] 2018-04-08 13:25:23 [45006.610556] cpu#13, 3200.000 MHz 2018-04-08 13:25:23 [45006.614180] .nr_running : 0 2018-04-08 13:25:23 [45006.619183] .load : 0 2018-04-08 13:25:23 [45006.624185] .nr_switches : 994572867 2018-04-08 13:25:23 [45006.629871] .nr_load_updates : 22702120 2018-04-08 13:25:23 [45006.635469] .nr_uninterruptible : -45 2018-04-08 13:25:23 [45006.640641] .next_balance : 4339.782990 2018-04-08 13:25:23 [45006.646499] .curr->pid : 0 2018-04-08 13:25:23 [45006.651484] .clock : 45006650.567347 2018-04-08 13:25:23 [45006.657688] .cpu_load[0] : 0 2018-04-08 13:25:23 [45006.662668] .cpu_load[1] : 0 2018-04-08 13:25:23 [45006.667650] .cpu_load[2] : 0 2018-04-08 13:25:23 [45006.672622] .cpu_load[3] : 0 2018-04-08 13:25:23 [45006.677588] .cpu_load[4] : 0 2018-04-08 13:25:24 [45006.682546] .avg_idle : 1000000 2018-04-08 13:25:24 [45006.688023] .max_idle_balance_cost : 500000 2018-04-08 13:25:24 [45006.693408] 2018-04-08 13:25:24 [45006.693408] cfs_rq[13]:/ 2018-04-08 13:25:24 [45006.698078] .exec_clock : 0.000000 2018-04-08 13:25:24 [45006.703621] .MIN_vruntime : 0.000001 2018-04-08 13:25:24 [45006.709163] .min_vruntime : 8885649.050298 2018-04-08 13:25:24 [45006.715219] .max_vruntime : 0.000001 2018-04-08 13:25:24 [45006.720756] .spread : 0.000000 2018-04-08 13:25:24 [45006.726285] .spread0 : 1722072.818432 2018-04-08 13:25:24 [45006.732331] .nr_spread_over : 0 2018-04-08 13:25:24 [45006.737248] .nr_running : 0 2018-04-08 13:25:24 [45006.742160] .load : 0 2018-04-08 13:25:24 [45006.747065] .runnable_load_avg : 0 2018-04-08 13:25:24 [45006.751960] .blocked_load_avg : 194 2018-04-08 13:25:24 [45006.757034] .tg_load_avg : 0 2018-04-08 13:25:24 [45006.761922] .tg_load_contrib : 0 2018-04-08 13:25:24 [45006.766809] .tg_runnable_contrib : 0 2018-04-08 13:25:24 [45006.771692] .tg->runnable_avg : 0 2018-04-08 13:25:24 [45006.776576] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:24 [45006.781456] .throttled : 0 2018-04-08 13:25:24 [45006.786327] .throttle_count : 0 2018-04-08 13:25:24 [45006.791200] .avg->runnable_avg_sum : 2097 2018-04-08 13:25:24 [45006.796332] .avg->runnable_avg_period : 47411 2018-04-08 13:25:24 [45006.801549] 2018-04-08 13:25:24 [45006.801549] rt_rq[13]:/ 2018-04-08 13:25:24 [45006.805962] .rt_nr_running : 0 2018-04-08 13:25:24 [45006.810819] .rt_throttled : 0 2018-04-08 13:25:24 [45006.815664] .rt_time : 0.000000 2018-04-08 13:25:24 [45006.821120] .rt_runtime : 950.000000 2018-04-08 13:25:24 [45006.826740] 2018-04-08 13:25:24 [45006.826740] runnable tasks: 2018-04-08 13:25:24 [45006.826740] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:24 [45006.826740] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:24 [45006.853284] systemd 1 8885649.050298 41160 120 0.000000 8959.795468 0.000000 1 / 2018-04-08 13:25:24 [45006.864671] kthreadd 2 8882536.287003 224546 120 0.000000 1924.430133 0.000000 1 / 2018-04-08 13:25:24 [45006.876058] migration/13 74 0.000000 447 0 0.000000 938.043388 0.000000 1 / 2018-04-08 13:25:24 [45006.887446] ksoftirqd/13 75 8885399.729086 13204 120 0.000000 84.358623 0.000000 1 / 2018-04-08 13:25:24 [45006.898846] kworker/13:0 76 8423.471560 24 120 0.000000 0.104458 0.000000 1 / 2018-04-08 13:25:24 [45006.910248] kworker/13:0H 77 5404.198639 8 100 0.000000 0.064481 0.000000 1 / 2018-04-08 13:25:24 [45006.921649] scsi_eh_11 380 131.968313 22 120 0.000000 0.314535 0.000000 1 / 2018-04-08 13:25:24 [45006.933054] kdmwork-253:9 4239 8885399.723341 51810 120 0.000000 928.589124 0.000000 1 / 2018-04-08 13:25:24 [45006.944472] kworker/13:1H 6111 8885399.725809 13120 100 0.000000 18.468538 0.000000 1 / 2018-04-08 13:25:24 [45006.955869] zvol 8230 8335.309427 2 100 0.000000 0.011671 0.000000 1 / 2018-04-08 13:25:24 [45006.967296] arc_reclaim 8667 8885637.054820 45073 120 0.000000 472.355377 0.000000 1 / 2018-04-08 13:25:24 [45006.978725] kworker/13:2 9145 8885637.053047 31262 120 0.000000 251.833308 0.000000 1 / 2018-04-08 13:25:24 [45006.990164] z_wr_iss 18798 19252.950644 122 101 0.000000 4.472954 0.000000 1 / 2018-04-08 13:25:24 [45007.001607] mmp 18939 8885637.056340 88941 120 0.000000 1305.125716 0.000000 1 / 2018-04-08 13:25:24 [45007.013040] z_rd_int_1 19333 219655.508973 623 100 0.000000 7.875875 0.000000 1 / 2018-04-08 13:25:24 [45007.024484] z_rd_int_7 19339 219655.508930 577 100 0.000000 7.428536 0.000000 1 / 2018-04-08 13:25:24 [45007.035938] z_wr_iss 19974 20402.264972 162 101 0.000000 5.687715 0.000000 1 / 2018-04-08 13:25:24 [45007.047399] z_wr_iss 20545 20762.342738 163 101 0.000000 7.653908 0.000000 1 / 2018-04-08 13:25:24 [45007.058854] z_wr_int_7 20565 20774.345567 773 100 0.000000 7.776420 0.000000 1 / 2018-04-08 13:25:24 [45007.070323] z_null_iss 21245 8885637.050567 88916 100 0.000000 4361.187599 0.000000 1 / 2018-04-08 13:25:24 [45007.081787] z_rd_int_1 21249 8743643.884264 898 100 0.000000 10.511912 0.000000 1 / 2018-04-08 13:25:24 [45007.093246] z_wr_iss 21260 20258.149772 58 101 0.000000 2.512108 0.000000 1 / 2018-04-08 13:25:24 [45007.104716] z_wr_int_1 21270 20258.147089 354 100 0.000000 3.272959 0.000000 1 / 2018-04-08 13:25:24 [45007.116184] dp_sync_taskq 21309 20261.251872 52 139 0.000000 0.629631 0.000000 1 / 2018-04-08 13:25:24 [45007.127658] mmp 21405 8885637.057483 88902 120 0.000000 1571.320526 0.000000 1 / 2018-04-08 13:25:24 [45007.139138] z_wr_iss 21862 8743787.918123 13893 101 0.000000 617.131565 0.000000 1 / 2018-04-08 13:25:24 [45007.150625] z_wr_int_6 21879 8743823.926281 45566 100 0.000000 545.239305 0.000000 1 / 2018-04-08 13:25:24 [45007.162108] dp_sync_taskq 21905 8743790.383607 7015 139 0.000000 131.062884 0.000000 1 / 2018-04-08 13:25:24 [45007.173595] txg_sync 22015 8884589.654358 35490 120 0.000000 1098.118376 0.000000 1 / 2018-04-08 13:25:24 [45007.185089] z_rd_int_2 22432 7512060.935601 1940 100 0.000000 21.375771 0.000000 1 / 2018-04-08 13:25:24 [45007.196594] z_rd_int_5 22435 7512060.935601 1805 100 0.000000 19.526267 0.000000 1 / 2018-04-08 13:25:24 [45007.208102] z_rd_int_6 22436 7512060.935591 1856 100 0.000000 21.440699 0.000000 1 / 2018-04-08 13:25:24 [45007.219604] kiblnd_sd_01_01 23079 8885641.671446 8994813 120 0.000000 43676.904447 0.000000 1 / 2018-04-08 13:25:24 [45007.231122] ptlrpcd_01_01 23095 8885399.311655 11547 120 0.000000 181.404418 0.000000 1 / 2018-04-08 13:25:24 [45007.242641] ptlrpcd_01_04 23098 8884589.625312 11375 120 0.000000 180.926683 0.000000 1 / 2018-04-08 13:25:24 [45007.254152] ptlrpcd_01_05 23099 8884589.661928 11612 120 0.000000 181.673570 0.000000 1 / 2018-04-08 13:25:24 [45007.265656] ldlm_cn01_000 23117 8882586.538485 52318 120 0.000000 427.833617 0.000000 1 / 2018-04-08 13:25:24 [45007.277172] mdt01_006 24571 8885637.052313 892982 120 0.000000 12579.613746 0.000000 1 / 2018-04-08 13:25:24 [45007.288696] osp_up1-0 26833 16384.728506 2 120 0.000000 0.010467 0.000000 1 / 2018-04-08 13:25:24 [45007.300223] mdt_rdpg01_005 32912 8643720.015335 1095040 120 0.000000 10570.626994 0.000000 1 / 2018-04-08 13:25:24 [45007.311757] mdt_rdpg01_012 32919 8694463.920491 690218 120 0.000000 6704.719690 0.000000 1 / 2018-04-08 13:25:24 [45007.323304] mdt_out01_002 35586 8885654.094702 587231958 120 0.000000 12070206.489137 0.000000 1 / 2018-04-08 13:25:24 [45007.334854] 2018-04-08 13:25:24 [45007.336763] cpu#14, 3200.000 MHz 2018-04-08 13:25:24 [45007.340403] .nr_running : 0 2018-04-08 13:25:24 [45007.345434] .load : 0 2018-04-08 13:25:24 [45007.350462] .nr_switches : 741429604 2018-04-08 13:25:24 [45007.356170] .nr_load_updates : 17848263 2018-04-08 13:25:24 [45007.361774] .nr_uninterruptible : -103 2018-04-08 13:25:24 [45007.367029] .next_balance : 4339.783705 2018-04-08 13:25:24 [45007.372889] .curr->pid : 0 2018-04-08 13:25:24 [45007.377881] .clock : 45007377.796595 2018-04-08 13:25:24 [45007.384081] .cpu_load[0] : 0 2018-04-08 13:25:24 [45007.389063] .cpu_load[1] : 0 2018-04-08 13:25:24 [45007.394034] .cpu_load[2] : 0 2018-04-08 13:25:24 [45007.399000] .cpu_load[3] : 0 2018-04-08 13:25:24 [45007.403966] .cpu_load[4] : 0 2018-04-08 13:25:24 [45007.408921] .avg_idle : 1000000 2018-04-08 13:25:24 [45007.414390] .max_idle_balance_cost : 500000 2018-04-08 13:25:24 [45007.419771] 2018-04-08 13:25:24 [45007.419771] cfs_rq[14]:/ 2018-04-08 13:25:24 [45007.424425] .exec_clock : 0.000000 2018-04-08 13:25:24 [45007.429963] .MIN_vruntime : 0.000001 2018-04-08 13:25:24 [45007.435497] .min_vruntime : 6384368.656757 2018-04-08 13:25:24 [45007.441545] .max_vruntime : 0.000001 2018-04-08 13:25:24 [45007.447078] .spread : 0.000000 2018-04-08 13:25:24 [45007.452609] .spread0 : -779345.989372 2018-04-08 13:25:24 [45007.458650] .nr_spread_over : 0 2018-04-08 13:25:24 [45007.463561] .nr_running : 0 2018-04-08 13:25:24 [45007.468471] .load : 0 2018-04-08 13:25:24 [45007.473377] .runnable_load_avg : 0 2018-04-08 13:25:24 [45007.478285] .blocked_load_avg : 5 2018-04-08 13:25:24 [45007.483179] .tg_load_avg : 0 2018-04-08 13:25:24 [45007.488067] .tg_load_contrib : 0 2018-04-08 13:25:24 [45007.492958] .tg_runnable_contrib : 0 2018-04-08 13:25:24 [45007.497836] .tg->runnable_avg : 0 2018-04-08 13:25:24 [45007.502718] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:24 [45007.507591] .throttled : 0 2018-04-08 13:25:24 [45007.512467] .throttle_count : 0 2018-04-08 13:25:24 [45007.517341] .avg->runnable_avg_sum : 72 2018-04-08 13:25:24 [45007.522300] .avg->runnable_avg_period : 47391 2018-04-08 13:25:24 [45007.527509] 2018-04-08 13:25:24 [45007.527509] rt_rq[14]:/ 2018-04-08 13:25:24 [45007.531931] .rt_nr_running : 0 2018-04-08 13:25:24 [45007.536787] .rt_throttled : 0 2018-04-08 13:25:24 [45007.541641] .rt_time : 0.000000 2018-04-08 13:25:24 [45007.547092] .rt_runtime : 950.000000 2018-04-08 13:25:24 [45007.552714] 2018-04-08 13:25:24 [45007.552714] runnable tasks: 2018-04-08 13:25:24 [45007.552714] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:24 [45007.552714] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:24 [45007.579256] migration/14 79 0.000000 307 0 0.000000 2712.461955 0.000000 0 / 2018-04-08 13:25:24 [45007.590636] ksoftirqd/14 80 6384351.684837 77864 120 0.000000 270.648576 0.000000 0 / 2018-04-08 13:25:24 [45007.602029] kworker/14:0H 82 4433.979137 11 100 0.000000 0.025868 0.000000 0 / 2018-04-08 13:25:24 [45007.613412] scsi_tmf_1 346 110.001237 2 100 0.000000 0.005254 0.000000 0 / 2018-04-08 13:25:24 [45007.624808] fw_event_mpt3sa 347 122.005171 2 100 0.000000 0.004272 0.000000 0 / 2018-04-08 13:25:24 [45007.636197] scsi_eh_15 388 8999.893590 125 120 0.000000 2.772158 0.000000 0 / 2018-04-08 13:25:24 [45007.647600] kmpathd 1449 735.917999 2 100 0.000000 0.003516 0.000000 0 / 2018-04-08 13:25:24 [45007.658998] multipathd 4271 0.000000 9 0 0.000000 2.837495 0.000000 0 / 2018-04-08 13:25:24 [45007.670406] kdmwork-253:6 4209 6384351.662275 98596 120 0.000000 1256.885766 0.000000 0 / 2018-04-08 13:25:25 [45007.681822] bioset 8850 3606.259141 2 100 0.000000 0.004914 0.000000 0 / 2018-04-08 13:25:25 [45007.693234] xfsalloc 8851 3618.263877 2 100 0.000000 0.005109 0.000000 0 / 2018-04-08 13:25:25 [45007.704648] xfs_mru_cache 8852 3630.267818 2 100 0.000000 0.004281 0.000000 0 / 2018-04-08 13:25:25 [45007.716082] xfs-buf/dm-13 8853 3642.272097 2 100 0.000000 0.004810 0.000000 0 / 2018-04-08 13:25:25 [45007.727517] xfs-data/dm-13 8854 3654.275960 2 100 0.000000 0.004206 0.000000 0 / 2018-04-08 13:25:25 [45007.738955] xfs-conv/dm-13 8855 3666.279856 2 100 0.000000 0.004217 0.000000 0 / 2018-04-08 13:25:25 [45007.750382] xfs-cil/dm-13 8856 3678.283728 2 100 0.000000 0.004212 0.000000 0 / 2018-04-08 13:25:25 [45007.761801] xfs-reclaim/dm- 8857 3690.287900 2 100 0.000000 0.004509 0.000000 0 / 2018-04-08 13:25:25 [45007.773225] xfs-log/dm-13 8858 3702.291694 2 100 0.000000 0.004152 0.000000 0 / 2018-04-08 13:25:25 [45007.784664] xfs-eofblocks/d 8859 3714.295870 2 100 0.000000 0.004539 0.000000 0 / 2018-04-08 13:25:25 [45007.796104] xfsaild/dm-13 8860 3726.300282 2 120 0.000000 0.004418 0.000000 0 / 2018-04-08 13:25:25 [45007.807538] rpciod 8899 3846.822882 2 100 0.000000 0.005140 0.000000 0 / 2018-04-08 13:25:25 [45007.818977] xprtiod 8900 3858.826785 2 100 0.000000 0.004208 0.000000 0 / 2018-04-08 13:25:25 [45007.830420] in:imjournal 8906 6384359.311313 57672 120 0.000000 1172.322992 0.000000 0 / 2018-04-08 13:25:25 [45007.841869] rdma-ndd 8950 7230.456609 4 120 0.000000 3.213509 0.000000 0 / 2018-04-08 13:25:25 [45007.853311] kworker/14:1H 9659 6384351.682311 95674 100 0.000000 169.020774 0.000000 0 / 2018-04-08 13:25:25 [45007.864758] gdbus 15451 8570.058932 126 120 0.000000 4.339945 0.000000 0 / 2018-04-08 13:25:25 [45007.876218] z_wr_iss 18800 10408.858052 122 101 0.000000 3.552117 0.000000 0 / 2018-04-08 13:25:25 [45007.887678] z_ioctl_int 18831 10420.861959 69 100 0.000000 0.260626 0.000000 0 / 2018-04-08 13:25:25 [45007.899145] metaslab_group_ 18834 10420.861962 57 100 0.000000 0.196461 0.000000 0 / 2018-04-08 13:25:25 [45007.910619] z_wr_iss 19343 178612.108428 193 101 0.000000 8.721872 0.000000 0 / 2018-04-08 13:25:25 [45007.922096] z_wr_int_7 19360 178624.109910 1003 100 0.000000 9.963288 0.000000 0 / 2018-04-08 13:25:25 [45007.933573] dp_sync_taskq 19381 178616.048962 153 139 0.000000 2.460316 0.000000 0 / 2018-04-08 13:25:25 [45007.945059] dp_sync_taskq 19392 178613.908307 150 139 0.000000 2.861832 0.000000 0 / 2018-04-08 13:25:25 [45007.956532] z_rd_int_1 19957 15089.550464 679 100 0.000000 7.610951 0.000000 0 / 2018-04-08 13:25:25 [45007.968014] z_rd_int_6 19962 15089.548871 716 100 0.000000 8.060381 0.000000 0 / 2018-04-08 13:25:25 [45007.979498] z_wr_iss 19971 11671.303007 157 101 0.000000 6.089065 0.000000 0 / 2018-04-08 13:25:25 [45007.990983] z_wr_iss 19972 11671.304627 169 101 0.000000 5.371105 0.000000 0 / 2018-04-08 13:25:25 [45008.002473] z_wr_int_3 19980 11683.307063 628 100 0.000000 6.501511 0.000000 0 / 2018-04-08 13:25:25 [45008.013973] dp_sync_taskq 20013 11671.476323 107 139 0.000000 1.129494 0.000000 0 / 2018-04-08 13:25:25 [45008.025467] mmp 20188 6384356.663910 88922 120 0.000000 1676.769407 0.000000 0 / 2018-04-08 13:25:25 [45008.036954] z_wr_int_6 20564 13380.444464 708 100 0.000000 7.557971 0.000000 0 / 2018-04-08 13:25:25 [45008.048466] z_ioctl_int 20579 13380.444282 49 100 0.000000 0.219434 0.000000 0 / 2018-04-08 13:25:25 [45008.059967] dp_sync_taskq 20591 13389.093607 127 139 0.000000 2.289302 0.000000 0 / 2018-04-08 13:25:25 [45008.071475] dp_sync_taskq 21305 11378.091130 57 139 0.000000 0.635103 0.000000 0 / 2018-04-08 13:25:25 [45008.082999] z_wr_iss 21867 6292221.521047 13753 101 0.000000 621.875226 0.000000 0 / 2018-04-08 13:25:25 [45008.094527] z_wr_int_3 21876 6292221.520427 45909 100 0.000000 551.809412 0.000000 0 / 2018-04-08 13:25:25 [45008.106049] z_wr_int_5 21878 6292221.521944 45763 100 0.000000 546.339236 0.000000 0 / 2018-04-08 13:25:25 [45008.117552] dp_sync_taskq 21902 6292227.652864 6868 139 0.000000 131.951688 0.000000 0 / 2018-04-08 13:25:25 [45008.129042] z_wr_iss 22444 6246755.066885 673 101 0.000000 22.351767 0.000000 0 / 2018-04-08 13:25:25 [45008.140533] z_wr_iss 22446 6246755.065733 676 101 0.000000 22.223180 0.000000 0 / 2018-04-08 13:25:25 [45008.152027] dp_sync_taskq 22487 6246756.495136 769 139 0.000000 5.129068 0.000000 0 / 2018-04-08 13:25:25 [45008.163508] dp_sync_taskq 22489 6246759.087882 786 139 0.000000 5.648887 0.000000 0 / 2018-04-08 13:25:25 [45008.174999] ptlrpcd_00_07 23093 6384356.657582 75523 120 0.000000 1439.643773 0.000000 0 / 2018-04-08 13:25:25 [45008.186481] ldlm_cn00_001 23115 6243417.164288 9574 120 0.000000 102.517643 0.000000 0 / 2018-04-08 13:25:25 [45008.197968] ll_mgs_0001 23133 6382365.105524 151278 120 0.000000 3952.006043 0.000000 0 / 2018-04-08 13:25:25 [45008.209460] ll_mgs_0002 23134 6382365.087971 189990 120 0.000000 4939.853740 0.000000 0 / 2018-04-08 13:25:25 [45008.220950] osp-pre-0-0 24679 6384356.659967 8816 120 0.000000 160.745316 0.000000 0 / 2018-04-08 13:25:25 [45008.232446] osp-syn-1-0 25318 5632270.202727 15375 120 0.000000 373.314028 0.000000 0 / 2018-04-08 13:25:25 [45008.243944] mdt00_006 26015 6384532.708866 92318 120 0.000000 2061.547405 0.000000 0 / 2018-04-08 13:25:25 [45008.255448] ldlm_cn00_006 26131 6229667.463218 21107 120 0.000000 371.692074 0.000000 0 / 2018-04-08 13:25:25 [45008.266940] osp-pre-8-0 26779 6384356.659183 8807 120 0.000000 165.373534 0.000000 0 / 2018-04-08 13:25:25 [45008.278433] osp-pre-11-0 26801 6384356.663155 8807 120 0.000000 168.596980 0.000000 0 / 2018-04-08 13:25:25 [45008.289936] osp-pre-15-0 26826 6384356.660518 8807 120 0.000000 170.429848 0.000000 0 / 2018-04-08 13:25:25 [45008.301444] osp-syn-14-1 28788 10305.750488 4 120 0.000000 0.108986 0.000000 0 / 2018-04-08 13:25:25 [45008.312952] mdt_rdpg00_003 31988 6229667.428875 5072 120 0.000000 64.197691 0.000000 0 / 2018-04-08 13:25:25 [45008.324461] mdt_rdpg00_013 34722 6229667.428906 8049 120 0.000000 76.919003 0.000000 0 / 2018-04-08 13:25:25 [45008.335965] mdt_out00_002 35047 6384809.267067 156096985 120 0.000000 2891837.767451 0.000000 0 / 2018-04-08 13:25:25 [45008.347478] kworker/14:1 60930 6384356.670145 47651 120 0.000000 352.944789 0.000000 0 / 2018-04-08 13:25:25 [45008.358995] z_wr_int_5 282325 6246755.065432 4 100 0.000000 0.014996 0.000000 0 / 2018-04-08 13:25:25 [45008.370598] kworker/14:0 282636 6354487.119228 4 120 0.000000 0.053843 0.000000 0 / 2018-04-08 13:25:25 [45008.382190] kworker/14:2 283584 6384342.608416 4 120 0.000000 0.046033 0.000000 0 / 2018-04-08 13:25:25 [45008.393800] 2018-04-08 13:25:25 [45008.395676] cpu#15, 3200.000 MHz 2018-04-08 13:25:25 [45008.399282] .nr_running : 0 2018-04-08 13:25:25 [45008.404267] .load : 0 2018-04-08 13:25:25 [45008.409244] .nr_switches : 1070496466 2018-04-08 13:25:25 [45008.415002] .nr_load_updates : 23979254 2018-04-08 13:25:25 [45008.420584] .nr_uninterruptible : -61 2018-04-08 13:25:25 [45008.425733] .next_balance : 4339.784771 2018-04-08 13:25:25 [45008.431569] .curr->pid : 0 2018-04-08 13:25:25 [45008.436536] .clock : 45008436.482169 2018-04-08 13:25:25 [45008.442720] .cpu_load[0] : 0 2018-04-08 13:25:25 [45008.447689] .cpu_load[1] : 0 2018-04-08 13:25:25 [45008.452654] .cpu_load[2] : 0 2018-04-08 13:25:25 [45008.457614] .cpu_load[3] : 128 2018-04-08 13:25:25 [45008.462743] .cpu_load[4] : 47 2018-04-08 13:25:25 [45008.467777] .avg_idle : 78207 2018-04-08 13:25:25 [45008.473066] .max_idle_balance_cost : 500000 2018-04-08 13:25:25 [45008.478441] 2018-04-08 13:25:25 [45008.478441] cfs_rq[15]:/ 2018-04-08 13:25:25 [45008.483093] .exec_clock : 0.000000 2018-04-08 13:25:25 [45008.488631] .MIN_vruntime : 0.000001 2018-04-08 13:25:25 [45008.494158] .min_vruntime : 9536655.094287 2018-04-08 13:25:25 [45008.500209] .max_vruntime : 0.000001 2018-04-08 13:25:25 [45008.505742] .spread : 0.000000 2018-04-08 13:25:25 [45008.511260] .spread0 : 2372815.951779 2018-04-08 13:25:25 [45008.517301] .nr_spread_over : 0 2018-04-08 13:25:25 [45008.522212] .nr_running : 0 2018-04-08 13:25:25 [45008.527117] .load : 0 2018-04-08 13:25:25 [45008.532026] .runnable_load_avg : 0 2018-04-08 13:25:25 [45008.536931] .blocked_load_avg : 47 2018-04-08 13:25:25 [45008.541915] .tg_load_avg : 0 2018-04-08 13:25:25 [45008.546806] .tg_load_contrib : 0 2018-04-08 13:25:25 [45008.551694] .tg_runnable_contrib : 0 2018-04-08 13:25:25 [45008.556583] .tg->runnable_avg : 0 2018-04-08 13:25:25 [45008.561466] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:25 [45008.566345] .throttled : 0 2018-04-08 13:25:25 [45008.571220] .throttle_count : 0 2018-04-08 13:25:25 [45008.576091] .avg->runnable_avg_sum : 918 2018-04-08 13:25:25 [45008.581130] .avg->runnable_avg_period : 46239 2018-04-08 13:25:25 [45008.586343] 2018-04-08 13:25:25 [45008.586343] rt_rq[15]:/ 2018-04-08 13:25:25 [45008.590764] .rt_nr_running : 0 2018-04-08 13:25:25 [45008.595626] .rt_throttled : 0 2018-04-08 13:25:25 [45008.600479] .rt_time : 0.000000 2018-04-08 13:25:25 [45008.605929] .rt_runtime : 950.000000 2018-04-08 13:25:25 [45008.611548] 2018-04-08 13:25:25 [45008.611548] runnable tasks: 2018-04-08 13:25:25 [45008.611548] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:25 [45008.611548] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:25 [45008.638104] migration/15 84 0.000000 416 0 0.000000 987.232445 0.000000 1 / 2018-04-08 13:25:25 [45008.649487] ksoftirqd/15 85 9536535.612497 12654 120 0.000000 51.973678 0.000000 1 / 2018-04-08 13:25:25 [45008.660886] kworker/15:0 86 9536643.104395 32138 120 0.000000 262.135291 0.000000 1 / 2018-04-08 13:25:25 [45008.672277] kworker/15:0H 87 5066.141942 8 100 0.000000 0.022942 0.000000 1 / 2018-04-08 13:25:26 [45008.683666] kworker/15:1 124 11517.182274 196 120 0.000000 8.951912 0.000000 1 / 2018-04-08 13:25:26 [45008.695073] scsi_eh_14 386 186.899786 22 120 0.000000 0.220625 0.000000 1 / 2018-04-08 13:25:26 [45008.706463] spl_kmem_cache 3644 9395205.752987 414 100 0.000000 27.521093 0.000000 1 / 2018-04-08 13:25:26 [45008.717881] kworker/15:1H 6112 9536535.609559 12854 100 0.000000 18.884455 0.000000 1 / 2018-04-08 13:25:26 [45008.729304] bioset 7787 7193.827392 2 100 0.000000 0.005684 0.000000 1 / 2018-04-08 13:25:26 [45008.740715] bioset 7799 7238.089781 2 100 0.000000 0.006461 0.000000 1 / 2018-04-08 13:25:26 [45008.752143] arc_reclaim 8667 9536631.069197 45074 120 0.000000 472.360535 0.000000 1 / 2018-04-08 13:25:26 [45008.763571] ruby-timer-thr 283753 9529720.104622 3 120 0.000000 0.039130 0.000000 1 / 2018-04-08 13:25:26 [45008.775097] z_wr_iss 19968 19358.343532 172 101 0.000000 5.809768 0.000000 1 / 2018-04-08 13:25:26 [45008.786541] z_wr_iss 20549 19911.201349 171 101 0.000000 7.608119 0.000000 1 / 2018-04-08 13:25:26 [45008.797994] z_wr_iss 20556 19911.197866 179 101 0.000000 7.000143 0.000000 1 / 2018-04-08 13:25:26 [45008.809441] dp_sync_taskq 20590 19913.103533 134 139 0.000000 1.835620 0.000000 1 / 2018-04-08 13:25:26 [45008.820898] dp_sync_taskq 20592 19912.429198 127 139 0.000000 2.199921 0.000000 1 / 2018-04-08 13:25:26 [45008.832357] z_wr_iss 21262 19166.199622 63 101 0.000000 2.890502 0.000000 1 / 2018-04-08 13:25:26 [45008.843824] z_wr_int_4 21273 19166.197002 327 100 0.000000 2.915991 0.000000 1 / 2018-04-08 13:25:26 [45008.855270] z_wr_int_6 21275 19166.196829 288 100 0.000000 3.092745 0.000000 1 / 2018-04-08 13:25:26 [45008.866735] dp_sync_taskq 21302 19174.003907 56 139 0.000000 0.442737 0.000000 1 / 2018-04-08 13:25:26 [45008.878189] z_wr_iss 21861 9397302.224610 13947 101 0.000000 615.262441 0.000000 1 / 2018-04-08 13:25:26 [45008.889660] z_null_iss 22427 9536643.094580 88988 100 0.000000 3799.270838 0.000000 1 / 2018-04-08 13:25:26 [45008.901126] z_wr_int_4 22455 9330400.897149 3364 100 0.000000 31.184553 0.000000 1 / 2018-04-08 13:25:26 [45008.912602] kiblnd_sd_01_00 23078 9536643.134072 8999096 120 0.000000 43702.770129 0.000000 1 / 2018-04-08 13:25:26 [45008.924084] ldlm_cn01_008 26132 9533345.306185 45934 120 0.000000 439.041873 0.000000 1 / 2018-04-08 13:25:26 [45008.935577] osp-syn-2-0 26749 19178.337067 7 120 0.000000 0.244648 0.000000 1 / 2018-04-08 13:25:26 [45008.947080] osp-pre-3-0 26750 9536535.594908 8806 120 0.000000 157.357829 0.000000 1 / 2018-04-08 13:25:26 [45008.958579] osp-syn-4-0 26758 15704.144915 4 120 0.000000 0.115481 0.000000 1 / 2018-04-08 13:25:26 [45008.970083] osp-syn-6-0 26768 15704.144085 4 120 0.000000 0.096961 0.000000 1 / 2018-04-08 13:25:26 [45008.981583] osp-syn-7-0 26775 15644.032167 4 120 0.000000 0.098482 0.000000 1 / 2018-04-08 13:25:26 [45008.993073] osp-syn-11-0 26802 15644.035777 4 120 0.000000 0.095228 0.000000 1 / 2018-04-08 13:25:26 [45009.004583] osp-syn-12-0 26807 15704.141339 4 120 0.000000 0.098727 0.000000 1 / 2018-04-08 13:25:26 [45009.016087] osp-syn-13-0 26816 15644.056224 4 120 0.000000 0.124228 0.000000 1 / 2018-04-08 13:25:26 [45009.027587] osp-syn-15-0 26828 15644.031462 4 120 0.000000 0.091112 0.000000 1 / 2018-04-08 13:25:26 [45009.039086] mdt01_008 28410 9536540.331546 707158 120 0.000000 9878.646865 0.000000 1 / 2018-04-08 13:25:26 [45009.050589] z_wr_int_1 31031 18219.871625 2 100 0.000000 0.005570 0.000000 1 / 2018-04-08 13:25:26 [45009.062095] Rlod0002_rec0000 31314 9536663.013623 1110205763 120 0.000000 13990007.362330 0.000000 1 / 2018-04-08 13:25:26 [45009.073704] mdt01_013 32611 9533813.170589 840040 120 0.000000 11971.349839 0.000000 1 / 2018-04-08 13:25:26 [45009.085231] mdt_rdpg01_004 32911 9298050.329042 432653 120 0.000000 3981.829195 0.000000 1 / 2018-04-08 13:25:26 [45009.096750] mdt_rdpg01_011 32918 9302006.538061 3769 120 0.000000 36.516141 0.000000 1 / 2018-04-08 13:25:26 [45009.108296] mdt_rdpg01_014 32921 9372935.063702 21866 120 0.000000 213.983064 0.000000 1 / 2018-04-08 13:25:26 [45009.119841] z_wr_int_4 34467 19178.196632 3 100 0.000000 0.009102 0.000000 1 / 2018-04-08 13:25:26 [45009.131379] z_wr_int_7 35159 19370.341156 3 100 0.000000 0.014407 0.000000 1 / 2018-04-08 13:25:26 [45009.142913] z_wr_int_2 35444 19959.203602 2 100 0.000000 0.004912 0.000000 1 / 2018-04-08 13:25:26 [45009.154465] z_wr_int_2 35446 19983.208503 2 100 0.000000 0.005018 0.000000 1 / 2018-04-08 13:25:26 [45009.166006] z_wr_int_2 35449 20019.215611 2 100 0.000000 0.004878 0.000000 1 / 2018-04-08 13:25:26 [45009.177528] z_wr_int_2 35450 20031.218059 2 100 0.000000 0.004712 0.000000 1 / 2018-04-08 13:25:26 [45009.189040] z_wr_int_0 35457 20103.233189 2 100 0.000000 0.008200 0.000000 1 / 2018-04-08 13:25:26 [45009.200549] z_wr_int_0 35459 20115.235699 2 100 0.000000 0.005694 0.000000 1 / 2018-04-08 13:25:26 [45009.212043] z_wr_int_0 35460 20127.238277 2 100 0.000000 0.005130 0.000000 1 / 2018-04-08 13:25:26 [45009.223529] z_wr_int_0 35461 20139.240713 2 100 0.000000 0.004921 0.000000 1 / 2018-04-08 13:25:26 [45009.235034] z_wr_int_0 35463 20151.243359 2 100 0.000000 0.005449 0.000000 1 / 2018-04-08 13:25:26 [45009.246527] z_wr_int_0 35464 20163.245801 2 100 0.000000 0.004763 0.000000 1 / 2018-04-08 13:25:26 [45009.258022] z_wr_int_7 35466 20187.250796 2 100 0.000000 0.005010 0.000000 1 / 2018-04-08 13:25:26 [45009.269499] mdt_out01_003 43540 9514011.040281 461762921 120 0.000000 9128825.804384 0.000000 1 / 2018-04-08 13:25:26 [45009.281002] 2018-04-08 13:25:26 [45009.283174] INFO: rcu_sched detected stalls on CPUs/tasks: { 6} (detected by 2, t=104490 jiffies, g=990559, c=990558, q=46015) 2018-04-08 13:25:43 [45025.790726] S4969] task PC stack pid father 2018-04-08 13:25:43 [45025.801427] tgt_recover_1 D ffff88bd82cfeeb0 0 29650 2 0x00000000 2018-04-08 13:25:43 [45025.808906] Call Trace: 2018-04-08 13:25:43 [45025.811745] [] schedule+0x29/0x70 2018-04-08 13:25:43 [45025.817089] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:25:43 [45025.823300] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:25:43 [45025.829731] [] ? handle_recovery_req+0x270/0x270 [ptlrpc] 2018-04-08 13:25:43 [45025.837192] [] target_recovery_overseer+0xd8/0x650 [ptlrpc] 2018-04-08 13:25:43 [45025.844818] [] ? ldlm_dump_ns_write+0x90/0x90 [ptlrpc] 2018-04-08 13:25:43 [45025.851984] [] ? default_wake_function+0x12/0x20 2018-04-08 13:25:43 [45025.858630] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:25:43 [45025.864843] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:25:43 [45025.871075] [] target_recovery_thread+0x5d0/0x1360 [ptlrpc] 2018-04-08 13:25:43 [45025.878675] [] ? replay_request_or_update.isra.21+0x8c0/0x8c0 [ptlrpc] 2018-04-08 13:25:43 [45025.887218] [] kthread+0xcf/0xe0 2018-04-08 13:25:43 [45025.892481] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:43 [45025.898951] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:43 [45025.904734] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:43 [45025.911226] tgt_recover_2 D ffff88012cc39fa0 0 31538 2 0x00000000 2018-04-08 13:25:43 [45025.918709] Call Trace: 2018-04-08 13:25:43 [45025.921560] [] schedule+0x29/0x70 2018-04-08 13:25:43 [45025.926927] [] schedule_timeout+0x174/0x2c0 2018-04-08 13:25:43 [45025.933161] [] ? internal_add_timer+0x70/0x70 2018-04-08 13:25:43 [45025.939585] [] ? handle_recovery_req+0x270/0x270 [ptlrpc] 2018-04-08 13:25:43 [45025.947043] [] target_recovery_overseer+0xd8/0x650 [ptlrpc] 2018-04-08 13:25:43 [45025.954664] [] ? ldlm_dump_ns_write+0x90/0x90 [ptlrpc] 2018-04-08 13:25:43 [45025.961837] [] ? default_wake_function+0x12/0x20 2018-04-08 13:25:43 [45025.968486] [] ? __wake_up_common+0x58/0x90 2018-04-08 13:25:43 [45025.974701] [] ? wake_up_atomic_t+0x30/0x30 2018-04-08 13:25:43 [45025.980928] [] target_recovery_thread+0x5d0/0x1360 [ptlrpc] 2018-04-08 13:25:43 [45025.988550] [] ? replay_request_or_update.isra.21+0x8c0/0x8c0 [ptlrpc] 2018-04-08 13:25:43 [45025.997111] [] kthread+0xcf/0xe0 2018-04-08 13:25:43 [45026.002385] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:43 [45026.008874] [] ret_from_fork+0x58/0x90 2018-04-08 13:25:43 [45026.014678] [] ? insert_kthread_work+0x40/0x40 2018-04-08 13:25:43 [45026.021191] Sched Debug Version: v0.11, 3.10.0-693.17.1.el7.x86_64 #1 2018-04-08 13:25:43 [45026.028044] ktime : 45135110.798005 2018-04-08 13:25:43 [45026.034899] sched_clk : 45026021.190495 2018-04-08 13:25:43 [45026.041755] cpu_clk : 45026021.190525 2018-04-08 13:25:43 [45026.048610] jiffies : 4339802435 2018-04-08 13:25:43 [45026.055034] sched_clock_stable() : 1 2018-04-08 13:25:43 [45026.060683] 2018-04-08 13:25:43 [45026.062604] sysctl_sched 2018-04-08 13:25:43 [45026.065563] .sysctl_sched_latency : 24.000000 2018-04-08 13:25:43 [45026.072149] .sysctl_sched_min_granularity : 10.000000 2018-04-08 13:25:43 [45026.078725] .sysctl_sched_wakeup_granularity : 15.000000 2018-04-08 13:25:43 [45026.085280] .sysctl_sched_child_runs_first : 0 2018-04-08 13:25:43 [45026.091137] .sysctl_sched_features : 110203 2018-04-08 13:25:43 [45026.097431] .sysctl_sched_tunable_scaling : 1 (logaritmic) 2018-04-08 13:25:43 [45026.104411] 2018-04-08 13:25:43 [45026.106276] cpu#0, 3200.000 MHz 2018-04-08 13:25:43 [45026.109786] .nr_running : 0 2018-04-08 13:25:43 [45026.114767] .load : 0 2018-04-08 13:25:43 [45026.119744] .nr_switches : 818854772 2018-04-08 13:25:43 [45026.125412] .nr_load_updates : 18636400 2018-04-08 13:25:43 [45026.130986] .nr_uninterruptible : 5 2018-04-08 13:25:43 [45026.135951] .next_balance : 4339.802532 2018-04-08 13:25:43 [45026.141778] .curr->pid : 0 2018-04-08 13:25:43 [45026.146734] .clock : 45026145.127920 2018-04-08 13:25:43 [45026.152910] .cpu_load[0] : 0 2018-04-08 13:25:43 [45026.157866] .cpu_load[1] : 0 2018-04-08 13:25:43 [45026.162812] .cpu_load[2] : 0 2018-04-08 13:25:43 [45026.167748] .cpu_load[3] : 0 2018-04-08 13:25:43 [45026.172678] .cpu_load[4] : 2 2018-04-08 13:25:43 [45026.177601] .avg_idle : 1000000 2018-04-08 13:25:43 [45026.183045] .max_idle_balance_cost : 500000 2018-04-08 13:25:43 [45026.188403] 2018-04-08 13:25:43 [45026.188403] cfs_rq[0]:/ 2018-04-08 13:25:43 [45026.192913] .exec_clock : 0.000000 2018-04-08 13:25:43 [45026.198427] .MIN_vruntime : 0.000001 2018-04-08 13:25:43 [45026.203938] .min_vruntime : 7166030.861996 2018-04-08 13:25:43 [45026.209960] .max_vruntime : 0.000001 2018-04-08 13:25:43 [45026.215462] .spread : 0.000000 2018-04-08 13:25:43 [45026.220955] .spread0 : 0.000000 2018-04-08 13:25:43 [45026.226437] .nr_spread_over : 0 2018-04-08 13:25:43 [45026.231311] .nr_running : 0 2018-04-08 13:25:43 [45026.236186] .load : 0 2018-04-08 13:25:43 [45026.241054] .runnable_load_avg : 0 2018-04-08 13:25:43 [45026.245916] .blocked_load_avg : 25 2018-04-08 13:25:43 [45026.250855] .tg_load_avg : 0 2018-04-08 13:25:43 [45026.255711] .tg_load_contrib : 0 2018-04-08 13:25:43 [45026.260557] .tg_runnable_contrib : 0 2018-04-08 13:25:43 [45026.265402] .tg->runnable_avg : 0 2018-04-08 13:25:43 [45026.270239] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:43 [45026.275075] .throttled : 0 2018-04-08 13:25:43 [45026.279908] .throttle_count : 0 2018-04-08 13:25:43 [45026.284741] .avg->runnable_avg_sum : 1051 2018-04-08 13:25:43 [45026.289835] .avg->runnable_avg_period : 46488 2018-04-08 13:25:43 [45026.295012] 2018-04-08 13:25:43 [45026.295012] rt_rq[0]:/ 2018-04-08 13:25:43 [45026.299282] .rt_nr_running : 0 2018-04-08 13:25:43 [45026.304110] .rt_throttled : 0 2018-04-08 13:25:43 [45026.308942] .rt_time : 0.000000 2018-04-08 13:25:43 [45026.314373] .rt_runtime : 900.000000 2018-04-08 13:25:43 [45026.319982] 2018-04-08 13:25:43 [45026.319982] runnable tasks: 2018-04-08 13:25:43 [45026.319982] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:43 [45026.319982] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:43 [45026.346506] ksoftirqd/0 3 7165349.743652 81325 120 0.000000 304.760581 0.000000 0 / 2018-04-08 13:25:43 [45026.357883] kworker/0:0H 5 3204.025455 8 100 0.000000 0.020204 0.000000 0 / 2018-04-08 13:25:43 [45026.369275] migration/0 8 0.000000 342 0 0.000000 1642.650528 0.000000 0 / 2018-04-08 13:25:43 [45026.380665] rcu_bh 9 324.144409 2 120 0.000000 0.000905 0.000000 0 / 2018-04-08 13:25:43 [45026.392068] kswapd0 106 2627.157854 4 120 0.000000 0.161369 0.000000 0 / 2018-04-08 13:25:43 [45026.403463] scsi_eh_6 356 3171.574809 22 120 0.000000 0.153568 0.000000 0 / 2018-04-08 13:25:43 [45026.414857] kworker/0:1H 520 7164441.362585 86219 100 0.000000 126.998567 0.000000 0 / 2018-04-08 13:25:43 [45026.426253] ib_cm 742 4676.421478 2 100 0.000000 0.006321 0.000000 0 / 2018-04-08 13:25:43 [45026.437659] ipoib_flush 745 4688.428719 2 100 0.000000 0.007784 0.000000 0 / 2018-04-08 13:25:43 [45026.449065] irq/148-mei_me 1068 0.000653 14 49 0.000000 0.542179 0.000000 0 / 2018-04-08 13:25:43 [45026.460483] multipathd 4257 0.000000 2 0 0.000000 1.004348 0.000000 0 / 2018-04-08 13:25:43 [45026.471901] multipathd 9264 0.000000 3 0 0.000000 0.457289 0.000000 0 / 2018-04-08 13:25:43 [45026.483317] multipathd 9320 0.000000 7 0 0.000000 0.731167 0.000000 0 / 2018-04-08 13:25:43 [45026.494740] multipathd 9395 0.000000 4 0 0.000000 0.504980 0.000000 0 / 2018-04-08 13:25:43 [45026.506163] kworker/0:3 8476 10673.996568 14 120 0.000000 0.043201 0.000000 0 / 2018-04-08 13:25:43 [45026.517592] kworker/0:23 8770 7165827.361024 34307 120 0.000000 247.712076 0.000000 0 / 2018-04-08 13:25:43 [45026.529024] rs:main Q:Reg 8907 7166020.337359 17788 120 0.000000 276.091187 0.000000 0 / 2018-04-08 13:25:43 [45026.540460] kdmflush 9375 7894.932334 2 100 0.000000 0.005659 0.000000 0 / 2018-04-08 13:25:43 [45026.551884] polkitd 15449 11016.087252 80 120 0.000000 14.524405 0.000000 0 / 2018-04-08 13:25:43 [45026.563319] z_rd_int_5 18794 13574.112357 278 100 0.000000 2.404634 0.000000 0 / 2018-04-08 13:25:43 [45026.574759] z_wr_iss 18803 13754.519439 121 101 0.000000 3.487449 0.000000 0 / 2018-04-08 13:25:43 [45026.586210] z_wr_int_5 18815 13754.521624 749 100 0.000000 5.818908 0.000000 0 / 2018-04-08 13:25:43 [45026.597662] z_rd_int_0 19332 24609.743555 606 100 0.000000 7.239807 0.000000 0 / 2018-04-08 13:25:43 [45026.609103] z_wr_iss 19345 237852.358195 198 101 0.000000 8.774228 0.000000 0 / 2018-04-08 13:25:43 [45026.620564] z_wr_int_2 19355 237852.359015 925 100 0.000000 9.026173 0.000000 0 / 2018-04-08 13:25:44 [45026.632020] z_wr_int_6 19359 237852.359748 996 100 0.000000 9.626361 0.000000 0 / 2018-04-08 13:25:44 [45026.643486] dp_sync_taskq 19387 237853.404317 146 139 0.000000 2.080130 0.000000 0 / 2018-04-08 13:25:44 [45026.654952] dp_sync_taskq 19388 237853.394281 151 139 0.000000 2.227225 0.000000 0 / 2018-04-08 13:25:44 [45026.666416] z_rd_int_0 19956 22114.020092 713 100 0.000000 7.714849 0.000000 0 / 2018-04-08 13:25:44 [45026.677895] z_rd_int_4 19960 22114.020415 692 100 0.000000 7.741297 0.000000 0 / 2018-04-08 13:25:44 [45026.689378] z_wr_int_0 19977 15058.865468 660 100 0.000000 6.588943 0.000000 0 / 2018-04-08 13:25:44 [45026.700852] z_wr_int_5 19982 15058.867047 641 100 0.000000 6.649645 0.000000 0 / 2018-04-08 13:25:44 [45026.712342] z_wr_iss 21259 14869.342719 72 101 0.000000 3.064179 0.000000 0 / 2018-04-08 13:25:44 [45026.723812] z_rd_int_6 21858 7034779.638502 3262 100 0.000000 34.457613 0.000000 0 / 2018-04-08 13:25:44 [45026.735297] z_wr_iss 22438 6985416.221057 666 101 0.000000 21.378483 0.000000 0 / 2018-04-08 13:25:44 [45026.746790] z_wr_iss 22440 6985416.221037 666 101 0.000000 23.045440 0.000000 0 / 2018-04-08 13:25:44 [45026.758271] z_wr_int_1 22452 6985428.224797 3361 100 0.000000 29.962615 0.000000 0 / 2018-04-08 13:25:44 [45026.769765] dp_sync_taskq 22481 6985417.644230 785 139 0.000000 5.461825 0.000000 0 / 2018-04-08 13:25:44 [45026.781257] ptlrpc_hr00_000 23048 612327.805706 4 120 0.000000 0.021672 0.000000 0 / 2018-04-08 13:25:44 [45026.792761] kiblnd_sd_00_01 23075 7166095.487741 845274 120 0.000000 9139.937527 0.000000 0 / 2018-04-08 13:25:44 [45026.804273] ptlrpcd_00_04 23090 7164677.339944 75082 120 0.000000 1467.946229 0.000000 0 / 2018-04-08 13:25:44 [45026.815777] ll_ping 23102 7163859.076840 1847 120 0.000000 183.854941 0.000000 0 / 2018-04-08 13:25:44 [45026.827287] ldlm_cb00_001 23111 13245.598308 12 120 0.000000 0.248830 0.000000 0 / 2018-04-08 13:25:44 [45026.838799] ldlm_bl_02 23121 7166024.676709 24035 120 0.000000 505.088526 0.000000 0 / 2018-04-08 13:25:44 [45026.850323] ldlm_cn00_003 23400 7161769.568506 21419 120 0.000000 296.554130 0.000000 0 / 2018-04-08 13:25:44 [45026.861844] osp-pre-0-0 24679 7164677.305601 8819 120 0.000000 160.767059 0.000000 0 / 2018-04-08 13:25:44 [45026.873362] osp-pre-6-0 26767 7164677.308429 8810 120 0.000000 170.822477 0.000000 0 / 2018-04-08 13:25:44 [45026.884878] osp-pre-12-1 28775 13550.050747 4 120 0.000000 0.029854 0.000000 0 / 2018-04-08 13:25:44 [45026.896383] osp-pre-6-2 30485 13923.169698 4 120 0.000000 0.035777 0.000000 0 / 2018-04-08 13:25:44 [45026.907881] z_wr_int_7 31035 13766.519478 3 100 0.000000 0.013392 0.000000 0 / 2018-04-08 13:25:44 [45026.919385] mdt00_009 32612 7166095.488655 92103 120 0.000000 2102.605710 0.000000 0 / 2018-04-08 13:25:44 [45026.930885] mdt_rdpg00_006 32922 6966604.822725 7214 120 0.000000 52.353509 0.000000 0 / 2018-04-08 13:25:44 [45026.942385] z_wr_int_4 34469 14965.363714 2 100 0.000000 0.005482 0.000000 0 / 2018-04-08 13:25:44 [45026.953886] z_wr_int_6 35158 15070.865255 2 100 0.000000 0.005353 0.000000 0 / 2018-04-08 13:25:44 [45026.965390] tx_commit_cb 281689 6967213.770954 5 120 0.000000 0.074970 0.000000 0 / 2018-04-08 13:25:44 [45026.976986] kworker/u896:0 282576 7166026.246904 12859 120 0.000000 524.923097 0.000000 0 / 2018-04-08 13:25:44 [45026.988605] 2018-04-08 13:25:44 [45026.990469] cpu#1, 3200.000 MHz 2018-04-08 13:25:44 [45026.993982] .nr_running : 0 2018-04-08 13:25:44 [45026.998965] .load : 0 2018-04-08 13:25:44 [45027.003944] .nr_switches : 329763514 2018-04-08 13:25:44 [45027.009619] .nr_load_updates : 10716409 2018-04-08 13:25:44 [45027.015212] .nr_uninterruptible : 137 2018-04-08 13:25:44 [45027.020360] .next_balance : 4339.803416 2018-04-08 13:25:44 [45027.026201] .curr->pid : 0 2018-04-08 13:25:44 [45027.031175] .clock : 45027030.937822 2018-04-08 13:25:44 [45027.037357] .cpu_load[0] : 0 2018-04-08 13:25:44 [45027.042322] .cpu_load[1] : 0 2018-04-08 13:25:44 [45027.047280] .cpu_load[2] : 0 2018-04-08 13:25:44 [45027.052235] .cpu_load[3] : 0 2018-04-08 13:25:44 [45027.057187] .cpu_load[4] : 60 2018-04-08 13:25:44 [45027.062219] .avg_idle : 1000000 2018-04-08 13:25:44 [45027.067683] .max_idle_balance_cost : 500000 2018-04-08 13:25:44 [45027.073061] 2018-04-08 13:25:44 [45027.073061] cfs_rq[1]:/ 2018-04-08 13:25:44 [45027.077630] .exec_clock : 0.000000 2018-04-08 13:25:44 [45027.083167] .MIN_vruntime : 0.000001 2018-04-08 13:25:44 [45027.088709] .min_vruntime : 1701879.963371 2018-04-08 13:25:44 [45027.094769] .max_vruntime : 0.000001 2018-04-08 13:25:44 [45027.100297] .spread : 0.000000 2018-04-08 13:25:44 [45027.105830] .spread0 : -5464227.503018 2018-04-08 13:25:44 [45027.111963] .nr_spread_over : 0 2018-04-08 13:25:44 [45027.116877] .nr_running : 0 2018-04-08 13:25:44 [45027.121797] .load : 0 2018-04-08 13:25:44 [45027.126712] .runnable_load_avg : 0 2018-04-08 13:25:44 [45027.131620] .blocked_load_avg : 46 2018-04-08 13:25:44 [45027.136611] .tg_load_avg : 0 2018-04-08 13:25:44 [45027.141507] .tg_load_contrib : 0 2018-04-08 13:25:44 [45027.146395] .tg_runnable_contrib : 0 2018-04-08 13:25:44 [45027.151287] .tg->runnable_avg : 0 2018-04-08 13:25:44 [45027.156176] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:44 [45027.161055] .throttled : 0 2018-04-08 13:25:44 [45027.165927] .throttle_count : 0 2018-04-08 13:25:44 [45027.170799] .avg->runnable_avg_sum : 20 2018-04-08 13:25:44 [45027.175755] .avg->runnable_avg_period : 47042 2018-04-08 13:25:44 [45027.180972] 2018-04-08 13:25:44 [45027.180972] rt_rq[1]:/ 2018-04-08 13:25:44 [45027.185304] .rt_nr_running : 0 2018-04-08 13:25:44 [45027.190159] .rt_throttled : 0 2018-04-08 13:25:44 [45027.195014] .rt_time : 0.000000 2018-04-08 13:25:44 [45027.200463] .rt_runtime : 1000.000000 2018-04-08 13:25:44 [45027.206178] 2018-04-08 13:25:44 [45027.206178] runnable tasks: 2018-04-08 13:25:44 [45027.206178] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:44 [45027.206178] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:44 [45027.232734] systemd 1 1701868.001689 41177 120 0.000000 9745.149117 0.000000 1 / 2018-04-08 13:25:44 [45027.244117] migration/1 13 0.000000 388 0 0.000000 938.046436 0.000000 1 / 2018-04-08 13:25:44 [45027.255508] ksoftirqd/1 14 1701867.966772 38402 120 0.000000 272.850254 0.000000 1 / 2018-04-08 13:25:44 [45027.266888] kworker/1:0H 16 1701867.963381 1130463 100 0.000000 6352.680013 0.000000 1 / 2018-04-08 13:25:44 [45027.278288] khungtaskd 92 1701640.189550 378 120 0.000000 55.186013 0.000000 1 / 2018-04-08 13:25:44 [45027.289692] kworker/1:1 100 1701867.967116 349750 120 0.000000 6011.766529 0.000000 1 / 2018-04-08 13:25:44 [45027.301096] multipathd 4273 0.000000 10 0 0.000000 1.574793 0.000000 1 / 2018-04-08 13:25:44 [45027.312509] kdmwork-253:10 4254 1701867.970661 46036 120 0.000000 1028.456792 0.000000 1 / 2018-04-08 13:25:44 [45027.323915] kdmflush 7784 9182.127593 2 100 0.000000 0.006692 0.000000 1 / 2018-04-08 13:25:44 [45027.335341] bioset 7815 9230.924690 2 100 0.000000 0.005706 0.000000 1 / 2018-04-08 13:25:44 [45027.346760] hfi1_cq0 14385 1701868.106712 19559072 100 0.000000 75392.446621 0.000000 1 / 2018-04-08 13:25:44 [45027.358194] qmgr 14453 1699883.609695 315 120 0.000000 21.425005 0.000000 1 / 2018-04-08 13:25:44 [45027.369631] sssd 14466 1701138.444235 1530 120 0.000000 44.080914 0.000000 1 / 2018-04-08 13:25:44 [45027.381065] sssd_be 14467 1701867.974134 9676 120 0.000000 595.061551 0.000000 1 / 2018-04-08 13:25:44 [45027.392507] kworker/1:1H 17405 1701836.668617 978759 100 0.000000 5420.911800 0.000000 1 / 2018-04-08 13:25:44 [45027.403956] kworker/1:0 18711 19270.123195 7 120 0.000000 0.036932 0.000000 1 / 2018-04-08 13:25:44 [45027.415420] z_rd_int_6 19338 1450696.090639 568 100 0.000000 6.628409 0.000000 1 / 2018-04-08 13:25:44 [45027.426879] z_wr_iss 19965 26987.442618 175 101 0.000000 22.136822 0.000000 1 / 2018-04-08 13:25:44 [45027.438338] z_ioctl_int 19998 26987.440780 37 100 0.000000 0.207898 0.000000 1 / 2018-04-08 13:25:44 [45027.449796] dp_sync_taskq 20586 27011.765175 123 139 0.000000 2.506950 0.000000 1 / 2018-04-08 13:25:44 [45027.461272] dp_sync_taskq 20594 27016.440853 149 139 0.000000 2.410381 0.000000 1 / 2018-04-08 13:25:44 [45027.472743] dp_sync_taskq 20595 27007.418641 124 139 0.000000 1.302327 0.000000 1 / 2018-04-08 13:25:44 [45027.484210] z_rd_int_4 21252 1450696.091083 786 100 0.000000 10.019010 0.000000 1 / 2018-04-08 13:25:44 [45027.495689] z_rd_int_7 21255 1675850.604793 793 100 0.000000 9.603099 0.000000 1 / 2018-04-08 13:25:44 [45027.507159] z_wr_iss 21263 26961.275518 61 101 0.000000 3.097916 0.000000 1 / 2018-04-08 13:25:44 [45027.518638] z_wr_int_0 21269 26961.271695 324 100 0.000000 3.121123 0.000000 1 / 2018-04-08 13:25:44 [45027.530104] z_wr_int_5 21274 26961.271519 332 100 0.000000 3.081909 0.000000 1 / 2018-04-08 13:25:44 [45027.541589] z_wr_iss 21860 1675888.525279 13970 101 0.000000 617.777139 0.000000 1 / 2018-04-08 13:25:44 [45027.553081] z_wr_iss 21868 1675888.524592 13934 101 0.000000 620.862750 0.000000 1 / 2018-04-08 13:25:44 [45027.564570] z_wr_int_2 21875 1675936.535787 45799 100 0.000000 548.489030 0.000000 1 / 2018-04-08 13:25:44 [45027.576059] z_wr_int_7 21880 1675936.535256 45618 100 0.000000 547.715490 0.000000 1 / 2018-04-08 13:25:44 [45027.587558] dp_sync_taskq 21909 1675889.737404 6954 139 0.000000 130.215392 0.000000 1 / 2018-04-08 13:25:44 [45027.599052] txg_sync 22015 1701868.000685 35500 120 0.000000 1098.358158 0.000000 1 / 2018-04-08 13:25:44 [45027.610556] z_rd_int_4 22434 1470815.749824 1911 100 0.000000 21.813711 0.000000 1 / 2018-04-08 13:25:45 [45027.622062] ptlrpc_hr01_001 23057 1531304.536142 12395 120 0.000000 60.766272 0.000000 1 / 2018-04-08 13:25:45 [45027.633571] ptlrpc_hr01_002 23058 1531306.210926 12395 120 0.000000 61.197521 0.000000 1 / 2018-04-08 13:25:45 [45027.645087] ptlrpc_hr01_003 23059 1531311.133315 12395 120 0.000000 61.065823 0.000000 1 / 2018-04-08 13:25:45 [45027.656604] ptlrpc_hr01_004 23060 1531311.143029 12395 120 0.000000 61.571555 0.000000 1 / 2018-04-08 13:25:45 [45027.668118] ptlrpc_hr01_005 23061 1531311.742394 12395 120 0.000000 60.520237 0.000000 1 / 2018-04-08 13:25:45 [45027.679627] ptlrpc_hr01_006 23062 1531311.739445 12395 120 0.000000 60.401027 0.000000 1 / 2018-04-08 13:25:45 [45027.691133] ptlrpc_hr01_007 23063 1531311.740413 12395 120 0.000000 61.405083 0.000000 1 / 2018-04-08 13:25:45 [45027.702643] ptlrpcd_01_00 23094 1701868.142906 11370 120 0.000000 180.674040 0.000000 1 / 2018-04-08 13:25:45 [45027.714156] sptlrpc_gc 23103 1664963.590877 26 120 0.000000 0.329311 0.000000 1 / 2018-04-08 13:25:45 [45027.725677] mdt_attr01_000 24018 21622.478870 3 120 0.000000 0.115927 0.000000 1 / 2018-04-08 13:25:45 [45027.737204] mdt_attr01_001 24019 21622.512525 3 120 0.000000 0.040030 0.000000 1 / 2018-04-08 13:25:45 [45027.748740] osp-pre-1-0 24689 1701836.675230 8829 120 0.000000 160.244582 0.000000 1 / 2018-04-08 13:25:45 [45027.760265] ldlm_cn01_006 24800 1701836.670789 502477 120 0.000000 3671.060663 0.000000 1 / 2018-04-08 13:25:45 [45027.771775] osp-pre-0-0 25292 1701867.966739 10104 120 0.000000 216.165891 0.000000 1 / 2018-04-08 13:25:45 [45027.783288] osp-pre-0-0 26735 1701836.679178 8810 120 0.000000 156.586945 0.000000 1 / 2018-04-08 13:25:45 [45027.794795] osp-pre-8-0 26779 1701867.978147 8811 120 0.000000 165.412194 0.000000 1 / 2018-04-08 13:25:45 [45027.806289] osp-syn-14-0 26821 22338.088622 4 120 0.000000 0.112049 0.000000 1 / 2018-04-08 13:25:45 [45027.817782] mdt_rdpg01_002 27978 1701182.247643 31399 120 0.000000 301.860742 0.000000 1 / 2018-04-08 13:25:45 [45027.829291] osp-syn-8-1 28749 24832.960851 4 120 0.000000 0.142333 0.000000 1 / 2018-04-08 13:25:45 [45027.840800] osp-syn-10-2 30565 25843.535173 7 120 0.000000 0.404456 0.000000 1 / 2018-04-08 13:25:45 [45027.852294] ldlm_cb01_003 31072 27374.531286 9 120 0.000000 0.077707 0.000000 1 / 2018-04-08 13:25:45 [45027.863800] mdt_out01_003 43540 1701947.044031 461996890 120 0.000000 9139517.070116 0.000000 1 / 2018-04-08 13:25:45 [45027.875292] kworker/u896:3 283785 1701138.430932 10 120 0.000000 1.374480 0.000000 1 / 2018-04-08 13:25:45 [45027.886906] 2018-04-08 13:25:45 [45027.888769] cpu#2, 3200.000 MHz 2018-04-08 13:25:45 [45027.892279] .nr_running : 1 2018-04-08 13:25:45 [45027.897256] .load : 1024 2018-04-08 13:25:45 [45027.902495] .nr_switches : 747562765 2018-04-08 13:25:45 [45027.908154] .nr_load_updates : 18056431 2018-04-08 13:25:45 [45027.913725] .nr_uninterruptible : 1069 2018-04-08 13:25:45 [45027.918943] .next_balance : 4339.804401 2018-04-08 13:25:45 [45027.924769] .curr->pid : 283092 2018-04-08 13:25:45 [45027.930164] .clock : 45027930.163015 2018-04-08 13:25:45 [45027.936336] .cpu_load[0] : 1024 2018-04-08 13:25:45 [45027.941553] .cpu_load[1] : 1024 2018-04-08 13:25:45 [45027.946762] .cpu_load[2] : 1024 2018-04-08 13:25:45 [45027.951968] .cpu_load[3] : 1024 2018-04-08 13:25:45 [45027.957170] .cpu_load[4] : 1024 2018-04-08 13:25:45 [45027.962359] .avg_idle : 138126 2018-04-08 13:25:45 [45027.967726] .max_idle_balance_cost : 500000 2018-04-08 13:25:45 [45027.973089] 2018-04-08 13:25:45 [45027.973089] cfs_rq[2]:/ 2018-04-08 13:25:45 [45027.977638] .exec_clock : 0.000000 2018-04-08 13:25:45 [45027.983166] .MIN_vruntime : 0.000001 2018-04-08 13:25:45 [45027.988689] .min_vruntime : 7346377.266480 2018-04-08 13:25:45 [45027.994730] .max_vruntime : 0.000001 2018-04-08 13:25:45 [45028.000248] .spread : 0.000000 2018-04-08 13:25:45 [45028.005760] .spread0 : 180268.191863 2018-04-08 13:25:45 [45028.011701] .nr_spread_over : 0 2018-04-08 13:25:45 [45028.016603] .nr_running : 1 2018-04-08 13:25:45 [45028.021504] .load : 1024 2018-04-08 13:25:45 [45028.026664] .runnable_load_avg : 1023 2018-04-08 13:25:45 [45028.031827] .blocked_load_avg : 0 2018-04-08 13:25:45 [45028.036729] .tg_load_avg : 0 2018-04-08 13:25:45 [45028.041632] .tg_load_contrib : 0 2018-04-08 13:25:45 [45028.046527] .tg_runnable_contrib : 0 2018-04-08 13:25:45 [45028.051417] .tg->runnable_avg : 0 2018-04-08 13:25:45 [45028.056307] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:45 [45028.061190] .throttled : 0 2018-04-08 13:25:45 [45028.066072] .throttle_count : 0 2018-04-08 13:25:45 [45028.070952] .avg->runnable_avg_sum : 47483 2018-04-08 13:25:45 [45028.076171] .avg->runnable_avg_period : 47483 2018-04-08 13:25:45 [45028.081393] 2018-04-08 13:25:45 [45028.081393] rt_rq[2]:/ 2018-04-08 13:25:45 [45028.085740] .rt_nr_running : 0 2018-04-08 13:25:45 [45028.090603] .rt_throttled : 0 2018-04-08 13:25:45 [45028.095458] .rt_time : 0.000000 2018-04-08 13:25:45 [45028.100918] .rt_runtime : 950.000000 2018-04-08 13:25:45 [45028.106543] 2018-04-08 13:25:45 [45028.106543] runnable tasks: 2018-04-08 13:25:45 [45028.106543] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:45 [45028.106543] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:45 [45028.133100] migration/2 19 0.000000 1796 0 0.000000 956.785581 0.000000 0 / 2018-04-08 13:25:45 [45028.144487] ksoftirqd/2 20 7343479.943736 80300 120 0.000000 311.538614 0.000000 0 / 2018-04-08 13:25:45 [45028.155889] kworker/2:0H 22 1419.934544 9 100 0.000000 0.035558 0.000000 0 / 2018-04-08 13:25:45 [45028.167281] kdevtmpfs 90 51151.941590 305 120 0.000000 2.672295 0.000000 0 / 2018-04-08 13:25:45 [45028.178686] scsi_tmf_4 353 724.046959 2 100 0.000000 0.004912 0.000000 0 / 2018-04-08 13:25:45 [45028.190081] scsi_tmf_6 357 736.066755 2 100 0.000000 0.004924 0.000000 0 / 2018-04-08 13:25:45 [45028.201479] kworker/u897:14 396 86852.080177 34 120 0.000000 5.864594 0.000000 0 / 2018-04-08 13:25:45 [45028.212882] kworker/2:1H 674 7343693.295814 90414 100 0.000000 136.900096 0.000000 0 / 2018-04-08 13:25:45 [45028.224281] iw_cm_wq 975 2660.310290 2 100 0.000000 0.005133 0.000000 0 / 2018-04-08 13:25:45 [45028.235690] kmpath_handlerd 1450 3164.850846 2 100 0.000000 0.003671 0.000000 0 / 2018-04-08 13:25:45 [45028.247107] multipathd 3103 -10.131730 183 0 0.000000 22.277235 0.000000 0 / 2018-04-08 13:25:45 [45028.258534] multipathd 3574 9437.433853 75 120 0.000000 1.181434 0.000000 0 / 2018-04-08 13:25:45 [45028.269967] multipathd 3584 0.000000 76 0 0.000000 20.739343 0.000000 0 / 2018-04-08 13:25:45 [45028.281402] multipathd 4259 0.000000 5 0 0.000000 0.333227 0.000000 0 / 2018-04-08 13:25:45 [45028.292839] multipathd 4264 0.000000 9 0 0.000000 0.290030 0.000000 0 / 2018-04-08 13:25:45 [45028.304267] kdmwork-253:6 4209 7344179.402941 98622 120 0.000000 1257.153888 0.000000 0 / 2018-04-08 13:25:45 [45028.315709] systemd-logind 9036 7336004.771261 771 120 0.000000 28.562479 0.000000 0 / 2018-04-08 13:25:45 [45028.327156] kworker/2:0 15851 7344182.845821 37680 120 0.000000 319.047470 0.000000 0 / 2018-04-08 13:25:45 [45028.338595] kworker/2:4 15854 16993.815145 11 120 0.000000 0.075116 0.000000 0 / 2018-04-08 13:25:45 [45028.350046] z_rd_iss 18788 29202.137248 2 100 0.000000 0.006423 0.000000 0 / 2018-04-08 13:25:45 [45028.361496] z_wr_iss 18797 83089.903244 122 101 0.000000 3.561767 0.000000 0 / 2018-04-08 13:25:45 [45028.372952] z_wr_iss 18802 83089.902928 122 101 0.000000 3.556781 0.000000 0 / 2018-04-08 13:25:45 [45028.384398] z_wr_iss_h 18809 29454.216981 2 100 0.000000 0.006132 0.000000 0 / 2018-04-08 13:25:45 [45028.395852] z_wr_int_1 18811 83329.986774 759 100 0.000000 6.347646 0.000000 0 / 2018-04-08 13:25:45 [45028.407304] z_wr_int_6 18816 83221.947630 706 100 0.000000 5.728744 0.000000 0 / 2018-04-08 13:25:45 [45028.418763] z_wr_int_h 18818 29562.251016 2 100 0.000000 0.006701 0.000000 0 / 2018-04-08 13:25:45 [45028.430229] z_fr_iss_0 18819 29574.255172 2 100 0.000000 0.007085 0.000000 0 / 2018-04-08 13:25:45 [45028.441679] z_fr_iss_1 18820 29586.259510 2 100 0.000000 0.007212 0.000000 0 / 2018-04-08 13:25:45 [45028.453130] z_fr_iss_2 18821 29598.263395 2 100 0.000000 0.006707 0.000000 0 / 2018-04-08 13:25:45 [45028.464596] z_fr_iss_3 18822 29610.267705 2 100 0.000000 0.007131 0.000000 0 / 2018-04-08 13:25:45 [45028.476055] z_fr_iss_4 18823 29622.272217 2 100 0.000000 0.007400 0.000000 0 / 2018-04-08 13:25:45 [45028.487527] z_fr_iss_5 18824 29634.276093 2 100 0.000000 0.006750 0.000000 0 / 2018-04-08 13:25:45 [45028.498980] z_fr_iss_6 18825 29646.280135 2 100 0.000000 0.006811 0.000000 0 / 2018-04-08 13:25:45 [45028.510444] z_fr_iss_7 18826 29658.283783 2 100 0.000000 0.006916 0.000000 0 / 2018-04-08 13:25:45 [45028.521899] z_fr_int 18827 29670.287448 2 100 0.000000 0.006652 0.000000 0 / 2018-04-08 13:25:45 [45028.533367] z_cl_iss 18828 29682.292249 2 100 0.000000 0.007958 0.000000 0 / 2018-04-08 13:25:45 [45028.544821] z_cl_int 18829 29694.296347 2 100 0.000000 0.007173 0.000000 0 / 2018-04-08 13:25:45 [45028.556276] z_ioctl_iss 18830 29706.300394 2 100 0.000000 0.006911 0.000000 0 / 2018-04-08 13:25:45 [45028.567730] z_upgrade 18833 29742.317021 2 120 0.000000 0.006422 0.000000 0 / 2018-04-08 13:25:45 [45028.579191] dp_sync_taskq 18840 83093.707915 150 139 0.000000 1.128442 0.000000 0 / 2018-04-08 13:25:45 [45028.590668] dp_sync_taskq 18841 83091.192338 154 139 0.000000 1.017525 0.000000 0 / 2018-04-08 13:25:45 [45028.602132] dp_sync_taskq 18843 83089.977736 160 139 0.000000 1.059017 0.000000 0 / 2018-04-08 13:25:45 [45028.613606] dp_sync_taskq 18844 83089.976507 153 139 0.000000 1.131436 0.000000 0 / 2018-04-08 13:25:46 [45028.625069] dp_sync_taskq 18845 83090.621786 155 139 0.000000 1.052707 0.000000 0 / 2018-04-08 13:25:46 [45028.636525] dp_sync_taskq 18846 83090.493080 156 139 0.000000 1.101104 0.000000 0 / 2018-04-08 13:25:46 [45028.647991] dp_sync_taskq 18847 83089.941964 156 139 0.000000 1.119514 0.000000 0 / 2018-04-08 13:25:46 [45028.659466] dp_sync_taskq 18849 83090.008660 157 139 0.000000 1.042933 0.000000 0 / 2018-04-08 13:25:46 [45028.670923] dp_sync_taskq 18850 83089.971387 153 139 0.000000 1.119019 0.000000 0 / 2018-04-08 13:25:46 [45028.682367] z_iput 18852 29949.411893 2 120 0.000000 0.006563 0.000000 0 / 2018-04-08 13:25:46 [45028.693806] z_wr_iss 19342 312118.644860 211 101 0.000000 8.625834 0.000000 0 / 2018-04-08 13:25:46 [45028.705249] z_wr_iss_h 19352 33665.709879 2 100 0.000000 0.006446 0.000000 0 / 2018-04-08 13:25:46 [45028.716680] z_wr_int_h 19361 33773.742815 2 100 0.000000 0.006500 0.000000 0 / 2018-04-08 13:25:46 [45028.728106] z_fr_iss_0 19362 33785.746420 2 100 0.000000 0.006394 0.000000 0 / 2018-04-08 13:25:46 [45028.739545] z_fr_iss_1 19363 33797.750284 2 100 0.000000 0.006598 0.000000 0 / 2018-04-08 13:25:46 [45028.750961] z_fr_iss_2 19364 33809.754187 2 100 0.000000 0.006786 0.000000 0 / 2018-04-08 13:25:46 [45028.762386] z_fr_iss_3 19365 33821.758126 2 100 0.000000 0.006875 0.000000 0 / 2018-04-08 13:25:46 [45028.773812] z_fr_iss_4 19366 33833.762027 2 100 0.000000 0.007025 0.000000 0 / 2018-04-08 13:25:46 [45028.785230] z_fr_iss_5 19367 33845.765715 2 100 0.000000 0.006539 0.000000 0 / 2018-04-08 13:25:46 [45028.796637] z_fr_iss_6 19368 33857.769654 2 100 0.000000 0.006757 0.000000 0 / 2018-04-08 13:25:46 [45028.808052] z_fr_iss_7 19369 33869.773719 2 100 0.000000 0.006894 0.000000 0 / 2018-04-08 13:25:46 [45028.819446] z_fr_int 19370 33881.777698 2 100 0.000000 0.006849 0.000000 0 / 2018-04-08 13:25:46 [45028.830854] z_cl_iss 19371 33893.781532 2 100 0.000000 0.006698 0.000000 0 / 2018-04-08 13:25:46 [45028.842258] z_cl_int 19372 33905.785254 2 100 0.000000 0.006724 0.000000 0 / 2018-04-08 13:25:46 [45028.853666] z_ioctl_iss 19373 33917.789431 2 100 0.000000 0.007213 0.000000 0 / 2018-04-08 13:25:46 [45028.865064] z_upgrade 19376 33953.806794 2 120 0.000000 0.006777 0.000000 0 / 2018-04-08 13:25:46 [45028.876456] dp_sync_taskq 19382 312119.844381 153 139 0.000000 2.050838 0.000000 0 / 2018-04-08 13:25:46 [45028.887862] z_iput 19393 34160.721025 2 120 0.000000 0.006493 0.000000 0 / 2018-04-08 13:25:46 [45028.899256] z_wr_iss 19970 99263.439722 158 101 0.000000 5.821160 0.000000 0 / 2018-04-08 13:25:46 [45028.910661] z_wr_iss_h 19976 37203.970421 2 100 0.000000 0.006607 0.000000 0 / 2018-04-08 13:25:46 [45028.922061] z_wr_int_h 19985 37312.002807 2 100 0.000000 0.006487 0.000000 0 / 2018-04-08 13:25:46 [45028.933459] z_fr_iss_0 19986 37324.006356 2 100 0.000000 0.006201 0.000000 0 / 2018-04-08 13:25:46 [45028.944853] z_fr_iss_1 19987 37336.009876 2 100 0.000000 0.006369 0.000000 0 / 2018-04-08 13:25:46 [45028.956257] z_fr_iss_2 19988 37348.013399 2 100 0.000000 0.006406 0.000000 0 / 2018-04-08 13:25:46 [45028.967656] z_fr_iss_3 19989 37360.017037 2 100 0.000000 0.006472 0.000000 0 / 2018-04-08 13:25:46 [45028.979057] z_fr_iss_4 19990 37372.020620 2 100 0.000000 0.006458 0.000000 0 / 2018-04-08 13:25:46 [45028.990452] z_fr_iss_5 19991 37384.023947 2 100 0.000000 0.006286 0.000000 0 / 2018-04-08 13:25:46 [45029.001849] z_fr_iss_6 19992 37396.027515 2 100 0.000000 0.006237 0.000000 0 / 2018-04-08 13:25:46 [45029.013244] z_fr_iss_7 19993 37408.030788 2 100 0.000000 0.006032 0.000000 0 / 2018-04-08 13:25:46 [45029.024646] z_fr_int 19994 37420.034266 2 100 0.000000 0.006361 0.000000 0 / 2018-04-08 13:25:46 [45029.036035] z_cl_iss 19995 37432.037887 2 100 0.000000 0.006375 0.000000 0 / 2018-04-08 13:25:46 [45029.047430] z_cl_int 19996 37444.041598 2 100 0.000000 0.006729 0.000000 0 / 2018-04-08 13:25:46 [45029.058835] z_ioctl_iss 19997 37456.045133 2 100 0.000000 0.006628 0.000000 0 / 2018-04-08 13:25:46 [45029.070230] z_upgrade 20000 37480.058798 2 120 0.000000 0.006521 0.000000 0 / 2018-04-08 13:25:46 [45029.081629] z_iput 20017 37687.049563 2 120 0.000000 0.006152 0.000000 0 / 2018-04-08 13:25:46 [45029.093030] z_rd_int_0 20537 106105.608670 1565 100 0.000000 13.019157 0.000000 0 / 2018-04-08 13:25:46 [45029.104427] z_wr_iss 20547 103170.453421 174 101 0.000000 7.218605 0.000000 0 / 2018-04-08 13:25:46 [45029.115827] z_wr_iss_h 20557 40857.572590 2 100 0.000000 0.006791 0.000000 0 / 2018-04-08 13:25:46 [45029.127239] z_wr_int_h 20566 40965.607683 2 100 0.000000 0.006577 0.000000 0 / 2018-04-08 13:25:46 [45029.138641] z_fr_iss_0 20567 40977.611723 2 100 0.000000 0.007123 0.000000 0 / 2018-04-08 13:25:46 [45029.150043] z_fr_iss_1 20568 40989.615851 2 100 0.000000 0.007094 0.000000 0 / 2018-04-08 13:25:46 [45029.161446] z_fr_iss_2 20569 41001.619700 2 100 0.000000 0.006653 0.000000 0 / 2018-04-08 13:25:46 [45029.172858] z_fr_iss_3 20570 41013.629812 2 100 0.000000 0.013152 0.000000 0 / 2018-04-08 13:25:46 [45029.184264] z_fr_iss_4 20571 41025.634018 2 100 0.000000 0.007146 0.000000 0 / 2018-04-08 13:25:46 [45029.195668] z_fr_iss_5 20572 41037.637940 2 100 0.000000 0.007035 0.000000 0 / 2018-04-08 13:25:46 [45029.207079] z_fr_iss_6 20573 41049.642047 2 100 0.000000 0.007170 0.000000 0 / 2018-04-08 13:25:46 [45029.218490] z_fr_iss_7 20574 41061.646013 2 100 0.000000 0.006961 0.000000 0 / 2018-04-08 13:25:46 [45029.229891] z_fr_int 20575 41073.649737 2 100 0.000000 0.006521 0.000000 0 / 2018-04-08 13:25:46 [45029.241282] z_cl_iss 20576 41085.653630 2 100 0.000000 0.006963 0.000000 0 / 2018-04-08 13:25:46 [45029.252672] z_cl_int 20577 41097.657402 2 100 0.000000 0.006552 0.000000 0 / 2018-04-08 13:25:46 [45029.264068] z_ioctl_iss 20578 41109.661311 2 100 0.000000 0.007013 0.000000 0 / 2018-04-08 13:25:46 [45029.275464] z_upgrade 20581 41145.679154 2 120 0.000000 0.006558 0.000000 0 / 2018-04-08 13:25:46 [45029.286862] z_iput 20598 41352.763255 2 120 0.000000 0.006411 0.000000 0 / 2018-04-08 13:25:46 [45029.298259] z_wr_iss 21265 95238.719956 62 101 0.000000 2.754221 0.000000 0 / 2018-04-08 13:25:46 [45029.309648] dp_sync_taskq 21298 95240.043374 57 139 0.000000 0.611818 0.000000 0 / 2018-04-08 13:25:46 [45029.321056] dp_sync_taskq 21306 95239.081224 52 139 0.000000 0.482406 0.000000 0 / 2018-04-08 13:25:46 [45029.332460] z_rd_int_4 21856 7227716.787580 3209 100 0.000000 33.067901 0.000000 0 / 2018-04-08 13:25:46 [45029.343875] z_wr_iss_h 21872 45129.213275 2 100 0.000000 0.007017 0.000000 0 / 2018-04-08 13:25:46 [45029.355282] z_wr_int_h 21881 45237.247201 2 100 0.000000 0.006985 0.000000 0 / 2018-04-08 13:25:46 [45029.366685] z_fr_iss_0 21882 45249.250938 2 100 0.000000 0.006719 0.000000 0 / 2018-04-08 13:25:46 [45029.378090] z_fr_iss_1 21883 45261.254614 2 100 0.000000 0.006870 0.000000 0 / 2018-04-08 13:25:46 [45029.389502] z_fr_iss_2 21884 45273.258358 2 100 0.000000 0.006885 0.000000 0 / 2018-04-08 13:25:46 [45029.400911] z_fr_iss_3 21885 45285.262079 2 100 0.000000 0.007014 0.000000 0 / 2018-04-08 13:25:46 [45029.412305] z_fr_iss_4 21886 45297.265804 2 100 0.000000 0.006720 0.000000 0 / 2018-04-08 13:25:46 [45029.423712] z_fr_iss_5 21887 45309.269592 2 100 0.000000 0.006956 0.000000 0 / 2018-04-08 13:25:46 [45029.435113] z_fr_iss_6 21888 45321.273568 2 100 0.000000 0.007335 0.000000 0 / 2018-04-08 13:25:46 [45029.446502] z_fr_iss_7 21889 45333.277295 2 100 0.000000 0.006659 0.000000 0 / 2018-04-08 13:25:46 [45029.457903] z_fr_int 21890 45345.281135 2 100 0.000000 0.006838 0.000000 0 / 2018-04-08 13:25:46 [45029.469292] z_cl_iss 21891 45357.284882 2 100 0.000000 0.006979 0.000000 0 / 2018-04-08 13:25:46 [45029.480686] z_cl_int 21892 45369.288811 2 100 0.000000 0.007188 0.000000 0 / 2018-04-08 13:25:46 [45029.492081] z_ioctl_iss 21893 45381.292377 2 100 0.000000 0.006530 0.000000 0 / 2018-04-08 13:25:46 [45029.503469] z_zvol 21895 47144.661087 19 120 0.000000 0.699970 0.000000 0 / 2018-04-08 13:25:46 [45029.514867] z_upgrade 21896 45417.310527 2 120 0.000000 0.007566 0.000000 0 / 2018-04-08 13:25:46 [45029.526265] dp_sync_taskq 21906 7228435.580582 6850 139 0.000000 134.890553 0.000000 0 / 2018-04-08 13:25:46 [45029.537676] z_iput 21913 45624.553191 2 120 0.000000 0.006586 0.000000 0 / 2018-04-08 13:25:46 [45029.549091] z_wr_iss 22447 7192018.477069 676 101 0.000000 22.627493 0.000000 0 / 2018-04-08 13:25:46 [45029.560507] z_wr_iss_h 22450 48320.358242 2 100 0.000000 0.006825 0.000000 0 / 2018-04-08 13:25:46 [45029.571923] z_wr_int_h 22459 48428.391034 2 100 0.000000 0.007240 0.000000 0 / 2018-04-08 13:25:46 [45029.583351] z_fr_iss_0 22460 48440.394562 2 100 0.000000 0.006850 0.000000 0 / 2018-04-08 13:25:46 [45029.594773] z_fr_iss_1 22461 48452.398246 2 100 0.000000 0.006775 0.000000 0 / 2018-04-08 13:25:46 [45029.606193] z_fr_iss_2 22462 48464.401636 2 100 0.000000 0.006486 0.000000 0 / 2018-04-08 13:25:46 [45029.617604] z_fr_iss_3 22463 48476.405348 2 100 0.000000 0.007017 0.000000 0 / 2018-04-08 13:25:47 [45029.629015] z_fr_iss_4 22464 48488.409314 2 100 0.000000 0.006746 0.000000 0 / 2018-04-08 13:25:47 [45029.640432] z_fr_iss_5 22465 48500.412888 2 100 0.000000 0.006656 0.000000 0 / 2018-04-08 13:25:47 [45029.651848] z_fr_iss_6 22466 48512.416112 2 100 0.000000 0.006295 0.000000 0 / 2018-04-08 13:25:47 [45029.663247] z_fr_iss_7 22467 48524.419470 2 100 0.000000 0.006268 0.000000 0 / 2018-04-08 13:25:47 [45029.674651] z_fr_int 22468 48536.423084 2 100 0.000000 0.006589 0.000000 0 / 2018-04-08 13:25:47 [45029.686064] z_cl_iss 22469 48548.426519 2 100 0.000000 0.006285 0.000000 0 / 2018-04-08 13:25:47 [45029.697465] z_cl_int 22470 48560.430101 2 100 0.000000 0.007165 0.000000 0 / 2018-04-08 13:25:47 [45029.708851] z_ioctl_iss 22471 48572.433748 2 100 0.000000 0.006689 0.000000 0 / 2018-04-08 13:25:47 [45029.720248] z_zvol 22473 50235.863588 11 120 0.000000 0.890968 0.000000 0 / 2018-04-08 13:25:47 [45029.731663] z_upgrade 22474 48608.451114 2 120 0.000000 0.006800 0.000000 0 / 2018-04-08 13:25:47 [45029.743072] z_iput 22492 48815.865930 2 120 0.000000 0.006798 0.000000 0 / 2018-04-08 13:25:47 [45029.754485] cfs_rh_01 23034 5851109.369105 227 120 0.000000 7.434470 0.000000 0 / 2018-04-08 13:25:47 [45029.765909] cfs_rh_03 23036 5578098.932847 227 120 0.000000 4.262746 0.000000 0 / 2018-04-08 13:25:47 [45029.777331] clio 23045 51175.941212 2 100 0.000000 0.007540 0.000000 0 / 2018-04-08 13:25:47 [45029.788745] ptlrpc_hr00_003 23051 630936.350625 3 120 0.000000 0.012500 0.000000 0 / 2018-04-08 13:25:47 [45029.800171] ptlrpc_hr00_004 23052 51223.972710 2 120 0.000000 0.006442 0.000000 0 / 2018-04-08 13:25:47 [45029.811593] ptlrpc_hr00_005 23053 51235.978855 2 120 0.000000 0.006151 0.000000 0 / 2018-04-08 13:25:47 [45029.823010] ptlrpc_hr00_006 23054 51247.984989 2 120 0.000000 0.006140 0.000000 0 / 2018-04-08 13:25:47 [45029.834422] ptlrpc_hr00_007 23055 51259.991649 2 120 0.000000 0.006666 0.000000 0 / 2018-04-08 13:25:47 [45029.845839] ib_fmr(hfi1_0) 23082 51512.407363 2 120 0.000000 0.005828 0.000000 0 / 2018-04-08 13:25:47 [45029.857248] ib_fmr(hfi1_0) 23083 51524.413301 2 120 0.000000 0.005944 0.000000 0 / 2018-04-08 13:25:47 [45029.868668] router_checker 23084 51536.420822 2 120 0.000000 0.007527 0.000000 0 / 2018-04-08 13:25:47 [45029.880082] ldlm_cb00_000 23109 75219.982860 11 120 0.000000 0.053152 0.000000 0 / 2018-04-08 13:25:47 [45029.891491] lc_watchdogd 23110 51800.647996 2 120 0.000000 0.007002 0.000000 0 / 2018-04-08 13:25:47 [45029.902904] ldlm_cn00_000 23114 7175130.244592 11633 120 0.000000 147.812894 0.000000 0 / 2018-04-08 13:25:47 [45029.914320] ldlm_elt 23122 51932.771856 2 120 0.000000 0.006495 0.000000 0 / 2018-04-08 13:25:47 [45029.925738] mgs_params_noti 23128 51956.790151 2 118 0.000000 0.011178 0.000000 0 / 2018-04-08 13:25:47 [45029.937174] ll_evictor 23135 52004.860665 2 120 0.000000 0.007064 0.000000 0 / 2018-04-08 13:25:47 [45029.948614] mdt_attr00_000 24016 56358.197895 2 120 0.000000 0.045940 0.000000 0 / 2018-04-08 13:25:47 [45029.960056] mdt_attr00_001 24017 56370.221943 2 120 0.000000 0.024054 0.000000 0 / 2018-04-08 13:25:47 [45029.971483] mdt_out00_000 24020 7339066.353792 445877868 120 0.000000 10013140.713944 0.000000 0 / 2018-04-08 13:25:47 [45029.982928] mdt_seqs_0000 24024 56454.361793 2 120 0.000000 0.040406 0.000000 0 / 2018-04-08 13:25:47 [45029.994380] mdt_seqs_0001 24025 56466.375772 2 120 0.000000 0.013985 0.000000 0 / 2018-04-08 13:25:47 [45030.005826] mdt_seqm_0000 24026 56478.407584 2 120 0.000000 0.031818 0.000000 0 / 2018-04-08 13:25:47 [45030.017275] mdt_seqm_0001 24027 56490.419879 2 120 0.000000 0.012301 0.000000 0 / 2018-04-08 13:25:47 [45030.028711] qmt_reba_images 24074 56747.565994 2 120 0.000000 0.016153 0.000000 0 / 2018-04-08 13:25:47 [45030.040159] dist_txn-0 24239 57685.837758 2 120 0.000000 0.013026 0.000000 0 / 2018-04-08 13:25:47 [45030.051596] qmt_reba_apps-Q 24673 58621.131858 2 120 0.000000 0.013362 0.000000 0 / 2018-04-08 13:25:47 [45030.063036] osp-syn-0-0 24686 94013.840594 4 120 0.000000 0.134343 0.000000 0 / 2018-04-08 13:25:47 [45030.074471] dist_txn-0 24806 59319.256613 2 120 0.000000 0.016947 0.000000 0 / 2018-04-08 13:25:47 [45030.085910] qmt_reba_home-Q 25282 61307.221200 2 120 0.000000 0.013842 0.000000 0 / 2018-04-08 13:25:47 [45030.097345] osp-syn-9-0 26789 67324.891212 5 120 0.000000 0.127409 0.000000 0 / 2018-04-08 13:25:47 [45030.108793] osp_up2-0 26834 67312.705495 2 120 0.000000 0.013305 0.000000 0 / 2018-04-08 13:25:47 [45030.120231] osp_up0-1 28705 74616.505783 2 120 0.000000 0.014302 0.000000 0 / 2018-04-08 13:25:47 [45030.131665] osp-pre-1-1 28710 95610.909327 4 120 0.000000 0.034467 0.000000 0 / 2018-04-08 13:25:47 [45030.143103] osp-pre-3-1 28725 100575.158783 4 120 0.000000 0.021798 0.000000 0 / 2018-04-08 13:25:47 [45030.154542] osp-pre-4-1 28727 79588.013566 4 120 0.000000 0.021158 0.000000 0 / 2018-04-08 13:25:47 [45030.165990] osp-syn-6-1 28738 76188.305681 4 120 0.000000 0.113740 0.000000 0 / 2018-04-08 13:25:47 [45030.177446] osp-pre-15-1 28791 80440.894492 4 120 0.000000 0.027008 0.000000 0 / 2018-04-08 13:25:47 [45030.188903] osp_up2-1 28796 75049.996767 2 120 0.000000 0.011542 0.000000 0 / 2018-04-08 13:25:47 [45030.200362] lquota_wb_dagg- 29166 7339426.534455 738 120 0.000000 9.023412 0.000000 0 / 2018-04-08 13:25:47 [45030.211806] osp_up0-2 30391 81955.987503 2 120 0.000000 0.021721 0.000000 0 / 2018-04-08 13:25:47 [45030.223265] osp-syn-6-2 30499 82161.275933 5 120 0.000000 0.371226 0.000000 0 / 2018-04-08 13:25:47 [45030.234732] osp-syn-7-2 30514 82173.620971 6 120 0.000000 0.340031 0.000000 0 / 2018-04-08 13:25:47 [45030.246194] osp-syn-8-2 30536 82197.923044 5 120 0.000000 0.358289 0.000000 0 / 2018-04-08 13:25:47 [45030.257661] osp-syn-9-2 30551 82234.195662 6 120 0.000000 0.331580 0.000000 0 / 2018-04-08 13:25:47 [45030.269129] osp-pre-12-2 30589 84965.706237 4 120 0.000000 0.023334 0.000000 0 / 2018-04-08 13:25:47 [45030.280594] osp-syn-14-2 30636 82969.897739 6 120 0.000000 0.387020 0.000000 0 / 2018-04-08 13:25:47 [45030.292052] osp_up1-2 30661 82355.631063 2 120 0.000000 0.012259 0.000000 0 / 2018-04-08 13:25:47 [45030.303520] z_wr_int_4 30994 83365.996459 3 100 0.000000 0.012467 0.000000 0 / 2018-04-08 13:25:47 [45030.314978] z_wr_int_2 31034 83365.993535 2 100 0.000000 0.006480 0.000000 0 / 2018-04-08 13:25:47 [45030.326430] z_wr_int_5 31044 83402.004659 2 100 0.000000 0.006367 0.000000 0 / 2018-04-08 13:25:47 [45030.337890] mdt_rdpg00_002 31986 7175130.215187 2997 120 0.000000 37.233686 0.000000 0 / 2018-04-08 13:25:47 [45030.349333] z_wr_int_0 35458 103206.463320 2 100 0.000000 0.007038 0.000000 0 / 2018-04-08 13:25:47 [45030.360802] z_wr_int_1 35470 103230.470252 2 100 0.000000 0.006401 0.000000 0 / 2018-04-08 13:25:47 [45030.372274] mdt_rdpg00_015 37778 7175130.214914 6570 120 0.000000 75.541260 0.000000 0 / 2018-04-08 13:25:47 [45030.383735] mdt_rdpg00_016 276874 7175130.244506 37 120 0.000000 2.718024 0.000000 0 / 2018-04-08 13:25:47 [45030.395291] mdt_rdpg00_019 276879 7175130.416555 4008 120 0.000000 37.759430 0.000000 0 / 2018-04-08 13:25:47 [45030.406852] tx_commit_cb 281692 7176072.820495 5 120 0.000000 0.087250 0.000000 0 / 2018-04-08 13:25:47 [45030.418414] z_wr_int_6 282991 7228555.228203 3 100 0.000000 0.010405 0.000000 0 / 2018-04-08 13:25:47 [45030.429982] z_wr_int_3 282993 7228555.223704 2 100 0.000000 0.006783 0.000000 0 / 2018-04-08 13:25:47 [45030.441545] z_wr_int_3 283005 7228591.236271 2 100 0.000000 0.007099 0.000000 0 / 2018-04-08 13:25:47 [45030.453098] R bash 283092 7346377.266480 143 120 0.000000 2322.503886 0.000000 0 / 2018-04-08 13:25:47 [45030.464673] 2018-04-08 13:25:47 [45030.466504] cpu#3, 3200.000 MHz 2018-04-08 13:25:47 [45030.469981] .nr_running : 0 2018-04-08 13:25:47 [45030.474924] .load : 1024 2018-04-08 13:25:47 [45030.480130] .nr_switches : 712125850 2018-04-08 13:25:47 [45030.485761] .nr_load_updates : 16627430 2018-04-08 13:25:47 [45030.491298] .nr_uninterruptible : 835 2018-04-08 13:25:47 [45030.496409] .next_balance : 4339.806900 2018-04-08 13:25:47 [45030.502214] .curr->pid : 0 2018-04-08 13:25:47 [45030.507150] .clock : 45030507.129890 2018-04-08 13:25:47 [45030.513295] .cpu_load[0] : 0 2018-04-08 13:25:47 [45030.518228] .cpu_load[1] : 260 2018-04-08 13:25:47 [45030.523325] .cpu_load[2] : 52 2018-04-08 13:25:47 [45030.528337] .cpu_load[3] : 40 2018-04-08 13:25:47 [45030.533346] .cpu_load[4] : 34 2018-04-08 13:25:47 [45030.538346] .avg_idle : 75631 2018-04-08 13:25:47 [45030.543599] .max_idle_balance_cost : 500000 2018-04-08 13:25:47 [45030.548941] 2018-04-08 13:25:47 [45030.548941] cfs_rq[3]:/ 2018-04-08 13:25:47 [45030.553446] .exec_clock : 0.000000 2018-04-08 13:25:47 [45030.558955] .MIN_vruntime : 0.000001 2018-04-08 13:25:47 [45030.564460] .min_vruntime : 5717379.346351 2018-04-08 13:25:47 [45030.570489] .max_vruntime : 0.000001 2018-04-08 13:25:47 [45030.575990] .spread : 0.000000 2018-04-08 13:25:47 [45030.581486] .spread0 : -1448912.142937 2018-04-08 13:25:47 [45030.587587] .nr_spread_over : 0 2018-04-08 13:25:47 [45030.592476] .nr_running : 0 2018-04-08 13:25:47 [45030.597356] .load : 0 2018-04-08 13:25:47 [45030.602242] .runnable_load_avg : 0 2018-04-08 13:25:47 [45030.607125] .blocked_load_avg : 13 2018-04-08 13:25:47 [45030.612095] .tg_load_avg : 0 2018-04-08 13:25:47 [45030.616966] .tg_load_contrib : 0 2018-04-08 13:25:47 [45030.621841] .tg_runnable_contrib : 0 2018-04-08 13:25:47 [45030.626714] .tg->runnable_avg : 0 2018-04-08 13:25:47 [45030.631579] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:47 [45030.636450] .throttled : 0 2018-04-08 13:25:48 [45030.641316] .throttle_count : 0 2018-04-08 13:25:48 [45030.646177] .avg->runnable_avg_sum : 607 2018-04-08 13:25:48 [45030.651216] .avg->runnable_avg_period : 47012 2018-04-08 13:25:48 [45030.656420] 2018-04-08 13:25:48 [45030.656420] rt_rq[3]:/ 2018-04-08 13:25:48 [45030.660732] .rt_nr_running : 0 2018-04-08 13:25:48 [45030.665578] .rt_throttled : 0 2018-04-08 13:25:48 [45030.670424] .rt_time : 0.057500 2018-04-08 13:25:48 [45030.675867] .rt_runtime : 950.000000 2018-04-08 13:25:48 [45030.681488] 2018-04-08 13:25:48 [45030.681488] runnable tasks: 2018-04-08 13:25:48 [45030.681488] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:48 [45030.681488] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:48 [45030.708046] migration/3 24 0.000000 2527 0 0.000000 997.563678 0.000000 1 / 2018-04-08 13:25:48 [45030.719444] ksoftirqd/3 25 5717365.357664 18604 120 0.000000 110.476004 0.000000 1 / 2018-04-08 13:25:48 [45030.730834] kworker/3:0H 27 2235.201898 9 100 0.000000 0.019206 0.000000 1 / 2018-04-08 13:25:48 [45030.742227] writeback 93 47.495986 2 100 0.000000 0.006042 0.000000 1 / 2018-04-08 13:25:48 [45030.753623] kintegrityd 94 59.501245 2 100 0.000000 0.005695 0.000000 1 / 2018-04-08 13:25:48 [45030.765024] bioset 95 71.506042 2 100 0.000000 0.005196 0.000000 1 / 2018-04-08 13:25:48 [45030.776430] kblockd 96 83.511263 2 100 0.000000 0.005636 0.000000 1 / 2018-04-08 13:25:48 [45030.787831] md 98 107.520701 2 100 0.000000 0.005940 0.000000 1 / 2018-04-08 13:25:48 [45030.799235] kworker/3:1 101 5717363.964135 31628 120 0.000000 278.938738 0.000000 1 / 2018-04-08 13:25:48 [45030.810641] kswapd1 107 693.524110 3 120 0.000000 0.012683 0.000000 1 / 2018-04-08 13:25:48 [45030.822052] ksmd 108 585.283768 2 125 0.000000 0.011401 0.000000 1 / 2018-04-08 13:25:48 [45030.833460] crypto 110 609.353549 2 100 0.000000 0.010376 0.000000 1 / 2018-04-08 13:25:48 [45030.844881] kthrotld 118 705.522730 2 100 0.000000 0.010283 0.000000 1 / 2018-04-08 13:25:48 [45030.856307] kmpath_rdacd 120 717.538060 2 100 0.000000 0.015643 0.000000 1 / 2018-04-08 13:25:48 [45030.867721] ib-comp-wq 332 1364.327026 2 100 0.000000 0.007154 0.000000 1 / 2018-04-08 13:25:48 [45030.879144] ib_addr 333 1376.332654 2 100 0.000000 0.006187 0.000000 1 / 2018-04-08 13:25:48 [45030.890563] ib_mcast 334 1388.338418 2 100 0.000000 0.006354 0.000000 1 / 2018-04-08 13:25:48 [45030.901988] ib_nl_sa_wq 335 1400.343994 2 100 0.000000 0.006089 0.000000 1 / 2018-04-08 13:25:48 [45030.913417] scsi_tmf_2 349 1502.819400 2 100 0.000000 0.006237 0.000000 1 / 2018-04-08 13:25:48 [45030.924832] scsi_eh_3 350 1534.236138 22 120 0.000000 0.194832 0.000000 1 / 2018-04-08 13:25:48 [45030.936266] bnx2x_iov 400 1544.821931 2 100 0.000000 0.006855 0.000000 1 / 2018-04-08 13:25:48 [45030.947704] bond0 491 1848.888257 2 100 0.000000 0.011202 0.000000 1 / 2018-04-08 13:25:48 [45030.959146] poll_mpt3sas0_s 601 2065.544537 2 100 0.000000 0.046977 0.000000 1 / 2018-04-08 13:25:48 [45030.970576] kworker/3:1H 685 5717365.350821 21083 100 0.000000 57.185612 0.000000 1 / 2018-04-08 13:25:48 [45030.982010] kworker/u898:3 1128 81428.551693 94 120 0.000000 2.316404 0.000000 1 / 2018-04-08 13:25:48 [45030.993454] multipathd 4274 0.000000 171464 0 0.000000 4222.637248 0.000000 1 / 2018-04-08 13:25:48 [45031.004908] lvmetad 4144 6634.526419 7 120 0.000000 3.295485 0.000000 1 / 2018-04-08 13:25:48 [45031.016370] kworker/3:2 4256 6861.272168 4 120 0.000000 0.011609 0.000000 1 / 2018-04-08 13:25:48 [45031.027816] ttm_swap 4461 6986.321107 2 100 0.000000 0.007050 0.000000 1 / 2018-04-08 13:25:48 [45031.039286] arc_reclaim 8667 5717365.356428 45096 120 0.000000 472.552904 0.000000 1 / 2018-04-08 13:25:48 [45031.050757] zed 9141 58883.518735 61 120 0.000000 1.586111 0.000000 1 / 2018-04-08 13:25:48 [45031.062231] sshd 8954 5643372.393134 22 120 0.000000 9.283669 0.000000 1 / 2018-04-08 13:25:48 [45031.073707] agetty 9048 21598.635383 36 120 0.000000 8.686304 0.000000 1 / 2018-04-08 13:25:48 [45031.085184] z_vdev_file 9129 15309.472218 2 139 0.000000 0.009466 0.000000 1 / 2018-04-08 13:25:48 [45031.096676] kdmwork-253:14 9259 5717365.364704 46458 120 0.000000 1018.665670 0.000000 1 / 2018-04-08 13:25:48 [45031.108164] irq/99-hfi1_0 k 14361 0.000000 2 49 0.000000 0.012343 0.000000 1 / 2018-04-08 13:25:48 [45031.119668] irq/100-hfi1_0 14362 0.000000 2 49 0.000000 0.006602 0.000000 1 / 2018-04-08 13:25:48 [45031.131168] irq/101-hfi1_0 14363 0.000000 2 49 0.000000 0.006035 0.000000 1 / 2018-04-08 13:25:48 [45031.142663] irq/102-hfi1_0 14364 0.000000 2 49 0.000000 0.006419 0.000000 1 / 2018-04-08 13:25:48 [45031.154163] ib_mad1 14414 20259.026604 2 100 0.000000 0.006590 0.000000 1 / 2018-04-08 13:25:48 [45031.165653] ipoib_wq 14419 20271.032735 2 100 0.000000 0.006562 0.000000 1 / 2018-04-08 13:25:48 [45031.177155] pcsd 14509 5717371.699012 22561 120 0.000000 894.872634 0.000000 1 / 2018-04-08 13:25:48 [45031.188647] gmain 15450 24782.718738 5 120 0.000000 0.146707 0.000000 1 / 2018-04-08 13:25:48 [45031.200152] JS GC Helper 15452 24806.952449 3 120 0.000000 0.060989 0.000000 1 / 2018-04-08 13:25:48 [45031.211649] JS Sour~ Thread 15453 24819.055323 6 120 0.000000 0.075046 0.000000 1 / 2018-04-08 13:25:48 [45031.223153] polkitd 15454 24831.056326 3 120 0.000000 0.037112 0.000000 1 / 2018-04-08 13:25:48 [45031.234665] txg_quiesce 18937 5717363.999893 17984 120 0.000000 570.415963 0.000000 1 / 2018-04-08 13:25:48 [45031.246160] z_wr_iss 20551 91258.450552 180 101 0.000000 6.230422 0.000000 1 / 2018-04-08 13:25:48 [45031.257646] z_rd_int_2 21250 4697555.812341 830 100 0.000000 10.172998 0.000000 1 / 2018-04-08 13:25:48 [45031.269127] z_rd_int_6 21254 4697555.812293 797 100 0.000000 9.497345 0.000000 1 / 2018-04-08 13:25:48 [45031.280603] z_wr_iss_h 21268 54084.343282 2 100 0.000000 0.007248 0.000000 1 / 2018-04-08 13:25:48 [45031.292094] z_wr_int_2 21271 88899.873591 342 100 0.000000 3.149736 0.000000 1 / 2018-04-08 13:25:48 [45031.303578] z_wr_int_7 21276 88899.872350 326 100 0.000000 2.891576 0.000000 1 / 2018-04-08 13:25:48 [45031.315057] z_wr_int_h 21277 54192.384133 2 100 0.000000 0.007378 0.000000 1 / 2018-04-08 13:25:48 [45031.326548] z_fr_iss_0 21278 54204.388591 2 100 0.000000 0.007777 0.000000 1 / 2018-04-08 13:25:48 [45031.338038] z_fr_iss_1 21279 54216.392965 2 100 0.000000 0.007061 0.000000 1 / 2018-04-08 13:25:48 [45031.349512] z_fr_iss_2 21280 54228.397545 2 100 0.000000 0.007673 0.000000 1 / 2018-04-08 13:25:48 [45031.360992] z_fr_iss_3 21281 54240.405820 2 100 0.000000 0.011215 0.000000 1 / 2018-04-08 13:25:48 [45031.372471] z_fr_iss_4 21282 54252.410447 2 100 0.000000 0.008159 0.000000 1 / 2018-04-08 13:25:48 [45031.383942] z_fr_iss_5 21283 54264.414862 2 100 0.000000 0.007378 0.000000 1 / 2018-04-08 13:25:48 [45031.395416] z_fr_iss_6 21284 54276.418893 2 100 0.000000 0.007440 0.000000 1 / 2018-04-08 13:25:48 [45031.406886] z_fr_iss_7 21285 54288.423463 2 100 0.000000 0.007882 0.000000 1 / 2018-04-08 13:25:48 [45031.418345] z_fr_int 21286 54300.427960 2 100 0.000000 0.007459 0.000000 1 / 2018-04-08 13:25:48 [45031.429808] z_cl_iss 21287 54312.433056 2 100 0.000000 0.008410 0.000000 1 / 2018-04-08 13:25:48 [45031.441274] z_cl_int 21288 54324.437669 2 100 0.000000 0.007730 0.000000 1 / 2018-04-08 13:25:48 [45031.452744] z_ioctl_iss 21289 54336.442109 2 100 0.000000 0.007231 0.000000 1 / 2018-04-08 13:25:48 [45031.464219] z_ioctl_int 21290 88899.872426 31 100 0.000000 0.117588 0.000000 1 / 2018-04-08 13:25:48 [45031.475690] z_upgrade 21292 54372.460644 2 120 0.000000 0.007033 0.000000 1 / 2018-04-08 13:25:48 [45031.487154] z_iput 21310 54579.943360 2 120 0.000000 0.008191 0.000000 1 / 2018-04-08 13:25:48 [45031.498612] z_wr_iss 21865 5636663.964677 13879 101 0.000000 626.255055 0.000000 1 / 2018-04-08 13:25:48 [45031.510078] dp_sync_taskq 21904 5636664.356331 6920 139 0.000000 131.156048 0.000000 1 / 2018-04-08 13:25:48 [45031.521540] dp_sync_taskq 21911 5636664.431561 6834 139 0.000000 129.190389 0.000000 1 / 2018-04-08 13:25:48 [45031.533010] cfs_rh_00 23033 4533470.530150 230 120 0.000000 3.083393 0.000000 1 / 2018-04-08 13:25:48 [45031.544481] ptlrpc_hr01_000 23056 5131440.039626 12396 120 0.000000 60.287160 0.000000 1 / 2018-04-08 13:25:48 [45031.555936] ptlrpcd_01_03 23097 5717363.983797 11548 120 0.000000 181.822730 0.000000 1 / 2018-04-08 13:25:48 [45031.567404] ldlm_cb01_000 23112 76298.248175 6 120 0.000000 0.068671 0.000000 1 / 2018-04-08 13:25:48 [45031.578876] mdt_rdpg01_000 24014 5590642.650265 13453 120 0.000000 133.150419 0.000000 1 / 2018-04-08 13:25:48 [45031.590346] osp-syn-1-0 24107 66629.935176 4 120 0.000000 0.153078 0.000000 1 / 2018-04-08 13:25:48 [45031.601803] tx_commit_cb 24564 88899.881188 6 120 0.000000 0.377957 0.000000 1 / 2018-04-08 13:25:48 [45031.613268] osp-pre-1-0 24689 5717363.967813 8830 120 0.000000 160.251516 0.000000 1 / 2018-04-08 13:25:48 [45031.624742] dist_txn-0 25501 64274.241755 2 120 0.000000 0.013739 0.000000 1 / 2018-04-08 13:25:49 [45031.636213] qmt_reba_dagg-Q 26729 98572.322188 4 120 0.000000 0.058525 0.000000 1 / 2018-04-08 13:25:49 [45031.647684] osp-syn-1-0 26745 85334.623235 4 120 0.000000 0.114951 0.000000 1 / 2018-04-08 13:25:49 [45031.659137] osp-pre-5-0 26762 5717363.981166 8811 120 0.000000 168.659597 0.000000 1 / 2018-04-08 13:25:49 [45031.670597] dist_txn-0 27005 67494.186575 2 120 0.000000 0.016976 0.000000 1 / 2018-04-08 13:25:49 [45031.682076] osp-pre-14-1 28787 74591.393972 4 120 0.000000 0.028707 0.000000 1 / 2018-04-08 13:25:49 [45031.693544] osp-pre-5-2 30468 79228.730165 4 120 0.000000 0.033432 0.000000 1 / 2018-04-08 13:25:49 [45031.705026] osp-pre-7-2 30506 79228.721922 4 120 0.000000 0.019735 0.000000 1 / 2018-04-08 13:25:49 [45031.716505] osp-pre-8-2 30525 79254.251565 4 120 0.000000 0.030084 0.000000 1 / 2018-04-08 13:25:49 [45031.727976] ldlm_cb01_002 31071 98572.287026 12 120 0.000000 0.045325 0.000000 1 / 2018-04-08 13:25:49 [45031.739437] tx_commit_cb 31563 91258.459243 12 120 0.000000 1.179666 0.000000 1 / 2018-04-08 13:25:49 [45031.750911] mdt_fld_0002 31987 91642.998794 6 120 0.000000 0.036638 0.000000 1 / 2018-04-08 13:25:49 [45031.762384] mdt01_009 32593 5717506.076926 926478 120 0.000000 13053.581417 0.000000 1 / 2018-04-08 13:25:49 [45031.773853] mdt_rdpg01_006 32913 5589256.210543 168639 120 0.000000 1721.225563 0.000000 1 / 2018-04-08 13:25:49 [45031.785326] z_wr_int_4 34470 88887.863673 2 100 0.000000 0.006749 0.000000 1 / 2018-04-08 13:25:49 [45031.796798] z_wr_int_4 35149 90981.549272 2 100 0.000000 0.006298 0.000000 1 / 2018-04-08 13:25:49 [45031.808276] z_wr_int_4 35150 90993.553409 2 100 0.000000 0.006636 0.000000 1 / 2018-04-08 13:25:49 [45031.819740] z_wr_int_4 35151 91005.557058 2 100 0.000000 0.006031 0.000000 1 / 2018-04-08 13:25:49 [45031.831201] z_wr_int_6 35152 91041.571690 3 100 0.000000 0.010189 0.000000 1 / 2018-04-08 13:25:49 [45031.842662] z_wr_int_6 35154 91041.567963 2 100 0.000000 0.005922 0.000000 1 / 2018-04-08 13:25:49 [45031.854127] z_wr_int_5 282331 5604542.846001 2 100 0.000000 0.007607 0.000000 1 / 2018-04-08 13:25:49 [45031.865689] z_wr_int_4 282336 5604566.855521 2 100 0.000000 0.007452 0.000000 1 / 2018-04-08 13:25:49 [45031.877237] z_wr_int_4 282337 5604578.859780 2 100 0.000000 0.006378 0.000000 1 / 2018-04-08 13:25:49 [45031.888796] z_wr_int_3 282338 5604590.864146 2 100 0.000000 0.007155 0.000000 1 / 2018-04-08 13:25:49 [45031.900355] z_wr_int_3 282339 5604602.868984 2 100 0.000000 0.006715 0.000000 1 / 2018-04-08 13:25:49 [45031.911913] z_wr_int_0 282343 5604650.888014 2 100 0.000000 0.007247 0.000000 1 / 2018-04-08 13:25:49 [45031.923456] kworker/u896:2 283706 5717506.084916 964 120 0.000000 44.392210 0.000000 1 / 2018-04-08 13:25:49 [45031.935043] 2018-04-08 13:25:49 [45031.936882] cpu#4, 3200.000 MHz 2018-04-08 13:25:49 [45031.940366] .nr_running : 0 2018-04-08 13:25:49 [45031.945323] .load : 0 2018-04-08 13:25:49 [45031.950275] .nr_switches : 756136649 2018-04-08 13:25:49 [45031.955923] .nr_load_updates : 18022806 2018-04-08 13:25:49 [45031.961481] .nr_uninterruptible : -269 2018-04-08 13:25:49 [45031.966693] .next_balance : 4339.808372 2018-04-08 13:25:49 [45031.972512] .curr->pid : 0 2018-04-08 13:25:49 [45031.977462] .clock : 45031976.893489 2018-04-08 13:25:49 [45031.983618] .cpu_load[0] : 0 2018-04-08 13:25:49 [45031.988557] .cpu_load[1] : 0 2018-04-08 13:25:49 [45031.993499] .cpu_load[2] : 0 2018-04-08 13:25:49 [45031.998429] .cpu_load[3] : 0 2018-04-08 13:25:49 [45032.003356] .cpu_load[4] : 0 2018-04-08 13:25:49 [45032.008271] .avg_idle : 1000000 2018-04-08 13:25:49 [45032.013704] .max_idle_balance_cost : 500000 2018-04-08 13:25:49 [45032.019045] 2018-04-08 13:25:49 [45032.019045] cfs_rq[4]:/ 2018-04-08 13:25:49 [45032.023537] .exec_clock : 0.000000 2018-04-08 13:25:49 [45032.029042] .MIN_vruntime : 0.000001 2018-04-08 13:25:49 [45032.034537] .min_vruntime : 6697561.721758 2018-04-08 13:25:49 [45032.040550] .max_vruntime : 0.000001 2018-04-08 13:25:49 [45032.046036] .spread : 0.000000 2018-04-08 13:25:49 [45032.051523] .spread0 : -469059.727393 2018-04-08 13:25:49 [45032.057528] .nr_spread_over : 0 2018-04-08 13:25:49 [45032.062400] .nr_running : 0 2018-04-08 13:25:49 [45032.067273] .load : 0 2018-04-08 13:25:49 [45032.072140] .runnable_load_avg : 0 2018-04-08 13:25:49 [45032.077005] .blocked_load_avg : 0 2018-04-08 13:25:49 [45032.081870] .tg_load_avg : 0 2018-04-08 13:25:49 [45032.086735] .tg_load_contrib : 0 2018-04-08 13:25:49 [45032.091587] .tg_runnable_contrib : 0 2018-04-08 13:25:49 [45032.096441] .tg->runnable_avg : 0 2018-04-08 13:25:49 [45032.101286] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:49 [45032.106124] .throttled : 0 2018-04-08 13:25:49 [45032.110965] .throttle_count : 0 2018-04-08 13:25:49 [45032.115807] .avg->runnable_avg_sum : 0 2018-04-08 13:25:49 [45032.120649] .avg->runnable_avg_period : 48097 2018-04-08 13:25:49 [45032.125837] 2018-04-08 13:25:49 [45032.125837] rt_rq[4]:/ 2018-04-08 13:25:49 [45032.130121] .rt_nr_running : 0 2018-04-08 13:25:49 [45032.134960] .rt_throttled : 0 2018-04-08 13:25:49 [45032.139792] .rt_time : 0.000000 2018-04-08 13:25:49 [45032.145231] .rt_runtime : 950.000000 2018-04-08 13:25:49 [45032.150843] 2018-04-08 13:25:49 [45032.150843] runnable tasks: 2018-04-08 13:25:49 [45032.150843] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:49 [45032.150843] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:49 [45032.177395] migration/4 29 0.000000 813 0 0.000000 1836.737246 0.000000 0 / 2018-04-08 13:25:49 [45032.188787] ksoftirqd/4 30 6695591.747664 78259 120 0.000000 274.721112 0.000000 0 / 2018-04-08 13:25:49 [45032.200169] kworker/4:0H 32 3337.470256 9 100 0.000000 0.024805 0.000000 0 / 2018-04-08 13:25:49 [45032.211556] scsi_eh_4 352 409.729942 22 120 0.000000 0.132865 0.000000 0 / 2018-04-08 13:25:49 [45032.222960] scsi_tmf_13 385 381.070802 2 100 0.000000 0.004985 0.000000 0 / 2018-04-08 13:25:49 [45032.234348] scsi_tmf_15 389 405.078440 2 100 0.000000 0.003830 0.000000 0 / 2018-04-08 13:25:49 [45032.245753] rdma_cm 1010 1171.194334 2 100 0.000000 0.006086 0.000000 0 / 2018-04-08 13:25:49 [45032.257152] multipathd 3585 0.000000 9077 0 0.000000 129.919182 0.000000 0 / 2018-04-08 13:25:49 [45032.268560] multipathd 4258 0.000000 3 0 0.000000 0.690104 0.000000 0 / 2018-04-08 13:25:49 [45032.279949] multipathd 4265 0.000000 10 0 0.000000 1.112942 0.000000 0 / 2018-04-08 13:25:49 [45032.291360] multipathd 4275 0.000000 254 0 0.000000 21.767142 0.000000 0 / 2018-04-08 13:25:49 [45032.302767] kvm-irqfd-clean 3561 2890.592996 2 100 0.000000 0.006440 0.000000 0 / 2018-04-08 13:25:49 [45032.314178] spl_system_task 3582 11432.692743 67 100 0.000000 2.908395 0.000000 0 / 2018-04-08 13:25:49 [45032.325602] spl_delay_taskq 3610 2951.032718 2 100 0.000000 0.016760 0.000000 0 / 2018-04-08 13:25:49 [45032.337028] bioset 4185 3034.441285 2 100 0.000000 0.007667 0.000000 0 / 2018-04-08 13:25:49 [45032.348452] kdmflush 4194 3042.561804 2 100 0.000000 0.007035 0.000000 0 / 2018-04-08 13:25:49 [45032.359872] bioset 4197 3042.564104 2 100 0.000000 0.007377 0.000000 0 / 2018-04-08 13:25:49 [45032.371295] bioset 4206 3042.568812 2 100 0.000000 0.006953 0.000000 0 / 2018-04-08 13:25:49 [45032.382705] kdmflush 4213 3042.600574 2 100 0.000000 0.006710 0.000000 0 / 2018-04-08 13:25:49 [45032.394134] bioset 4217 3042.602863 2 100 0.000000 0.006589 0.000000 0 / 2018-04-08 13:25:49 [45032.405557] bioset 4229 3042.607442 2 100 0.000000 0.006938 0.000000 0 / 2018-04-08 13:25:49 [45032.416985] kdmflush 4237 3042.612220 2 100 0.000000 0.007462 0.000000 0 / 2018-04-08 13:25:49 [45032.428408] bioset 4238 3042.614561 2 100 0.000000 0.007005 0.000000 0 / 2018-04-08 13:25:49 [45032.439828] kdmflush 4248 3042.619176 2 100 0.000000 0.007128 0.000000 0 / 2018-04-08 13:25:49 [45032.451257] bioset 4252 3042.621733 2 100 0.000000 0.007488 0.000000 0 / 2018-04-08 13:25:49 [45032.462687] kworker/4:1H 6116 6697481.090176 89441 100 0.000000 133.667750 0.000000 0 / 2018-04-08 13:25:49 [45032.474128] mcelog 9068 4808.133648 1 120 0.000000 1.955530 0.000000 0 / 2018-04-08 13:25:49 [45032.485569] kworker/4:16 12501 6697549.727257 37270 120 0.000000 293.490859 0.000000 0 / 2018-04-08 13:25:49 [45032.497017] kworker/4:17 12502 6295.522373 3 120 0.000000 0.008555 0.000000 0 / 2018-04-08 13:25:49 [45032.508459] pcsd 14516 6682002.277506 154 120 0.000000 5.086131 0.000000 0 / 2018-04-08 13:25:49 [45032.519905] z_wr_iss 18799 13849.484552 125 101 0.000000 3.383814 0.000000 0 / 2018-04-08 13:25:49 [45032.531363] z_wr_int_3 18813 13861.488985 765 100 0.000000 6.175023 0.000000 0 / 2018-04-08 13:25:49 [45032.542822] z_wr_int_7 18817 13861.489852 753 100 0.000000 6.275750 0.000000 0 / 2018-04-08 13:25:49 [45032.554277] z_zvol 18832 10074.694978 17 120 0.000000 0.738462 0.000000 0 / 2018-04-08 13:25:49 [45032.565735] dp_sync_taskq 18842 13849.548737 154 139 0.000000 1.100132 0.000000 0 / 2018-04-08 13:25:49 [45032.577203] dp_sync_taskq 18851 13850.207236 158 139 0.000000 1.113791 0.000000 0 / 2018-04-08 13:25:49 [45032.588678] z_rd_int_4 19336 5530038.404178 586 100 0.000000 8.011595 0.000000 0 / 2018-04-08 13:25:49 [45032.600154] z_wr_iss 19344 221051.515437 207 101 0.000000 7.997456 0.000000 0 / 2018-04-08 13:25:49 [45032.611622] z_wr_iss 19350 221051.518073 202 101 0.000000 8.497037 0.000000 0 / 2018-04-08 13:25:50 [45032.623096] z_zvol 19375 10419.138548 17 120 0.000000 0.711604 0.000000 0 / 2018-04-08 13:25:50 [45032.634573] dp_sync_taskq 19383 221053.642279 156 139 0.000000 1.404621 0.000000 0 / 2018-04-08 13:25:50 [45032.646059] dp_sync_taskq 19384 221052.778023 153 139 0.000000 2.546840 0.000000 0 / 2018-04-08 13:25:50 [45032.657548] dp_sync_taskq 19389 221053.196534 149 139 0.000000 1.597445 0.000000 0 / 2018-04-08 13:25:50 [45032.669034] dp_sync_taskq 19390 221054.118149 154 139 0.000000 2.319949 0.000000 0 / 2018-04-08 13:25:50 [45032.680523] txg_quiesce 19593 6697553.462632 17773 120 0.000000 601.683703 0.000000 0 / 2018-04-08 13:25:50 [45032.692001] z_null_int 19954 6697553.420123 90651 100 0.000000 638.895791 0.000000 0 / 2018-04-08 13:25:50 [45032.703486] z_wr_iss 19969 15290.038810 172 101 0.000000 5.967512 0.000000 0 / 2018-04-08 13:25:50 [45032.714967] z_wr_int_1 19978 15290.605074 644 100 0.000000 6.114061 0.000000 0 / 2018-04-08 13:25:50 [45032.726439] z_zvol 19999 10521.241045 13 120 0.000000 0.882285 0.000000 0 / 2018-04-08 13:25:50 [45032.737909] dp_sync_taskq 20008 15295.017633 108 139 0.000000 1.593691 0.000000 0 / 2018-04-08 13:25:50 [45032.749381] dp_sync_taskq 20009 15292.609763 122 139 0.000000 1.479050 0.000000 0 / 2018-04-08 13:25:50 [45032.760847] z_wr_iss 20553 16521.681144 176 101 0.000000 7.270022 0.000000 0 / 2018-04-08 13:25:50 [45032.772310] z_wr_int_0 20558 16521.681127 707 100 0.000000 7.662283 0.000000 0 / 2018-04-08 13:25:50 [45032.783777] z_wr_int_2 20560 16521.681218 727 100 0.000000 7.806736 0.000000 0 / 2018-04-08 13:25:50 [45032.795249] dp_sync_taskq 21301 15079.811931 53 139 0.000000 0.824289 0.000000 0 / 2018-04-08 13:25:50 [45032.806720] dp_sync_taskq 21307 15080.320654 55 139 0.000000 0.569315 0.000000 0 / 2018-04-08 13:25:50 [45032.818183] txg_quiesce 21403 6697490.196893 17770 120 0.000000 589.807369 0.000000 0 / 2018-04-08 13:25:50 [45032.829661] z_rd_iss 21851 6569390.888326 41 100 0.000000 0.709605 0.000000 0 / 2018-04-08 13:25:50 [45032.841132] z_rd_int_0 21852 6569406.082072 3290 100 0.000000 34.354666 0.000000 0 / 2018-04-08 13:25:50 [45032.852610] z_rd_int_3 21855 6569406.133369 3276 100 0.000000 33.800400 0.000000 0 / 2018-04-08 13:25:50 [45032.864081] dp_sync_taskq 21903 6570130.868767 6835 139 0.000000 137.126501 0.000000 0 / 2018-04-08 13:25:50 [45032.875563] dp_sync_taskq 21912 6570132.402037 7045 139 0.000000 136.943922 0.000000 0 / 2018-04-08 13:25:50 [45032.887034] z_rd_iss 22429 5072728.598666 64 100 0.000000 1.011154 0.000000 0 / 2018-04-08 13:25:50 [45032.898501] z_wr_int_3 22454 6518441.984761 3422 100 0.000000 30.628324 0.000000 0 / 2018-04-08 13:25:50 [45032.909986] z_wr_int_7 22458 6518453.987566 3342 100 0.000000 30.981233 0.000000 0 / 2018-04-08 13:25:50 [45032.921462] cfs_rh_02 23035 5373787.779427 228 120 0.000000 3.589824 0.000000 0 / 2018-04-08 13:25:50 [45032.932947] kiblnd_sd_00_02 23076 6697560.619192 847380 120 0.000000 9106.092893 0.000000 0 / 2018-04-08 13:25:50 [45032.944440] ptlrpcd_rcv 23085 6695591.763754 5230 120 0.000000 496.704203 0.000000 0 / 2018-04-08 13:25:50 [45032.955936] ptlrpcd_00_02 23088 6697560.611965 75179 120 0.000000 1478.358032 0.000000 0 / 2018-04-08 13:25:50 [45032.967440] ptlrpcd_00_04 23090 6697553.472690 75090 120 0.000000 1468.056828 0.000000 0 / 2018-04-08 13:25:50 [45032.978948] ptlrpcd_00_06 23092 6697553.421253 75067 120 0.000000 1461.294376 0.000000 0 / 2018-04-08 13:25:50 [45032.990455] ll_cfg_requeue 23136 14735.317146 48 120 0.000000 1.442236 0.000000 0 / 2018-04-08 13:25:50 [45033.001957] mdt00_002 24008 6697502.162838 107084 120 0.000000 2413.452969 0.000000 0 / 2018-04-08 13:25:50 [45033.013457] mdt_out00_001 24021 5864909.258205 357245030 120 0.000000 7712384.280144 0.000000 0 / 2018-04-08 13:25:50 [45033.024958] mdt_fld_0000 24028 14116.820586 6 120 0.000000 0.059054 0.000000 0 / 2018-04-08 13:25:50 [45033.036455] mdt00_003 24060 6697502.167773 70371 120 0.000000 1561.378406 0.000000 0 / 2018-04-08 13:25:50 [45033.047968] osp-pre-11-0 26801 6697553.431425 8812 120 0.000000 168.640573 0.000000 0 / 2018-04-08 13:25:50 [45033.059481] lquota_wb_dagg- 27000 6690462.917988 738 120 0.000000 9.188630 0.000000 0 / 2018-04-08 13:25:50 [45033.070979] mdt00_007 28411 6697502.162911 64912 120 0.000000 1454.648406 0.000000 0 / 2018-04-08 13:25:50 [45033.082488] osp-syn-0-1 28708 14970.752350 4 120 0.000000 0.177206 0.000000 0 / 2018-04-08 13:25:50 [45033.094008] osp-syn-2-1 28720 15188.228055 4 120 0.000000 0.121431 0.000000 0 / 2018-04-08 13:25:50 [45033.105513] osp-syn-4-1 28728 13094.735807 4 120 0.000000 0.094444 0.000000 0 / 2018-04-08 13:25:50 [45033.117019] osp-syn-5-1 28734 13094.690096 4 120 0.000000 0.102080 0.000000 0 / 2018-04-08 13:25:50 [45033.128524] osp-syn-7-1 28743 13488.631730 4 120 0.000000 0.106727 0.000000 0 / 2018-04-08 13:25:50 [45033.140027] osp-syn-9-1 28754 13082.716669 4 120 0.000000 0.088081 0.000000 0 / 2018-04-08 13:25:50 [45033.151533] osp-syn-13-1 28784 13094.716857 4 120 0.000000 0.092461 0.000000 0 / 2018-04-08 13:25:50 [45033.163040] tx_commit_cb 29903 15290.616630 10 120 0.000000 0.903154 0.000000 0 / 2018-04-08 13:25:50 [45033.174540] osp-syn-0-2 30394 14862.592875 7 120 0.000000 0.423942 0.000000 0 / 2018-04-08 13:25:50 [45033.186026] osp-syn-1-2 30410 14862.578428 7 120 0.000000 0.383564 0.000000 0 / 2018-04-08 13:25:50 [45033.197515] osp-syn-4-2 30464 13777.207887 6 120 0.000000 0.332741 0.000000 0 / 2018-04-08 13:25:50 [45033.209019] osp-syn-11-2 30582 13801.435794 6 120 0.000000 0.343456 0.000000 0 / 2018-04-08 13:25:50 [45033.220524] z_wr_int_6 31002 13861.489009 3 100 0.000000 0.016139 0.000000 0 / 2018-04-08 13:25:50 [45033.232031] z_wr_int_7 31033 13861.488968 3 100 0.000000 0.012927 0.000000 0 / 2018-04-08 13:25:50 [45033.243532] qsd_reint_1.dag 31307 16980.856131 84 120 0.000000 1.166582 0.000000 0 / 2018-04-08 13:25:50 [45033.255033] mdt00_011 32614 6697560.607212 101273 120 0.000000 2252.152205 0.000000 0 / 2018-04-08 13:25:50 [45033.266532] mdt00_012 32615 6697502.167660 103099 120 0.000000 2273.102697 0.000000 0 / 2018-04-08 13:25:50 [45033.278025] mdt_out00_003 35475 6697576.330323 112568048 120 0.000000 2244024.905330 0.000000 0 / 2018-04-08 13:25:50 [45033.289520] mdt_rdpg00_014 37777 6569152.390002 18821 120 0.000000 173.235054 0.000000 0 / 2018-04-08 13:25:50 [45033.301017] ldlm_cn00_008 276907 6691415.275437 1870 120 0.000000 28.039827 0.000000 0 / 2018-04-08 13:25:50 [45033.312613] tx_commit_cb 281686 6496900.857427 5 120 0.000000 0.114069 0.000000 0 / 2018-04-08 13:25:50 [45033.324212] z_wr_int_6 282330 6518465.987533 3 100 0.000000 0.016583 0.000000 0 / 2018-04-08 13:25:50 [45033.335815] z_wr_int_4 282334 6518477.990431 2 100 0.000000 0.006079 0.000000 0 / 2018-04-08 13:25:50 [45033.347404] z_wr_int_6 282987 6570238.270185 3 100 0.000000 0.020823 0.000000 0 / 2018-04-08 13:25:50 [45033.358994] z_wr_int_6 282992 6570238.266197 2 100 0.000000 0.007300 0.000000 0 / 2018-04-08 13:25:50 [45033.370588] z_wr_int_6 282995 6570250.270012 2 100 0.000000 0.006577 0.000000 0 / 2018-04-08 13:25:50 [45033.382170] z_wr_int_6 283001 6570262.272735 2 100 0.000000 0.005439 0.000000 0 / 2018-04-08 13:25:50 [45033.393763] 2018-04-08 13:25:50 [45033.395616] cpu#5, 3200.000 MHz 2018-04-08 13:25:50 [45033.399114] .nr_running : 0 2018-04-08 13:25:50 [45033.404079] .load : 0 2018-04-08 13:25:50 [45033.409045] .nr_switches : 650168938 2018-04-08 13:25:50 [45033.414698] .nr_load_updates : 15730227 2018-04-08 13:25:50 [45033.420265] .nr_uninterruptible : -229 2018-04-08 13:25:50 [45033.425481] .next_balance : 4339.809831 2018-04-08 13:25:50 [45033.431299] .curr->pid : 0 2018-04-08 13:25:50 [45033.436248] .clock : 45033435.340788 2018-04-08 13:25:50 [45033.442403] .cpu_load[0] : 0 2018-04-08 13:25:50 [45033.447345] .cpu_load[1] : 0 2018-04-08 13:25:50 [45033.452288] .cpu_load[2] : 0 2018-04-08 13:25:50 [45033.457224] .cpu_load[3] : 0 2018-04-08 13:25:50 [45033.462156] .cpu_load[4] : 0 2018-04-08 13:25:50 [45033.467076] .avg_idle : 1000000 2018-04-08 13:25:50 [45033.472507] .max_idle_balance_cost : 500000 2018-04-08 13:25:50 [45033.477845] 2018-04-08 13:25:50 [45033.477845] cfs_rq[5]:/ 2018-04-08 13:25:50 [45033.482342] .exec_clock : 0.000000 2018-04-08 13:25:50 [45033.487841] .MIN_vruntime : 0.000001 2018-04-08 13:25:50 [45033.493335] .min_vruntime : 4363579.724635 2018-04-08 13:25:50 [45033.499346] .max_vruntime : 0.000001 2018-04-08 13:25:50 [45033.504842] .spread : 0.000000 2018-04-08 13:25:50 [45033.510332] .spread0 : -2803057.866046 2018-04-08 13:25:50 [45033.516427] .nr_spread_over : 0 2018-04-08 13:25:50 [45033.521311] .nr_running : 0 2018-04-08 13:25:50 [45033.526193] .load : 0 2018-04-08 13:25:50 [45033.531075] .runnable_load_avg : 0 2018-04-08 13:25:50 [45033.535955] .blocked_load_avg : 65 2018-04-08 13:25:50 [45033.540920] .tg_load_avg : 0 2018-04-08 13:25:50 [45033.545794] .tg_load_contrib : 0 2018-04-08 13:25:50 [45033.550666] .tg_runnable_contrib : 0 2018-04-08 13:25:50 [45033.555539] .tg->runnable_avg : 0 2018-04-08 13:25:50 [45033.560407] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:50 [45033.565270] .throttled : 0 2018-04-08 13:25:50 [45033.570136] .throttle_count : 0 2018-04-08 13:25:50 [45033.574998] .avg->runnable_avg_sum : 1556 2018-04-08 13:25:50 [45033.580114] .avg->runnable_avg_period : 47322 2018-04-08 13:25:50 [45033.585313] 2018-04-08 13:25:50 [45033.585313] rt_rq[5]:/ 2018-04-08 13:25:50 [45033.589599] .rt_nr_running : 0 2018-04-08 13:25:50 [45033.594433] .rt_throttled : 0 2018-04-08 13:25:50 [45033.599266] .rt_time : 0.000000 2018-04-08 13:25:50 [45033.604703] .rt_runtime : 950.000000 2018-04-08 13:25:50 [45033.610314] 2018-04-08 13:25:50 [45033.610314] runnable tasks: 2018-04-08 13:25:50 [45033.610314] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:51 [45033.610314] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:51 [45033.636857] systemd 1 4363579.724635 41181 120 0.000000 10486.754507 0.000000 1 / 2018-04-08 13:25:51 [45033.648241] migration/5 34 0.000000 737 0 0.000000 1135.136757 0.000000 1 / 2018-04-08 13:25:51 [45033.659641] ksoftirqd/5 35 4363225.205575 18126 120 0.000000 91.034716 0.000000 1 / 2018-04-08 13:25:51 [45033.671033] kworker/5:0H 37 9507.000129 9 100 0.000000 0.026295 0.000000 1 / 2018-04-08 13:25:51 [45033.682423] kworker/u898:1 119 4300054.936480 329 120 0.000000 33.719788 0.000000 1 / 2018-04-08 13:25:51 [45033.693821] kworker/5:1 122 4363567.745473 28842 120 0.000000 638.927741 0.000000 1 / 2018-04-08 13:25:51 [45033.705225] scsi_eh_0 336 1047.151397 2 120 0.000000 0.005978 0.000000 1 / 2018-04-08 13:25:51 [45033.716635] scsi_tmf_0 337 1059.156712 2 100 0.000000 0.005958 0.000000 1 / 2018-04-08 13:25:51 [45033.728036] scsi_eh_2 348 1245.950817 22 120 0.000000 0.147930 0.000000 1 / 2018-04-08 13:25:51 [45033.739443] scsi_eh_12 382 1246.182717 22 120 0.000000 0.352351 0.000000 1 / 2018-04-08 13:25:51 [45033.750868] bnx2x 399 1161.823977 2 100 0.000000 0.006552 0.000000 1 / 2018-04-08 13:25:51 [45033.762284] kworker/5:2 605 14581.091341 8 120 0.000000 0.054535 0.000000 1 / 2018-04-08 13:25:51 [45033.773695] spl_dynamic_tas 3615 4294673.079376 253318 100 0.000000 1045.997752 0.000000 1 / 2018-04-08 13:25:51 [45033.785132] kworker/5:1H 6146 4363567.724642 18252 100 0.000000 24.618011 0.000000 1 / 2018-04-08 13:25:51 [45033.796575] kdmflush 7794 11486.700332 2 100 0.000000 0.006199 0.000000 1 / 2018-04-08 13:25:51 [45033.808026] arc_prune 8666 12702.536471 2 120 0.000000 0.009982 0.000000 1 / 2018-04-08 13:25:51 [45033.819467] kdmwork-253:14 9259 4363567.730509 46462 120 0.000000 1018.692500 0.000000 1 / 2018-04-08 13:25:51 [45033.830927] ntpd 14369 4356458.326212 1355 120 0.000000 83.039600 0.000000 1 / 2018-04-08 13:25:51 [45033.842385] sssd_pam 14469 4362703.397079 9016 120 0.000000 166.965476 0.000000 1 / 2018-04-08 13:25:51 [45033.853840] z_rd_int_5 19337 132019.661374 610 100 0.000000 7.337444 0.000000 1 / 2018-04-08 13:25:51 [45033.865295] z_wr_iss 19341 151649.986877 206 101 0.000000 21.392046 0.000000 1 / 2018-04-08 13:25:51 [45033.876765] z_wr_int_3 19356 151649.982963 986 100 0.000000 9.821276 0.000000 1 / 2018-04-08 13:25:51 [45033.888243] z_wr_iss 20550 25507.946463 166 101 0.000000 7.712882 0.000000 1 / 2018-04-08 13:25:51 [45033.899726] dp_sync_taskq 20597 25509.128572 142 139 0.000000 2.746740 0.000000 1 / 2018-04-08 13:25:51 [45033.911209] z_null_int 21246 4363567.724826 91267 100 0.000000 624.475122 0.000000 1 / 2018-04-08 13:25:51 [45033.922695] z_rd_int_5 21253 4294434.211821 777 100 0.000000 9.471433 0.000000 1 / 2018-04-08 13:25:51 [45033.934182] z_zvol 21291 19624.599019 18 120 0.000000 0.889776 0.000000 1 / 2018-04-08 13:25:51 [45033.945675] z_ioctl_int 21894 4294673.072260 1716 100 0.000000 7.781246 0.000000 1 / 2018-04-08 13:25:51 [45033.957169] dp_sync_taskq 21908 4294663.540594 6793 139 0.000000 129.893230 0.000000 1 / 2018-04-08 13:25:51 [45033.968670] dp_sync_taskq 21910 4294662.357670 6913 139 0.000000 131.870929 0.000000 1 / 2018-04-08 13:25:51 [45033.980165] z_rd_int_0 22430 3645166.600829 1845 100 0.000000 20.985865 0.000000 1 / 2018-04-08 13:25:51 [45033.991676] z_rd_int_3 22433 3645545.625879 1944 100 0.000000 21.137362 0.000000 1 / 2018-04-08 13:25:51 [45034.003179] z_rd_int_7 22437 3645545.625742 1845 100 0.000000 20.695441 0.000000 1 / 2018-04-08 13:25:51 [45034.014676] z_wr_int_2 22453 4260656.676461 3373 100 0.000000 29.964021 0.000000 1 / 2018-04-08 13:25:51 [45034.026179] ptlrpcd_01_01 23095 4363221.411240 11563 120 0.000000 181.602987 0.000000 1 / 2018-04-08 13:25:51 [45034.037689] ptlrpcd_01_04 23098 4363221.427757 11389 120 0.000000 181.198109 0.000000 1 / 2018-04-08 13:25:51 [45034.049195] ldlm_cn01_002 23119 4359539.106027 57911 120 0.000000 529.990107 0.000000 1 / 2018-04-08 13:25:51 [45034.060706] mgs_dagg_notify 23156 23224.102951 54 118 0.000000 4.473876 0.000000 1 / 2018-04-08 13:25:51 [45034.072219] mdt_out01_000 24022 3912464.297484 459073982 120 0.000000 9274455.790561 0.000000 1 / 2018-04-08 13:25:51 [45034.083744] lquota_wb_home- 25500 4362682.956085 799 120 0.000000 10.344363 0.000000 1 / 2018-04-08 13:25:51 [45034.095266] tx_commit_cb 25905 4294673.091310 642 120 0.000000 255.932041 0.000000 1 / 2018-04-08 13:25:51 [45034.106812] osp-syn-0-0 26737 24575.612851 4 120 0.000000 0.230843 0.000000 1 / 2018-04-08 13:25:51 [45034.118369] osp-pre-2-0 26748 4363221.399863 8811 120 0.000000 157.616387 0.000000 1 / 2018-04-08 13:25:51 [45034.129927] osp-pre-8-1 28747 22103.335515 4 120 0.000000 0.025829 0.000000 1 / 2018-04-08 13:25:51 [45034.141476] dist_txn-1 29205 21839.262329 2 120 0.000000 0.016729 0.000000 1 / 2018-04-08 13:25:51 [45034.153029] osp-pre-3-2 30430 24791.567341 4 120 0.000000 0.032894 0.000000 1 / 2018-04-08 13:25:51 [45034.164577] osp-pre-9-2 30543 23333.168474 4 120 0.000000 0.024717 0.000000 1 / 2018-04-08 13:25:51 [45034.176122] osp-pre-10-2 30554 23333.162449 4 120 0.000000 0.026636 0.000000 1 / 2018-04-08 13:25:51 [45034.187653] z_wr_int_4 30990 22359.626823 3 100 0.000000 0.012630 0.000000 1 / 2018-04-08 13:25:51 [45034.199183] z_wr_int_2 31036 22383.630361 2 100 0.000000 0.008464 0.000000 1 / 2018-04-08 13:25:51 [45034.210712] z_wr_int_7 31039 22407.908460 2 100 0.000000 0.004821 0.000000 1 / 2018-04-08 13:25:51 [45034.222233] z_wr_int_7 31040 22419.910982 2 100 0.000000 0.004828 0.000000 1 / 2018-04-08 13:25:51 [45034.233742] z_wr_int_7 31041 22431.913287 2 100 0.000000 0.004535 0.000000 1 / 2018-04-08 13:25:51 [45034.245255] mdt01_012 32601 4363567.726037 860805 120 0.000000 11855.124477 0.000000 1 / 2018-04-08 13:25:51 [45034.256764] mdt_rdpg01_009 32916 4245246.342941 70894 120 0.000000 784.078371 0.000000 1 / 2018-04-08 13:25:51 [45034.268285] R mdt_out01_002 35586 4363774.157242 587571942 120 0.000000 12077864.591944 0.000000 1 / 2018-04-08 13:25:51 [45034.279792] mdt_rdpg01_015 77247 4244929.567203 106518 120 0.000000 988.266803 0.000000 1 / 2018-04-08 13:25:51 [45034.291329] 2018-04-08 13:25:51 [45034.293214] cpu#6, 3200.000 MHz 2018-04-08 13:25:51 [45034.296740] .nr_running : 1 2018-04-08 13:25:51 [45034.301736] .load : 0 2018-04-08 13:25:51 [45034.306717] .nr_switches : 631266202 2018-04-08 13:25:51 [45034.312395] .nr_load_updates : 15730121 2018-04-08 13:25:51 [45034.317977] .nr_uninterruptible : -431 2018-04-08 13:25:51 [45034.323212] .next_balance : 4339.810735 2018-04-08 13:25:51 [45034.329054] .curr->pid : 0 2018-04-08 13:25:51 [45034.334021] .clock : 45034333.154397 2018-04-08 13:25:51 [45034.340204] .cpu_load[0] : 0 2018-04-08 13:25:51 [45034.345169] .cpu_load[1] : 0 2018-04-08 13:25:51 [45034.350128] .cpu_load[2] : 0 2018-04-08 13:25:51 [45034.355085] .cpu_load[3] : 0 2018-04-08 13:25:51 [45034.360031] .cpu_load[4] : 0 2018-04-08 13:25:51 [45034.364971] .avg_idle : 11803 2018-04-08 13:25:51 [45034.370256] .max_idle_balance_cost : 500000 2018-04-08 13:25:51 [45034.375626] 2018-04-08 13:25:51 [45034.375626] cfs_rq[6]:/ 2018-04-08 13:25:51 [45034.380170] .exec_clock : 0.000000 2018-04-08 13:25:51 [45034.385702] .MIN_vruntime : 0.000001 2018-04-08 13:25:51 [45034.391222] .min_vruntime : 5218833.066595 2018-04-08 13:25:51 [45034.397264] .max_vruntime : 0.000001 2018-04-08 13:25:51 [45034.402784] .spread : 0.000000 2018-04-08 13:25:51 [45034.408297] .spread0 : -1948013.414668 2018-04-08 13:25:51 [45034.414414] .nr_spread_over : 0 2018-04-08 13:25:51 [45034.419317] .nr_running : 1 2018-04-08 13:25:51 [45034.424222] .load : 1024 2018-04-08 13:25:51 [45034.429379] .runnable_load_avg : 0 2018-04-08 13:25:51 [45034.434266] .blocked_load_avg : 0 2018-04-08 13:25:51 [45034.439153] .tg_load_avg : 0 2018-04-08 13:25:51 [45034.444030] .tg_load_contrib : 0 2018-04-08 13:25:51 [45034.448902] .tg_runnable_contrib : 0 2018-04-08 13:25:51 [45034.453776] .tg->runnable_avg : 0 2018-04-08 13:25:51 [45034.458638] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:51 [45034.463504] .throttled : 0 2018-04-08 13:25:51 [45034.468363] .throttle_count : 0 2018-04-08 13:25:51 [45034.473219] .avg->runnable_avg_sum : 20238 2018-04-08 13:25:51 [45034.478424] .avg->runnable_avg_period : 46451 2018-04-08 13:25:51 [45034.483624] 2018-04-08 13:25:51 [45034.483624] rt_rq[6]:/ 2018-04-08 13:25:51 [45034.487945] .rt_nr_running : 0 2018-04-08 13:25:51 [45034.492798] .rt_throttled : 0 2018-04-08 13:25:51 [45034.497656] .rt_time : 0.000000 2018-04-08 13:25:51 [45034.503115] .rt_runtime : 950.000000 2018-04-08 13:25:51 [45034.508739] 2018-04-08 13:25:51 [45034.508739] runnable tasks: 2018-04-08 13:25:51 [45034.508739] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:51 [45034.508739] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:51 [45034.535303] migration/6 39 0.000000 423 0 0.000000 105138.529722 0.000000 0 / 2018-04-08 13:25:51 [45034.546694] ksoftirqd/6 40 5218578.057191 109070 120 0.000000 389.400046 0.000000 0 / 2018-04-08 13:25:51 [45034.558095] kworker/6:0H 42 5235.307047 12 100 0.000000 0.028846 0.000000 0 / 2018-04-08 13:25:51 [45034.569494] netns 91 55.216684 2 100 0.000000 0.006412 0.000000 0 / 2018-04-08 13:25:51 [45034.580901] ata_sff 339 279.755864 2 100 0.000000 0.005215 0.000000 0 / 2018-04-08 13:25:51 [45034.592295] scsi_eh_10 378 415.865898 22 120 0.000000 0.255155 0.000000 0 / 2018-04-08 13:25:51 [45034.603700] nfit 1026 845.919645 2 100 0.000000 0.005341 0.000000 0 / 2018-04-08 13:25:52 [45034.615096] multipathd 4260 0.000000 9 0 0.000000 0.680801 0.000000 0 / 2018-04-08 13:25:52 [45034.626502] bioset 4005 3330.638358 2 100 0.000000 0.006137 0.000000 0 / 2018-04-08 13:25:52 [45034.637906] kdmflush 4019 3332.500190 2 100 0.000000 0.004943 0.000000 0 / 2018-04-08 13:25:52 [45034.649315] kdmflush 4157 3332.502349 2 100 0.000000 0.007365 0.000000 0 / 2018-04-08 13:25:52 [45034.660730] bioset 4163 3332.504661 2 100 0.000000 0.006788 0.000000 0 / 2018-04-08 13:25:52 [45034.672144] kdmflush 4172 3332.509288 2 100 0.000000 0.006630 0.000000 0 / 2018-04-08 13:25:52 [45034.683566] bioset 4175 3332.511507 2 100 0.000000 0.006414 0.000000 0 / 2018-04-08 13:25:52 [45034.694984] kworker/6:11 6624 10350.306819 21 120 0.000000 0.058547 0.000000 0 / 2018-04-08 13:25:52 [45034.706408] bioset 9315 5065.879039 2 100 0.000000 0.005689 0.000000 0 / 2018-04-08 13:25:52 [45034.717836] kworker/6:1H 9586 5218134.029013 100875 100 0.000000 151.898553 0.000000 0 / 2018-04-08 13:25:52 [45034.729264] sssd_nss 14468 5217312.777245 9485 120 0.000000 228.316459 0.000000 0 / 2018-04-08 13:25:52 [45034.740698] gmond 14525 5218075.743440 15681 120 0.000000 137457.550044 0.000000 0 / 2018-04-08 13:25:52 [45034.752131] kworker/6:0 17547 5218941.583444 257809 120 0.000000 4588.436552 0.000000 0 / 2018-04-08 13:25:52 [45034.763575] z_rd_int_3 18792 12691.542899 259 100 0.000000 2.692143 0.000000 0 / 2018-04-08 13:25:52 [45034.775017] z_rd_int_6 18795 12691.542693 276 100 0.000000 2.665551 0.000000 0 / 2018-04-08 13:25:52 [45034.786466] z_wr_iss 18801 12704.175637 122 101 0.000000 3.408837 0.000000 0 / 2018-04-08 13:25:52 [45034.797905] z_wr_iss 18804 12704.176060 116 101 0.000000 3.688753 0.000000 0 / 2018-04-08 13:25:52 [45034.809360] z_wr_iss 19340 137354.301451 207 101 0.000000 8.550079 0.000000 0 / 2018-04-08 13:25:52 [45034.820817] z_wr_int_4 19357 137366.302474 973 100 0.000000 9.569187 0.000000 0 / 2018-04-08 13:25:52 [45034.832269] metaslab_group_ 19377 138964.800930 40 100 0.000000 0.583223 0.000000 0 / 2018-04-08 13:25:52 [45034.843734] txg_sync 19594 5218210.575117 18099 120 0.000000 395.873790 0.000000 0 / 2018-04-08 13:25:52 [45034.855197] z_rd_int_3 19959 18705.107611 666 100 0.000000 7.199769 0.000000 0 / 2018-04-08 13:25:52 [45034.866674] z_wr_iss 19964 14092.542854 178 101 0.000000 5.256766 0.000000 0 / 2018-04-08 13:25:52 [45034.878143] metaslab_group_ 20001 14834.574237 23 100 0.000000 0.270087 0.000000 0 / 2018-04-08 13:25:52 [45034.889620] dp_sync_taskq 20007 14097.063578 96 139 0.000000 0.973087 0.000000 0 / 2018-04-08 13:25:52 [45034.901103] dp_sync_taskq 20010 14097.295107 88 139 0.000000 1.256395 0.000000 0 / 2018-04-08 13:25:52 [45034.912575] dp_sync_taskq 20012 14095.373940 146 139 0.000000 1.485431 0.000000 0 / 2018-04-08 13:25:52 [45034.924059] z_rd_int_0 21248 5136848.067696 777 100 0.000000 10.052325 0.000000 0 / 2018-04-08 13:25:52 [45034.935554] z_rd_int_3 21251 5137080.692071 817 100 0.000000 9.337464 0.000000 0 / 2018-04-08 13:25:52 [45034.947038] dp_sync_taskq 21303 14059.344327 51 139 0.000000 0.924639 0.000000 0 / 2018-04-08 13:25:52 [45034.958543] z_wr_iss 21864 5137098.600662 13942 101 0.000000 620.457213 0.000000 0 / 2018-04-08 13:25:52 [45034.970042] z_wr_iss 21869 5137098.600618 13867 101 0.000000 612.127574 0.000000 0 / 2018-04-08 13:25:52 [45034.981533] metaslab_group_ 21897 5138270.050200 734 100 0.000000 3.565535 0.000000 0 / 2018-04-08 13:25:52 [45034.993036] dp_sync_taskq 21907 5137099.827029 6885 139 0.000000 128.925067 0.000000 0 / 2018-04-08 13:25:52 [45035.004551] z_wr_iss 22439 5100030.085581 684 101 0.000000 38.411941 0.000000 0 / 2018-04-08 13:25:52 [45035.016063] z_wr_iss 22443 5100030.086999 668 101 0.000000 22.281088 0.000000 0 / 2018-04-08 13:25:52 [45035.027570] z_wr_iss 22445 5100030.086027 688 101 0.000000 21.673063 0.000000 0 / 2018-04-08 13:25:52 [45035.039076] z_ioctl_int 22472 5100042.088513 258 100 0.000000 1.135391 0.000000 0 / 2018-04-08 13:25:52 [45035.050587] ptlrpc_hr00_001 23049 417004.633136 3 120 0.000000 0.014711 0.000000 0 / 2018-04-08 13:25:52 [45035.062108] ptlrpc_hr00_002 23050 417004.631204 3 120 0.000000 0.012852 0.000000 0 / 2018-04-08 13:25:52 [45035.073604] kiblnd_sd_00_01 23075 5219102.799425 845371 120 0.000000 9140.895329 0.000000 0 / 2018-04-08 13:25:52 [45035.085102] ptlrpcd_00_02 23088 5218811.444895 75182 120 0.000000 1478.413533 0.000000 0 / 2018-04-08 13:25:52 [45035.096592] ptlrpcd_00_07 23093 5218811.519489 75552 120 0.000000 1440.223557 0.000000 0 / 2018-04-08 13:25:52 [45035.108079] ll_mgs_0000 23132 5218210.538147 101685 120 0.000000 2555.974772 0.000000 0 / 2018-04-08 13:25:52 [45035.119577] ll_mgs_0001 23133 5218210.596067 151289 120 0.000000 3952.214072 0.000000 0 / 2018-04-08 13:25:52 [45035.131067] mgs_home_notify 23142 11760.074208 34 118 0.000000 2.258901 0.000000 0 / 2018-04-08 13:25:52 [45035.142550] mgs_apps_notify 23195 11703.670086 41 118 0.000000 1.931638 0.000000 0 / 2018-04-08 13:25:52 [45035.154041] ldlm_cn00_004 23401 5085705.591788 16622 120 0.000000 211.336753 0.000000 0 / 2018-04-08 13:25:52 [45035.165540] ldlm_cn00_005 23626 5218210.541711 11146 120 0.000000 179.254333 0.000000 0 / 2018-04-08 13:25:52 [45035.177040] mdt00_000 24006 5219190.375751 99210 120 0.000000 2291.596226 0.000000 0 / 2018-04-08 13:25:52 [45035.188539] osp-syn-0-0 24100 14002.824241 4 120 0.000000 0.117074 0.000000 0 / 2018-04-08 13:25:52 [45035.200034] osp-pre-0-0 24679 5218210.542716 8821 120 0.000000 160.783829 0.000000 0 / 2018-04-08 13:25:52 [45035.211536] osp-syn-1-0 24699 12003.038052 4 120 0.000000 0.116842 0.000000 0 / 2018-04-08 13:25:52 [45035.223049] osp-pre-9-0 26787 5218210.549656 8812 120 0.000000 164.370040 0.000000 0 / 2018-04-08 13:25:52 [45035.234559] osp-syn-10-0 26796 12006.665186 4 120 0.000000 0.102745 0.000000 0 / 2018-04-08 13:25:52 [45035.246075] tx_commit_cb 27954 5086155.807230 111 120 0.000000 3.835829 0.000000 0 / 2018-04-08 13:25:52 [45035.257573] osp-pre-0-1 28706 14058.649417 4 120 0.000000 0.035174 0.000000 0 / 2018-04-08 13:25:52 [45035.269089] osp-pre-2-1 28717 14375.917374 4 120 0.000000 0.037787 0.000000 0 / 2018-04-08 13:25:52 [45035.280591] osp-pre-9-1 28751 12675.853457 4 120 0.000000 0.022811 0.000000 0 / 2018-04-08 13:25:52 [45035.292086] osp-syn-10-1 28762 12608.542351 4 120 0.000000 0.104295 0.000000 0 / 2018-04-08 13:25:52 [45035.303589] osp-syn-11-1 28769 12363.789643 4 120 0.000000 0.103893 0.000000 0 / 2018-04-08 13:25:52 [45035.315086] ldlm_bl_03 29065 5083233.457642 34420 120 0.000000 788.345084 0.000000 0 / 2018-04-08 13:25:52 [45035.326579] Rlod0001_rec0000 29210 5219319.007965 2009352040 120 0.000000 22822811.163002 0.000000 0 / 2018-04-08 13:25:52 [45035.338163] osp-syn-2-2 30427 14006.929700 7 120 0.000000 0.437688 0.000000 0 / 2018-04-08 13:25:52 [45035.349682] osp-syn-3-2 30445 14006.810012 7 120 0.000000 0.440379 0.000000 0 / 2018-04-08 13:25:52 [45035.361195] osp-syn-5-2 30480 12703.882926 6 120 0.000000 0.395022 0.000000 0 / 2018-04-08 13:25:52 [45035.372704] osp-syn-12-2 30599 12703.956582 5 120 0.000000 0.374768 0.000000 0 / 2018-04-08 13:25:52 [45035.384216] osp-syn-13-2 30620 12704.172723 6 120 0.000000 0.343792 0.000000 0 / 2018-04-08 13:25:52 [45035.395728] mdt_rdpg00_007 32923 5085705.592116 12379 120 0.000000 130.945890 0.000000 0 / 2018-04-08 13:25:52 [45035.407224] mdt_rdpg00_008 32924 5085705.840260 8141 120 0.000000 83.146617 0.000000 0 / 2018-04-08 13:25:52 [45035.418720] mdt_rdpg00_010 34595 5215825.606878 12236 120 0.000000 126.028348 0.000000 0 / 2018-04-08 13:25:52 [45035.430231] z_wr_int_4 282335 5100054.088412 2 100 0.000000 0.005489 0.000000 0 / 2018-04-08 13:25:52 [45035.441811] z_wr_int_6 282989 5137110.605108 3 100 0.000000 0.010272 0.000000 0 / 2018-04-08 13:25:52 [45035.453427] 2018-04-08 13:25:52 [45035.455294] cpu#7, 3200.000 MHz 2018-04-08 13:25:52 [45035.458802] .nr_running : 0 2018-04-08 13:25:52 [45035.463785] .load : 0 2018-04-08 13:25:52 [45035.468759] .nr_switches : 899918668 2018-04-08 13:25:52 [45035.474427] .nr_load_updates : 19981867 2018-04-08 13:25:52 [45035.480002] .nr_uninterruptible : -417 2018-04-08 13:25:52 [45035.485230] .next_balance : 4339.811909 2018-04-08 13:25:52 [45035.491062] .curr->pid : 43540 2018-04-08 13:25:52 [45035.496367] .clock : 45035496.352264 2018-04-08 13:25:52 [45035.502540] .cpu_load[0] : 1024 2018-04-08 13:25:52 [45035.507762] .cpu_load[1] : 960 2018-04-08 13:25:52 [45035.512894] .cpu_load[2] : 635 2018-04-08 13:25:52 [45035.518023] .cpu_load[3] : 890 2018-04-08 13:25:52 [45035.523147] .cpu_load[4] : 926 2018-04-08 13:25:52 [45035.528268] .avg_idle : 16785 2018-04-08 13:25:52 [45035.533554] .max_idle_balance_cost : 500000 2018-04-08 13:25:52 [45035.538924] 2018-04-08 13:25:52 [45035.538924] cfs_rq[7]:/ 2018-04-08 13:25:52 [45035.543477] .exec_clock : 0.000000 2018-04-08 13:25:52 [45035.549008] .MIN_vruntime : 0.000001 2018-04-08 13:25:52 [45035.554539] .min_vruntime : 6986227.913212 2018-04-08 13:25:52 [45035.560589] .max_vruntime : 0.000001 2018-04-08 13:25:52 [45035.566111] .spread : 0.000000 2018-04-08 13:25:52 [45035.571629] .spread0 : -180623.572887 2018-04-08 13:25:52 [45035.577659] .nr_spread_over : 0 2018-04-08 13:25:52 [45035.582569] .nr_running : 1 2018-04-08 13:25:52 [45035.587475] .load : 1024 2018-04-08 13:25:52 [45035.592633] .runnable_load_avg : 804 2018-04-08 13:25:52 [45035.597704] .blocked_load_avg : 0 2018-04-08 13:25:52 [45035.602592] .tg_load_avg : 0 2018-04-08 13:25:52 [45035.607483] .tg_load_contrib : 0 2018-04-08 13:25:53 [45035.612366] .tg_runnable_contrib : 0 2018-04-08 13:25:53 [45035.617249] .tg->runnable_avg : 0 2018-04-08 13:25:53 [45035.622132] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:53 [45035.627018] .throttled : 0 2018-04-08 13:25:53 [45035.631899] .throttle_count : 0 2018-04-08 13:25:53 [45035.636763] .avg->runnable_avg_sum : 36403 2018-04-08 13:25:53 [45035.641967] .avg->runnable_avg_period : 46237 2018-04-08 13:25:53 [45035.647174] 2018-04-08 13:25:53 [45035.647174] rt_rq[7]:/ 2018-04-08 13:25:53 [45035.651494] .rt_nr_running : 0 2018-04-08 13:25:53 [45035.656352] .rt_throttled : 0 2018-04-08 13:25:53 [45035.661202] .rt_time : 0.000000 2018-04-08 13:25:53 [45035.666657] .rt_runtime : 950.000000 2018-04-08 13:25:53 [45035.672283] 2018-04-08 13:25:53 [45035.672283] runnable tasks: 2018-04-08 13:25:53 [45035.672283] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:53 [45035.672283] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:53 [45035.698842] migration/7 44 0.000000 470 0 0.000000 1367.859002 0.000000 1 / 2018-04-08 13:25:53 [45035.710233] ksoftirqd/7 45 6986038.977129 14482 120 0.000000 89.644736 0.000000 1 / 2018-04-08 13:25:53 [45035.721625] kworker/7:0 46 6986141.050457 27999 120 0.000000 286.696075 0.000000 1 / 2018-04-08 13:25:53 [45035.733023] kworker/7:0H 47 6257.087386 9 100 0.000000 0.031096 0.000000 1 / 2018-04-08 13:25:53 [45035.744424] scsi_eh_5 354 508.178044 22 120 0.000000 0.163158 0.000000 1 / 2018-04-08 13:25:53 [45035.755828] scsi_tmf_5 355 399.200412 2 100 0.000000 0.005871 0.000000 1 / 2018-04-08 13:25:53 [45035.767241] scsi_tmf_7 359 411.206279 2 100 0.000000 0.006538 0.000000 1 / 2018-04-08 13:25:53 [45035.778651] scsi_tmf_8 375 435.784995 2 100 0.000000 0.005768 0.000000 1 / 2018-04-08 13:25:53 [45035.790054] scsi_tmf_11 381 459.796236 2 100 0.000000 0.006200 0.000000 1 / 2018-04-08 13:25:53 [45035.801462] kworker/7:1H 6162 6986038.968586 14464 100 0.000000 22.172802 0.000000 1 / 2018-04-08 13:25:53 [45035.812879] agetty 9049 11286.258980 5 120 0.000000 20.895383 0.000000 1 / 2018-04-08 13:25:53 [45035.824294] kdmwork-253:14 9259 6986038.974037 46464 120 0.000000 1018.702915 0.000000 1 / 2018-04-08 13:25:53 [45035.835710] rpcbind 15248 6984910.552526 1500 120 0.000000 54.227462 0.000000 1 / 2018-04-08 13:25:53 [45035.847126] kworker/7:1 17606 12300.725034 2 120 0.000000 0.004341 0.000000 1 / 2018-04-08 13:25:53 [45035.858555] z_wr_iss 19351 200231.220649 202 101 0.000000 9.163923 0.000000 1 / 2018-04-08 13:25:53 [45035.870001] z_wr_int_1 19354 200231.221257 935 100 0.000000 10.117480 0.000000 1 / 2018-04-08 13:25:53 [45035.881441] z_ioctl_int 19374 200231.217810 59 100 0.000000 0.272291 0.000000 1 / 2018-04-08 13:25:53 [45035.892894] z_rd_int_1 20538 19656.851914 1643 100 0.000000 13.018420 0.000000 1 / 2018-04-08 13:25:53 [45035.904326] z_rd_int_5 20542 19656.852460 1513 100 0.000000 12.242486 0.000000 1 / 2018-04-08 13:25:53 [45035.915772] z_wr_iss 20555 19379.975220 170 101 0.000000 7.216901 0.000000 1 / 2018-04-08 13:25:53 [45035.927223] z_wr_int_1 20559 19391.978841 781 100 0.000000 7.835546 0.000000 1 / 2018-04-08 13:25:53 [45035.938681] z_wr_int_3 20561 19391.980179 750 100 0.000000 7.464033 0.000000 1 / 2018-04-08 13:25:53 [45035.950137] dp_sync_taskq 20588 19380.654358 134 139 0.000000 2.147771 0.000000 1 / 2018-04-08 13:25:53 [45035.961604] dp_sync_taskq 20589 19380.242574 149 139 0.000000 2.039335 0.000000 1 / 2018-04-08 13:25:53 [45035.973059] dp_sync_taskq 20593 19384.953791 133 139 0.000000 1.817107 0.000000 1 / 2018-04-08 13:25:53 [45035.984524] dp_sync_taskq 20596 19380.218476 122 139 0.000000 2.146276 0.000000 1 / 2018-04-08 13:25:53 [45035.995991] z_rd_iss 21247 5524055.427968 16 100 0.000000 0.249684 0.000000 1 / 2018-04-08 13:25:53 [45036.007458] z_wr_iss 21266 18681.302528 63 101 0.000000 2.514816 0.000000 1 / 2018-04-08 13:25:53 [45036.018933] z_wr_int_3 21272 18681.299703 305 100 0.000000 3.081681 0.000000 1 / 2018-04-08 13:25:53 [45036.030402] dp_sync_taskq 21308 18682.619630 60 139 0.000000 0.710339 0.000000 1 / 2018-04-08 13:25:53 [45036.041873] z_rd_int_1 22431 5987789.415565 1829 100 0.000000 20.611407 0.000000 1 / 2018-04-08 13:25:53 [45036.053358] z_wr_int_0 22451 6819974.628204 3357 100 0.000000 30.567843 0.000000 1 / 2018-04-08 13:25:53 [45036.064853] mdt01_000 24009 6985894.516875 904660 120 0.000000 12786.492795 0.000000 1 / 2018-04-08 13:25:53 [45036.076344] mdt_rdpg01_001 24015 6796178.325849 17208 120 0.000000 148.441885 0.000000 1 / 2018-04-08 13:25:53 [45036.087829] mdt01_005 24567 6985894.520069 833570 120 0.000000 11754.660632 0.000000 1 / 2018-04-08 13:25:53 [45036.099333] osp-pre-5-0 26762 6985941.810415 8812 120 0.000000 168.670385 0.000000 1 / 2018-04-08 13:25:53 [45036.110826] osp-syn-5-0 26763 15196.188153 4 120 0.000000 0.108949 0.000000 1 / 2018-04-08 13:25:53 [45036.122336] osp-pre-6-1 28737 16367.921191 4 120 0.000000 0.023277 0.000000 1 / 2018-04-08 13:25:53 [45036.133837] osp-pre-4-2 30450 16959.610917 4 120 0.000000 0.025649 0.000000 1 / 2018-04-08 13:25:53 [45036.145328] osp-pre-11-2 30572 16959.614520 4 120 0.000000 0.024729 0.000000 1 / 2018-04-08 13:25:53 [45036.156829] osp-pre-15-2 30639 16959.613165 4 120 0.000000 0.021036 0.000000 1 / 2018-04-08 13:25:53 [45036.168329] mdt01_010 32594 6985941.801312 681470 120 0.000000 9108.058402 0.000000 1 / 2018-04-08 13:25:53 [45036.179842] mdt01_013 32611 6985894.517918 840042 120 0.000000 11971.355584 0.000000 1 / 2018-04-08 13:25:53 [45036.191361] mdt_rdpg01_008 32915 6796178.376413 1810 120 0.000000 19.530202 0.000000 1 / 2018-04-08 13:25:53 [45036.202887] mdt_rdpg01_010 32917 6984947.140672 492787 120 0.000000 4764.903923 0.000000 1 / 2018-04-08 13:25:53 [45036.214418] z_wr_int_4 40034 200231.217760 4 100 0.000000 0.016804 0.000000 1 / 2018-04-08 13:25:53 [45036.225947] R mdt_out01_003 43540 6986757.171359 462102556 120 0.000000 9142162.909893 0.000000 1 / 2018-04-08 13:25:53 [45036.237470] z_wr_int_5 282328 6819974.627164 4 100 0.000000 0.019537 0.000000 1 / 2018-04-08 13:25:53 [45036.249067] sshd 283060 6985893.900374 246 120 0.000000 17.371147 0.000000 1 / 2018-04-08 13:25:53 [45036.260659] kworker/u896:1 283313 6984229.602686 1399 120 0.000000 53.373019 0.000000 1 / 2018-04-08 13:25:53 [45036.272273] 2018-04-08 13:25:53 [45036.274148] cpu#8, 3200.000 MHz 2018-04-08 13:25:53 [45036.277659] .nr_running : 1 2018-04-08 13:25:53 [45036.282638] .load : 1024 2018-04-08 13:25:53 [45036.287880] .nr_switches : 808324328 2018-04-08 13:25:53 [45036.293560] .nr_load_updates : 18883373 2018-04-08 13:25:53 [45036.299153] .nr_uninterruptible : -188 2018-04-08 13:25:53 [45036.304397] .next_balance : 4339.812721 2018-04-08 13:25:53 [45036.310238] .curr->pid : 890 2018-04-08 13:25:53 [45036.315387] .clock : 45036315.385461 2018-04-08 13:25:53 [45036.321565] .cpu_load[0] : 0 2018-04-08 13:25:53 [45036.326531] .cpu_load[1] : 0 2018-04-08 13:25:53 [45036.331487] .cpu_load[2] : 0 2018-04-08 13:25:53 [45036.336445] .cpu_load[3] : 0 2018-04-08 13:25:53 [45036.341395] .cpu_load[4] : 0 2018-04-08 13:25:53 [45036.346340] .avg_idle : 1000000 2018-04-08 13:25:53 [45036.351804] .max_idle_balance_cost : 500000 2018-04-08 13:25:53 [45036.357181] 2018-04-08 13:25:53 [45036.357181] cfs_rq[8]:/ 2018-04-08 13:25:53 [45036.361738] .exec_clock : 0.000000 2018-04-08 13:25:53 [45036.367278] .MIN_vruntime : 0.000001 2018-04-08 13:25:53 [45036.372812] .min_vruntime : 7016397.071078 2018-04-08 13:25:53 [45036.378863] .max_vruntime : 0.000001 2018-04-08 13:25:53 [45036.384395] .spread : 0.000000 2018-04-08 13:25:53 [45036.389923] .spread0 : -150763.261875 2018-04-08 13:25:53 [45036.395970] .nr_spread_over : 0 2018-04-08 13:25:53 [45036.400889] .nr_running : 0 2018-04-08 13:25:53 [45036.405803] .load : 0 2018-04-08 13:25:53 [45036.410710] .runnable_load_avg : 0 2018-04-08 13:25:53 [45036.415617] .blocked_load_avg : 0 2018-04-08 13:25:53 [45036.420513] .tg_load_avg : 0 2018-04-08 13:25:53 [45036.425408] .tg_load_contrib : 0 2018-04-08 13:25:53 [45036.430297] .tg_runnable_contrib : 0 2018-04-08 13:25:53 [45036.435177] .tg->runnable_avg : 0 2018-04-08 13:25:53 [45036.440057] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:53 [45036.444936] .throttled : 0 2018-04-08 13:25:53 [45036.449819] .throttle_count : 0 2018-04-08 13:25:53 [45036.454691] .avg->runnable_avg_sum : 51 2018-04-08 13:25:53 [45036.459655] .avg->runnable_avg_period : 47982 2018-04-08 13:25:53 [45036.464874] 2018-04-08 13:25:53 [45036.464874] rt_rq[8]:/ 2018-04-08 13:25:53 [45036.469222] .rt_nr_running : 0 2018-04-08 13:25:53 [45036.474089] .rt_throttled : 0 2018-04-08 13:25:53 [45036.478949] .rt_time : 0.000000 2018-04-08 13:25:53 [45036.484405] .rt_runtime : 950.000000 2018-04-08 13:25:53 [45036.490024] 2018-04-08 13:25:53 [45036.490024] runnable tasks: 2018-04-08 13:25:53 [45036.490024] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:53 [45036.490024] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:53 [45036.516569] migration/8 49 0.000000 304 0 0.000000 942.327224 0.000000 0 / 2018-04-08 13:25:53 [45036.527948] ksoftirqd/8 50 7016342.077707 82485 120 0.000000 305.698856 0.000000 0 / 2018-04-08 13:25:53 [45036.539341] kworker/8:0H 52 4851.050175 11 100 0.000000 0.024509 0.000000 0 / 2018-04-08 13:25:53 [45036.550740] khugepaged 109 7015821.058636 4522 139 0.000000 150.168756 0.000000 0 / 2018-04-08 13:25:53 [45036.562139] kpsmoused 125 1169.139878 2 100 0.000000 0.005028 0.000000 0 / 2018-04-08 13:25:53 [45036.573544] ipv6_addrconf 126 1181.144085 2 100 0.000000 0.004580 0.000000 0 / 2018-04-08 13:25:53 [45036.584947] deferwq 145 1265.467631 2 100 0.000000 0.008172 0.000000 0 / 2018-04-08 13:25:53 [45036.596353] scsi_eh_7 358 1405.804904 22 120 0.000000 0.142793 0.000000 0 / 2018-04-08 13:25:54 [45036.607749] scsi_eh_13 384 1405.920379 22 120 0.000000 0.262802 0.000000 0 / 2018-04-08 13:25:54 [45036.619137] kworker/8:1 413 7720.383371 246 120 0.000000 1.815674 0.000000 0 / 2018-04-08 13:25:54 [45036.630544] systemd-journal 890 7016386.046173 16171 120 0.000000 406.351171 0.000000 0 / 2018-04-08 13:25:54 [45036.641966] multipathd 4266 0.000000 11 0 0.000000 1.085092 0.000000 0 / 2018-04-08 13:25:54 [45036.653396] kdmwork-253:6 4209 7016166.729077 98627 120 0.000000 1257.224711 0.000000 0 / 2018-04-08 13:25:54 [45036.664833] kdmwork-253:8 4230 7016385.084154 50772 120 0.000000 925.071078 0.000000 0 / 2018-04-08 13:25:54 [45036.676267] kworker/8:4 7062 7016385.073952 36314 120 0.000000 217.989894 0.000000 0 / 2018-04-08 13:25:54 [45036.687715] rs:main Q:Reg 8907 7016385.341203 18784 120 0.000000 288.928713 0.000000 0 / 2018-04-08 13:25:54 [45036.699153] master 9169 7011253.808412 2615 120 0.000000 73.043753 0.000000 0 / 2018-04-08 13:25:54 [45036.710597] kdmflush 9305 4569.108255 2 100 0.000000 0.004362 0.000000 0 / 2018-04-08 13:25:54 [45036.722030] bioset 9388 4620.377431 2 100 0.000000 0.005140 0.000000 0 / 2018-04-08 13:25:54 [45036.733478] kworker/8:1H 9891 7016385.071092 90257 100 0.000000 130.936647 0.000000 0 / 2018-04-08 13:25:54 [45036.744930] irqbalance 14463 7016169.326523 4514 120 0.000000 12137.681497 0.000000 0 / 2018-04-08 13:25:54 [45036.756390] z_rd_int_1 18790 9831.378247 262 100 0.000000 2.822767 0.000000 0 / 2018-04-08 13:25:54 [45036.767843] z_rd_int_2 18791 9831.379135 271 100 0.000000 3.002021 0.000000 0 / 2018-04-08 13:25:54 [45036.779309] z_rd_int_7 18796 9831.378163 264 100 0.000000 2.667617 0.000000 0 / 2018-04-08 13:25:54 [45036.790779] z_wr_iss 18805 9899.395996 118 101 0.000000 3.934584 0.000000 0 / 2018-04-08 13:25:54 [45036.802248] z_wr_int_4 18814 9911.397504 744 100 0.000000 6.013190 0.000000 0 / 2018-04-08 13:25:54 [45036.813727] z_null_iss 19329 7016385.071602 89013 100 0.000000 4130.962556 0.000000 0 / 2018-04-08 13:25:54 [45036.825194] z_rd_int_3 19335 5836040.389256 593 100 0.000000 8.390229 0.000000 0 / 2018-04-08 13:25:54 [45036.836679] z_wr_iss 19349 204676.791512 207 101 0.000000 8.841718 0.000000 0 / 2018-04-08 13:25:54 [45036.848172] z_wr_int_5 19358 204700.799219 949 100 0.000000 9.430200 0.000000 0 / 2018-04-08 13:25:54 [45036.859669] dp_sync_taskq 19385 204677.280209 148 139 0.000000 2.058874 0.000000 0 / 2018-04-08 13:25:54 [45036.871160] dp_sync_taskq 19386 204685.296829 146 139 0.000000 2.787665 0.000000 0 / 2018-04-08 13:25:54 [45036.882644] dp_sync_taskq 19391 204682.318834 148 139 0.000000 1.996513 0.000000 0 / 2018-04-08 13:25:54 [45036.894144] z_null_iss 19953 7016385.071620 88998 100 0.000000 4379.638665 0.000000 0 / 2018-04-08 13:25:54 [45036.905637] z_rd_int_5 19961 17582.234565 695 100 0.000000 7.219828 0.000000 0 / 2018-04-08 13:25:54 [45036.917139] z_wr_iss 19966 10868.266405 176 101 0.000000 5.532624 0.000000 0 / 2018-04-08 13:25:54 [45036.928641] z_wr_int_2 19979 10868.264060 647 100 0.000000 6.683212 0.000000 0 / 2018-04-08 13:25:54 [45036.940150] z_wr_int_4 19981 10868.266862 634 100 0.000000 6.477428 0.000000 0 / 2018-04-08 13:25:54 [45036.951666] dp_sync_taskq 20005 10869.964069 135 139 0.000000 1.442656 0.000000 0 / 2018-04-08 13:25:54 [45036.963179] dp_sync_taskq 20011 10871.784008 104 139 0.000000 1.320088 0.000000 0 / 2018-04-08 13:25:54 [45036.974678] dp_sync_taskq 20014 10869.858128 142 139 0.000000 1.262731 0.000000 0 / 2018-04-08 13:25:54 [45036.986177] txg_sync 20187 7016050.249573 18028 120 0.000000 386.273483 0.000000 0 / 2018-04-08 13:25:54 [45036.997700] z_rd_iss 20536 17582.233247 27 100 0.000000 0.382637 0.000000 0 / 2018-04-08 13:25:54 [45037.009232] z_zvol 20580 7951.558233 13 120 0.000000 1.369214 0.000000 0 / 2018-04-08 13:25:54 [45037.020757] z_wr_iss 21256 10553.990619 73 101 0.000000 2.755314 0.000000 0 / 2018-04-08 13:25:54 [45037.032285] z_wr_int_0 21873 6884398.432445 45623 100 0.000000 551.425966 0.000000 0 / 2018-04-08 13:25:54 [45037.043824] z_wr_iss 22441 6825086.950984 675 101 0.000000 23.718878 0.000000 0 / 2018-04-08 13:25:54 [45037.055339] dp_sync_taskq 22480 6825087.145734 778 139 0.000000 5.674628 0.000000 0 / 2018-04-08 13:25:54 [45037.066844] dp_sync_taskq 22482 6825087.405693 774 139 0.000000 5.141750 0.000000 0 / 2018-04-08 13:25:54 [45037.078340] dp_sync_taskq 22483 6825088.076479 782 139 0.000000 5.418341 0.000000 0 / 2018-04-08 13:25:54 [45037.089854] dp_sync_taskq 22486 6825087.252434 787 139 0.000000 5.435437 0.000000 0 / 2018-04-08 13:25:54 [45037.101354] dp_sync_taskq 22490 6825089.583414 789 139 0.000000 5.323523 0.000000 0 / 2018-04-08 13:25:54 [45037.112861] ptlrpcd_00_01 23087 7016166.724038 75225 120 0.000000 1445.472115 0.000000 0 / 2018-04-08 13:25:54 [45037.124362] ldlm_bl_01 23120 7016213.880426 30037 120 0.000000 632.822611 0.000000 0 / 2018-04-08 13:25:54 [45037.135864] mdt_fld_0001 24029 17698.485292 11 120 0.000000 0.358684 0.000000 0 / 2018-04-08 13:25:54 [45037.147370] mdt00_006 26015 7016385.103934 92444 120 0.000000 2064.489521 0.000000 0 / 2018-04-08 13:25:54 [45037.158873] osp-pre-7-0 26772 7016051.951419 8812 120 0.000000 172.175907 0.000000 0 / 2018-04-08 13:25:54 [45037.170388] osp-syn-8-0 26781 8995.239580 4 120 0.000000 0.108708 0.000000 0 / 2018-04-08 13:25:54 [45037.181895] osp-syn-1-1 28712 10322.316410 4 120 0.000000 0.115017 0.000000 0 / 2018-04-08 13:25:54 [45037.193387] osp-syn-3-1 28726 10666.222951 4 120 0.000000 0.111571 0.000000 0 / 2018-04-08 13:25:54 [45037.204882] osp-pre-7-1 28741 9831.350045 4 120 0.000000 0.022026 0.000000 0 / 2018-04-08 13:25:54 [45037.216372] osp-pre-11-1 28766 9824.780810 4 120 0.000000 0.023597 0.000000 0 / 2018-04-08 13:25:54 [45037.227870] ldlm_cb00_002 29064 9824.781335 3 120 0.000000 0.067237 0.000000 0 / 2018-04-08 13:25:54 [45037.239357] Rlod0001_rec0000 29210 7016410.354957 2009441447 120 0.000000 22823793.825115 0.000000 0 / 2018-04-08 13:25:54 [45037.250948] osp-pre-2-2 30416 10638.036859 4 120 0.000000 0.102427 0.000000 0 / 2018-04-08 13:25:54 [45037.262446] osp-pre-13-2 30609 10007.432089 4 120 0.000000 0.023139 0.000000 0 / 2018-04-08 13:25:54 [45037.273954] lquota_wb_dagg- 31308 7011700.167994 738 120 0.000000 8.518680 0.000000 0 / 2018-04-08 13:25:54 [45037.285461] mdt00_009 32612 7016385.179965 92146 120 0.000000 2103.254606 0.000000 0 / 2018-04-08 13:25:54 [45037.296959] mdt_rdpg00_009 32925 6799332.985163 6648 120 0.000000 72.706056 0.000000 0 / 2018-04-08 13:25:54 [45037.308456] mdt_rdpg00_012 34604 6882981.226170 5224 120 0.000000 54.083261 0.000000 0 / 2018-04-08 13:25:54 [45037.319959] z_wr_int_5 40051 204724.799556 2 100 0.000000 0.005603 0.000000 0 / 2018-04-08 13:25:54 [45037.331470] tx_commit_cb 274911 6884398.443146 13 120 0.000000 2.665761 0.000000 0 / 2018-04-08 13:25:54 [45037.343067] mdt_rdpg00_018 276876 6799332.786064 38 120 0.000000 1.472410 0.000000 0 / 2018-04-08 13:25:54 [45037.354664] tx_commit_cb 281691 6799743.590830 5 120 0.000000 0.060067 0.000000 0 / 2018-04-08 13:25:54 [45037.366287] 2018-04-08 13:25:54 [45037.368161] cpu#9, 3200.000 MHz 2018-04-08 13:25:54 [45037.371680] .nr_running : 0 2018-04-08 13:25:54 [45037.376670] .load : 0 2018-04-08 13:25:54 [45037.381651] .nr_switches : 934438676 2018-04-08 13:25:54 [45037.387325] .nr_load_updates : 20705590 2018-04-08 13:25:54 [45037.392909] .nr_uninterruptible : -105 2018-04-08 13:25:54 [45037.398144] .next_balance : 4339.813810 2018-04-08 13:25:54 [45037.403989] .curr->pid : 35586 2018-04-08 13:25:54 [45037.409311] .clock : 45037409.300992 2018-04-08 13:25:54 [45037.415501] .cpu_load[0] : 0 2018-04-08 13:25:54 [45037.420470] .cpu_load[1] : 1 2018-04-08 13:25:54 [45037.425436] .cpu_load[2] : 15 2018-04-08 13:25:54 [45037.430491] .cpu_load[3] : 64 2018-04-08 13:25:54 [45037.435537] .cpu_load[4] : 144 2018-04-08 13:25:54 [45037.440664] .avg_idle : 157587 2018-04-08 13:25:54 [45037.446048] .max_idle_balance_cost : 500000 2018-04-08 13:25:54 [45037.451430] 2018-04-08 13:25:54 [45037.451430] cfs_rq[9]:/ 2018-04-08 13:25:54 [45037.456005] .exec_clock : 0.000000 2018-04-08 13:25:54 [45037.461541] .MIN_vruntime : 0.000001 2018-04-08 13:25:54 [45037.467080] .min_vruntime : 7081528.701782 2018-04-08 13:25:54 [45037.473134] .max_vruntime : 0.000001 2018-04-08 13:25:54 [45037.478674] .spread : 0.000000 2018-04-08 13:25:54 [45037.484205] .spread0 : -85649.364711 2018-04-08 13:25:54 [45037.490170] .nr_spread_over : 0 2018-04-08 13:25:54 [45037.495093] .nr_running : 0 2018-04-08 13:25:54 [45037.500006] .load : 0 2018-04-08 13:25:54 [45037.504922] .runnable_load_avg : 0 2018-04-08 13:25:54 [45037.509829] .blocked_load_avg : 0 2018-04-08 13:25:54 [45037.514734] .tg_load_avg : 0 2018-04-08 13:25:54 [45037.519632] .tg_load_contrib : 0 2018-04-08 13:25:54 [45037.524533] .tg_runnable_contrib : 0 2018-04-08 13:25:54 [45037.529432] .tg->runnable_avg : 0 2018-04-08 13:25:54 [45037.534325] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:54 [45037.539220] .throttled : 0 2018-04-08 13:25:54 [45037.544111] .throttle_count : 0 2018-04-08 13:25:54 [45037.548993] .avg->runnable_avg_sum : 1626 2018-04-08 13:25:54 [45037.554127] .avg->runnable_avg_period : 47849 2018-04-08 13:25:54 [45037.559348] 2018-04-08 13:25:54 [45037.559348] rt_rq[9]:/ 2018-04-08 13:25:54 [45037.563688] .rt_nr_running : 0 2018-04-08 13:25:54 [45037.568549] .rt_throttled : 0 2018-04-08 13:25:54 [45037.573404] .rt_time : 0.000000 2018-04-08 13:25:54 [45037.578856] .rt_runtime : 950.000000 2018-04-08 13:25:54 [45037.584476] 2018-04-08 13:25:54 [45037.584476] runnable tasks: 2018-04-08 13:25:54 [45037.584476] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:54 [45037.584476] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:55 [45037.611026] migration/9 54 0.000000 468 0 0.000000 938.284337 0.000000 1 / 2018-04-08 13:25:55 [45037.622417] ksoftirqd/9 55 7081516.706827 14554 120 0.000000 72.639830 0.000000 1 / 2018-04-08 13:25:55 [45037.633810] kworker/9:0H 57 8061.819733 8 100 0.000000 0.022031 0.000000 1 / 2018-04-08 13:25:55 [45037.645203] scsi_tmf_3 351 1146.446150 2 100 0.000000 0.006843 0.000000 1 / 2018-04-08 13:25:55 [45037.656607] scsi_tmf_9 377 1204.370640 2 100 0.000000 0.005378 0.000000 1 / 2018-04-08 13:25:55 [45037.668000] scsi_tmf_10 379 1216.374948 2 100 0.000000 0.004953 0.000000 1 / 2018-04-08 13:25:55 [45037.679405] scsi_tmf_12 383 1248.390805 2 100 0.000000 0.005731 0.000000 1 / 2018-04-08 13:25:55 [45037.690790] scsi_tmf_14 387 1272.401301 2 100 0.000000 0.005938 0.000000 1 / 2018-04-08 13:25:55 [45037.702175] kworker/9:2 572 7081493.749769 31381 120 0.000000 283.602462 0.000000 1 / 2018-04-08 13:25:55 [45037.713584] kdmwork-253:0 4007 7081516.708595 46701 120 0.000000 1020.525346 0.000000 1 / 2018-04-08 13:25:55 [45037.724991] kdmwork-253:9 4239 7081516.705540 51847 120 0.000000 928.989433 0.000000 1 / 2018-04-08 13:25:55 [45037.736401] kworker/9:1H 8178 7081543.594390 14441 100 0.000000 21.757254 0.000000 1 / 2018-04-08 13:25:55 [45037.747819] kdmwork-253:14 9259 7081543.460858 46467 120 0.000000 1018.717494 0.000000 1 / 2018-04-08 13:25:55 [45037.759235] irq/103-hfi1_0 14365 0.000000 4 49 0.000000 9.179610 0.000000 1 / 2018-04-08 13:25:55 [45037.770664] sssd_pam 14469 7081407.853137 9018 120 0.000000 166.985510 0.000000 1 / 2018-04-08 13:25:55 [45037.782097] z_null_int 18787 7081516.701830 89466 100 0.000000 602.127663 0.000000 1 / 2018-04-08 13:25:55 [45037.793530] mmp 18939 7081516.708842 89000 120 0.000000 1305.862681 0.000000 1 / 2018-04-08 13:25:55 [45037.804971] z_wr_iss 19348 236136.578689 203 101 0.000000 8.319543 0.000000 1 / 2018-04-08 13:25:55 [45037.816416] z_rd_int_2 20539 26331.300994 1542 100 0.000000 12.354687 0.000000 1 / 2018-04-08 13:25:55 [45037.827865] z_rd_int_7 20544 26331.301490 1586 100 0.000000 12.895108 0.000000 1 / 2018-04-08 13:25:55 [45037.839314] z_wr_iss 20554 26210.269342 158 101 0.000000 6.167802 0.000000 1 / 2018-04-08 13:25:55 [45037.850773] dp_sync_taskq 20587 26211.846784 141 139 0.000000 1.773602 0.000000 1 / 2018-04-08 13:25:55 [45037.862221] kworker/9:1 21172 14538.835659 2 120 0.000000 0.005068 0.000000 1 / 2018-04-08 13:25:55 [45037.873682] z_wr_iss 21258 25458.234593 69 101 0.000000 2.515445 0.000000 1 / 2018-04-08 13:25:55 [45037.885150] z_wr_iss 21264 25458.236467 74 101 0.000000 2.767678 0.000000 1 / 2018-04-08 13:25:55 [45037.896614] metaslab_group_ 21293 26082.382613 21 100 0.000000 0.221753 0.000000 1 / 2018-04-08 13:25:55 [45037.908091] dp_sync_taskq 21299 25461.886520 57 139 0.000000 0.571535 0.000000 1 / 2018-04-08 13:25:55 [45037.919568] dp_sync_taskq 21300 25466.660816 55 139 0.000000 0.535194 0.000000 1 / 2018-04-08 13:25:55 [45037.931041] dp_sync_taskq 21304 25467.013675 57 139 0.000000 0.519326 0.000000 1 / 2018-04-08 13:25:55 [45037.942523] z_wr_iss 21871 6977324.242706 13928 101 0.000000 620.017950 0.000000 1 / 2018-04-08 13:25:55 [45037.954013] dp_sync_taskq 21901 6977325.600940 6949 139 0.000000 132.968496 0.000000 1 / 2018-04-08 13:25:55 [45037.965503] ptlrpcd_01_01 23095 7081492.686322 11565 120 0.000000 181.654685 0.000000 1 / 2018-04-08 13:25:55 [45037.976995] ldlm_cb01_001 23113 23482.917673 6 120 0.000000 0.072018 0.000000 1 / 2018-04-08 13:25:55 [45037.988477] ldlm_cn01_001 23118 7074294.543974 574846 120 0.000000 4222.688848 0.000000 1 / 2018-04-08 13:25:55 [45037.999958] ldlm_cn01_004 23402 6895529.995421 403664 120 0.000000 2968.781487 0.000000 1 / 2018-04-08 13:25:55 [45038.011454] mdt01_003 24252 7079657.053566 878098 120 0.000000 12234.010103 0.000000 1 / 2018-04-08 13:25:55 [45038.022951] osp-syn-3-0 26752 26110.002722 8 120 0.000000 0.219028 0.000000 1 / 2018-04-08 13:25:55 [45038.034455] z_rd_int_5 30343 19931.947541 2 100 0.000000 0.006323 0.000000 1 / 2018-04-08 13:25:55 [45038.045968] z_rd_int_5 30344 19943.950201 2 100 0.000000 0.005205 0.000000 1 / 2018-04-08 13:25:55 [45038.057488] z_rd_int_5 30349 20003.964449 2 100 0.000000 0.005224 0.000000 1 / 2018-04-08 13:25:55 [45038.068988] osp-pre-14-2 30621 24335.094902 4 120 0.000000 0.021300 0.000000 1 / 2018-04-08 13:25:55 [45038.080508] mdt_rdpg01_013 32920 6895364.164487 7514 120 0.000000 80.229461 0.000000 1 / 2018-04-08 13:25:55 [45038.092035] mdt_out01_002 35586 7081887.629342 587620055 120 0.000000 12079138.800751 0.000000 1 / 2018-04-08 13:25:55 [45038.103549] tx_commit_cb 276394 6976820.447379 8 120 0.000000 0.745769 0.000000 1 / 2018-04-08 13:25:55 [45038.115179] z_wr_int_1 282983 6977396.695263 3 100 0.000000 0.008621 0.000000 1 / 2018-04-08 13:25:55 [45038.126803] z_wr_int_1 282985 6977348.684055 2 100 0.000000 0.005932 0.000000 1 / 2018-04-08 13:25:55 [45038.138422] z_wr_int_6 282988 6977408.700453 3 100 0.000000 0.010851 0.000000 1 / 2018-04-08 13:25:55 [45038.150030] z_wr_int_3 282990 6977396.695232 2 100 0.000000 0.005419 0.000000 1 / 2018-04-08 13:25:55 [45038.161628] z_wr_int_3 282994 6977408.697713 2 100 0.000000 0.006055 0.000000 1 / 2018-04-08 13:25:55 [45038.173220] z_wr_int_3 282997 6977420.700390 2 100 0.000000 0.005476 0.000000 1 / 2018-04-08 13:25:55 [45038.184805] z_wr_int_3 283000 6977444.706014 2 100 0.000000 0.005230 0.000000 1 / 2018-04-08 13:25:55 [45038.196390] z_wr_int_3 283003 6977456.708665 2 100 0.000000 0.005750 0.000000 1 / 2018-04-08 13:25:55 [45038.207962] z_wr_int_3 283004 6977468.711318 2 100 0.000000 0.005127 0.000000 1 / 2018-04-08 13:25:55 [45038.219539] 2018-04-08 13:25:55 [45038.221394] cpu#10, 3200.000 MHz 2018-04-08 13:25:55 [45038.224978] .nr_running : 0 2018-04-08 13:25:55 [45038.229947] .load : 1024 2018-04-08 13:25:55 [45038.235175] .nr_switches : 776991564 2018-04-08 13:25:55 [45038.240829] .nr_load_updates : 18369584 2018-04-08 13:25:55 [45038.246393] .nr_uninterruptible : -133 2018-04-08 13:25:55 [45038.251611] .next_balance : 4339.814672 2018-04-08 13:25:55 [45038.257435] .curr->pid : 29210 2018-04-08 13:25:55 [45038.262728] .clock : 45038262.706391 2018-04-08 13:25:55 [45038.268882] .cpu_load[0] : 1024 2018-04-08 13:25:55 [45038.274082] .cpu_load[1] : 62 2018-04-08 13:25:55 [45038.279109] .cpu_load[2] : 514 2018-04-08 13:25:55 [45038.284212] .cpu_load[3] : 531 2018-04-08 13:25:55 [45038.289312] .cpu_load[4] : 581 2018-04-08 13:25:55 [45038.294404] .avg_idle : 10422 2018-04-08 13:25:55 [45038.299669] .max_idle_balance_cost : 500000 2018-04-08 13:25:55 [45038.305016] 2018-04-08 13:25:55 [45038.305016] cfs_rq[10]:/ 2018-04-08 13:25:55 [45038.309621] .exec_clock : 0.000000 2018-04-08 13:25:55 [45038.315133] .MIN_vruntime : 0.000001 2018-04-08 13:25:55 [45038.320643] .min_vruntime : 6618570.499834 2018-04-08 13:25:55 [45038.326668] .max_vruntime : 0.000001 2018-04-08 13:25:55 [45038.332174] .spread : 0.000000 2018-04-08 13:25:55 [45038.337674] .spread0 : -548686.594875 2018-04-08 13:25:55 [45038.343690] .nr_spread_over : 0 2018-04-08 13:25:55 [45038.348578] .nr_running : 1 2018-04-08 13:25:55 [45038.353458] .load : 0 2018-04-08 13:25:55 [45038.358340] .runnable_load_avg : 524 2018-04-08 13:25:55 [45038.363386] .blocked_load_avg : 0 2018-04-08 13:25:55 [45038.368257] .tg_load_avg : 0 2018-04-08 13:25:55 [45038.373121] .tg_load_contrib : 0 2018-04-08 13:25:55 [45038.377982] .tg_runnable_contrib : 0 2018-04-08 13:25:55 [45038.382839] .tg->runnable_avg : 0 2018-04-08 13:25:55 [45038.387699] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:55 [45038.392557] .throttled : 0 2018-04-08 13:25:55 [45038.397413] .throttle_count : 0 2018-04-08 13:25:55 [45038.402262] .avg->runnable_avg_sum : 23596 2018-04-08 13:25:55 [45038.407452] .avg->runnable_avg_period : 46180 2018-04-08 13:25:55 [45038.412635] 2018-04-08 13:25:55 [45038.412635] rt_rq[10]:/ 2018-04-08 13:25:55 [45038.417004] .rt_nr_running : 0 2018-04-08 13:25:55 [45038.421842] .rt_throttled : 0 2018-04-08 13:25:55 [45038.426673] .rt_time : 0.000000 2018-04-08 13:25:55 [45038.432112] .rt_runtime : 950.000000 2018-04-08 13:25:55 [45038.437723] 2018-04-08 13:25:55 [45038.437723] runnable tasks: 2018-04-08 13:25:55 [45038.437723] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:55 [45038.437723] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:55 [45038.464276] migration/10 59 0.000000 390 0 0.000000 945.483871 0.000000 0 / 2018-04-08 13:25:55 [45038.475674] ksoftirqd/10 60 6617905.619573 83146 120 0.000000 294.687462 0.000000 0 / 2018-04-08 13:25:55 [45038.487074] kworker/10:0H 62 2991.056539 8 100 0.000000 0.022079 0.000000 0 / 2018-04-08 13:25:55 [45038.498475] kworker/10:1 341 6417.470228 109 120 0.000000 2.978583 0.000000 0 / 2018-04-08 13:25:55 [45038.509872] scsi_eh_1 345 85.522060 2 120 0.000000 0.004982 0.000000 0 / 2018-04-08 13:25:55 [45038.521263] multipathd 4267 0.000000 8 0 0.000000 4.883929 0.000000 0 / 2018-04-08 13:25:55 [45038.532676] kworker/10:1H 4241 6618131.971142 90872 100 0.000000 128.246555 0.000000 0 / 2018-04-08 13:25:55 [45038.544091] kworker/10:4 6846 6618475.165518 36718 120 0.000000 224.067883 0.000000 0 / 2018-04-08 13:25:55 [45038.555499] kdmflush 7813 3261.570690 2 100 0.000000 0.004835 0.000000 0 / 2018-04-08 13:25:55 [45038.566908] zed 8932 8229.853746 191 120 0.000000 26.665811 0.000000 0 / 2018-04-08 13:25:55 [45038.578341] pcsd 14515 6615751.916261 7357 120 0.000000 2184.834621 0.000000 0 / 2018-04-08 13:25:55 [45038.589768] z_rd_int_4 18793 9049.592450 265 100 0.000000 2.300331 0.000000 0 / 2018-04-08 13:25:56 [45038.601203] z_wr_iss 18806 9172.745516 122 101 0.000000 3.929290 0.000000 0 / 2018-04-08 13:25:56 [45038.612639] z_wr_iss 18807 9172.747747 117 101 0.000000 3.994657 0.000000 0 / 2018-04-08 13:25:56 [45038.624085] z_wr_iss 18808 9172.745763 126 101 0.000000 3.186234 0.000000 0 / 2018-04-08 13:25:56 [45038.635530] z_wr_int_2 18812 9196.751743 698 100 0.000000 6.234644 0.000000 0 / 2018-04-08 13:25:56 [45038.646980] dp_sync_taskq 18848 9173.992542 156 139 0.000000 1.193173 0.000000 0 / 2018-04-08 13:25:56 [45038.658424] z_wr_iss 19346 163071.099366 202 101 0.000000 8.984409 0.000000 0 / 2018-04-08 13:25:56 [45038.669885] z_rd_int_2 19958 17221.076557 685 100 0.000000 7.546576 0.000000 0 / 2018-04-08 13:25:56 [45038.681342] z_wr_iss 19967 10836.422171 149 101 0.000000 6.021378 0.000000 0 / 2018-04-08 13:25:56 [45038.692810] dp_sync_taskq 20006 10836.832635 123 139 0.000000 1.238394 0.000000 0 / 2018-04-08 13:25:56 [45038.704278] dp_sync_taskq 20016 10840.992510 136 139 0.000000 1.608927 0.000000 0 / 2018-04-08 13:25:56 [45038.715741] txg_sync 20187 6618448.413704 18030 120 0.000000 386.307048 0.000000 0 / 2018-04-08 13:25:56 [45038.727213] z_wr_iss 20548 13139.870659 176 101 0.000000 6.981073 0.000000 0 / 2018-04-08 13:25:56 [45038.738689] metaslab_group_ 20582 18072.578086 27 100 0.000000 0.221459 0.000000 0 / 2018-04-08 13:25:56 [45038.750174] z_wr_iss 21261 10341.384624 66 101 0.000000 2.777956 0.000000 0 / 2018-04-08 13:25:56 [45038.761661] z_rd_int_1 21853 6503201.472706 3305 100 0.000000 33.444497 0.000000 0 / 2018-04-08 13:25:56 [45038.773152] z_rd_int_2 21854 6503201.472616 3297 100 0.000000 33.091696 0.000000 0 / 2018-04-08 13:25:56 [45038.784635] z_rd_int_5 21857 6503201.472545 3230 100 0.000000 33.600636 0.000000 0 / 2018-04-08 13:25:56 [45038.796117] z_rd_int_7 21859 6503201.473857 3281 100 0.000000 33.773513 0.000000 0 / 2018-04-08 13:25:56 [45038.807612] z_wr_iss 22442 6455071.704002 661 101 0.000000 23.242380 0.000000 0 / 2018-04-08 13:25:56 [45038.819103] z_wr_int_5 22456 6455071.705498 3321 100 0.000000 30.380485 0.000000 0 / 2018-04-08 13:25:56 [45038.830597] dp_sync_taskq 22484 6455074.113642 779 139 0.000000 5.251092 0.000000 0 / 2018-04-08 13:25:56 [45038.842088] dp_sync_taskq 22485 6455074.954138 777 139 0.000000 5.638004 0.000000 0 / 2018-04-08 13:25:56 [45038.853576] dp_sync_taskq 22488 6455074.640248 792 139 0.000000 5.232902 0.000000 0 / 2018-04-08 13:25:56 [45038.865080] txg_sync 22584 6618475.224485 19193 120 0.000000 450.990421 0.000000 0 / 2018-04-08 13:25:56 [45038.876592] ldlm_cn00_002 23116 6617106.937909 21481 120 0.000000 332.358112 0.000000 0 / 2018-04-08 13:25:56 [45038.888092] ll_mgs_0001 23133 6618083.422024 151290 120 0.000000 3952.218850 0.000000 0 / 2018-04-08 13:25:56 [45038.899595] mgs_images_noti 23209 8257.005669 24 118 0.000000 0.760773 0.000000 0 / 2018-04-08 13:25:56 [45038.911100] mdt00_001 24007 6617776.798374 67905 120 0.000000 1536.909034 0.000000 0 / 2018-04-08 13:25:56 [45038.922623] mdt00_004 24110 6616572.680198 102499 120 0.000000 2369.599651 0.000000 0 / 2018-04-08 13:25:56 [45038.934142] lquota_wb_image 24237 6612337.222174 739 120 0.000000 9.581841 0.000000 0 / 2018-04-08 13:25:56 [45038.945672] osp-pre-6-0 26767 6618448.382553 8813 120 0.000000 170.843269 0.000000 0 / 2018-04-08 13:25:56 [45038.957200] osp-pre-7-0 26772 6618448.386969 8813 120 0.000000 172.182737 0.000000 0 / 2018-04-08 13:25:56 [45038.968735] osp-pre-10-1 28761 9039.634742 4 120 0.000000 0.027350 0.000000 0 / 2018-04-08 13:25:56 [45038.980275] osp-pre-13-1 28781 9039.631589 4 120 0.000000 0.020558 0.000000 0 / 2018-04-08 13:25:56 [45038.991804] qsd_reint_1.dag 29158 10351.165503 67 120 0.000000 0.779691 0.000000 0 / 2018-04-08 13:25:56 [45039.003320] lod0001_rec0000 29210 6618923.560746 2009523393 120 0.000000 22824699.518664 0.000000 0 / 2018-04-08 13:25:56 [45039.014931] tgt_recover_1 29650 6614589.159465 863 120 0.000000 1917.522940 0.000000 0 / 2018-04-08 13:25:56 [45039.026457] osp-pre-0-2 30392 10259.091859 4 120 0.000000 0.081206 0.000000 0 / 2018-04-08 13:25:56 [45039.037982] osp-pre-1-2 30401 10259.091877 4 120 0.000000 0.039045 0.000000 0 / 2018-04-08 13:25:56 [45039.049489] mdt_rdpg00_004 31989 6440983.475195 3368 120 0.000000 43.166244 0.000000 0 / 2018-04-08 13:25:56 [45039.061006] z_wr_int_7 282318 6455083.703571 4 100 0.000000 0.020088 0.000000 0 / 2018-04-08 13:25:56 [45039.072603] kworker/u896:0 282576 6618475.169368 12880 120 0.000000 524.982000 0.000000 0 / 2018-04-08 13:25:56 [45039.084222] z_wr_int_7 282961 6503333.640744 4 100 0.000000 0.011725 0.000000 0 / 2018-04-08 13:25:56 [45039.095863] 2018-04-08 13:25:56 [45039.097748] cpu#11, 3200.000 MHz 2018-04-08 13:25:56 [45039.101362] .nr_running : 1 2018-04-08 13:25:56 [45039.106359] .load : 1024 2018-04-08 13:25:56 [45039.111609] .nr_switches : 959242923 2018-04-08 13:25:56 [45039.117297] .nr_load_updates : 21798078 2018-04-08 13:25:56 [45039.122900] .nr_uninterruptible : -89 2018-04-08 13:25:56 [45039.128072] .next_balance : 4339.815553 2018-04-08 13:25:56 [45039.133932] .curr->pid : 35586 2018-04-08 13:25:56 [45039.139273] .clock : 45039139.212088 2018-04-08 13:25:56 [45039.145469] .cpu_load[0] : 1024 2018-04-08 13:25:56 [45039.150712] .cpu_load[1] : 896 2018-04-08 13:25:56 [45039.155859] .cpu_load[2] : 688 2018-04-08 13:25:56 [45039.161005] .cpu_load[3] : 885 2018-04-08 13:25:56 [45039.166149] .cpu_load[4] : 788 2018-04-08 13:25:56 [45039.171283] .avg_idle : 17879 2018-04-08 13:25:56 [45039.176588] .max_idle_balance_cost : 500000 2018-04-08 13:25:56 [45039.181972] 2018-04-08 13:25:56 [45039.181972] cfs_rq[11]:/ 2018-04-08 13:25:56 [45039.186643] .exec_clock : 0.000000 2018-04-08 13:25:56 [45039.192190] .MIN_vruntime : 0.000001 2018-04-08 13:25:56 [45039.197740] .min_vruntime : 8269007.655129 2018-04-08 13:25:56 [45039.203808] .max_vruntime : 0.000001 2018-04-08 13:25:56 [45039.209353] .spread : 0.000000 2018-04-08 13:25:56 [45039.214891] .spread0 : 1101750.560420 2018-04-08 13:25:56 [45039.220950] .nr_spread_over : 0 2018-04-08 13:25:56 [45039.225886] .nr_running : 1 2018-04-08 13:25:56 [45039.230814] .load : 1024 2018-04-08 13:25:56 [45039.235998] .runnable_load_avg : 800 2018-04-08 13:25:56 [45039.241094] .blocked_load_avg : 0 2018-04-08 13:25:56 [45039.246018] .tg_load_avg : 0 2018-04-08 13:25:56 [45039.250929] .tg_load_contrib : 0 2018-04-08 13:25:56 [45039.255833] .tg_runnable_contrib : 0 2018-04-08 13:25:56 [45039.260731] .tg->runnable_avg : 0 2018-04-08 13:25:56 [45039.265628] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:56 [45039.270521] .throttled : 0 2018-04-08 13:25:56 [45039.275415] .throttle_count : 0 2018-04-08 13:25:56 [45039.280302] .avg->runnable_avg_sum : 36708 2018-04-08 13:25:56 [45039.285536] .avg->runnable_avg_period : 46966 2018-04-08 13:25:56 [45039.290771] 2018-04-08 13:25:56 [45039.290771] rt_rq[11]:/ 2018-04-08 13:25:56 [45039.295206] .rt_nr_running : 0 2018-04-08 13:25:56 [45039.300066] .rt_throttled : 0 2018-04-08 13:25:56 [45039.304931] .rt_time : 0.000000 2018-04-08 13:25:56 [45039.310391] .rt_runtime : 950.000000 2018-04-08 13:25:56 [45039.316018] 2018-04-08 13:25:56 [45039.316018] runnable tasks: 2018-04-08 13:25:56 [45039.316018] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:56 [45039.316018] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:56 [45039.342589] migration/11 64 0.000000 478 0 0.000000 948.860579 0.000000 1 / 2018-04-08 13:25:56 [45039.353986] ksoftirqd/11 65 8268384.726951 13651 120 0.000000 60.003629 0.000000 1 / 2018-04-08 13:25:56 [45039.365377] kworker/11:0H 67 9229.238221 8 100 0.000000 0.022697 0.000000 1 / 2018-04-08 13:25:56 [45039.376786] scsi_eh_8 374 395.471384 22 120 0.000000 0.098870 0.000000 1 / 2018-04-08 13:25:56 [45039.388183] scsi_eh_9 376 395.562765 22 120 0.000000 0.200381 0.000000 1 / 2018-04-08 13:25:56 [45039.399594] kworker/11:1 415 8268920.841160 30078 120 0.000000 268.514430 0.000000 1 / 2018-04-08 13:25:56 [45039.411000] kworker/11:2 655 633.379009 2 120 0.000000 0.004157 0.000000 1 / 2018-04-08 13:25:56 [45039.422416] kdmflush 3746 3556.385712 2 100 0.000000 0.007042 0.000000 1 / 2018-04-08 13:25:56 [45039.433820] bioset 4147 4425.596710 2 100 0.000000 0.006743 0.000000 1 / 2018-04-08 13:25:56 [45039.445224] kworker/11:1H 7860 8268384.724849 13423 100 0.000000 19.696075 0.000000 1 / 2018-04-08 13:25:56 [45039.456644] zed 9142 13487.409769 41 120 0.000000 4.175878 0.000000 1 / 2018-04-08 13:25:56 [45039.468061] kdmflush 9244 10157.078193 2 100 0.000000 0.003890 0.000000 1 / 2018-04-08 13:25:56 [45039.479489] bioset 9257 10169.472293 2 100 0.000000 0.004553 0.000000 1 / 2018-04-08 13:25:56 [45039.490929] ruby-timer-thr 283814 8266728.145601 3 120 0.000000 0.073916 0.000000 1 / 2018-04-08 13:25:56 [45039.502463] z_rd_int_2 19334 231300.257330 639 100 0.000000 7.291984 0.000000 1 / 2018-04-08 13:25:56 [45039.513911] z_rd_iss 19955 30372.553034 23 100 0.000000 0.350809 0.000000 1 / 2018-04-08 13:25:56 [45039.525356] z_rd_int_7 19963 30372.651008 699 100 0.000000 7.764012 0.000000 1 / 2018-04-08 13:25:56 [45039.536807] z_wr_iss 19975 29419.287001 169 101 0.000000 5.901843 0.000000 1 / 2018-04-08 13:25:56 [45039.548256] z_wr_int_6 19983 29419.282856 637 100 0.000000 6.392281 0.000000 1 / 2018-04-08 13:25:56 [45039.559717] z_rd_int_3 20540 30372.932984 1569 100 0.000000 12.451140 0.000000 1 / 2018-04-08 13:25:56 [45039.571165] z_rd_int_4 20541 30372.809364 1540 100 0.000000 12.262240 0.000000 1 / 2018-04-08 13:25:56 [45039.582628] z_rd_int_6 20543 30372.777557 1583 100 0.000000 12.269883 0.000000 1 / 2018-04-08 13:25:56 [45039.594084] z_wr_iss 20546 30224.049033 181 101 0.000000 25.550442 0.000000 1 / 2018-04-08 13:25:57 [45039.605553] z_wr_iss 20552 30224.048469 182 101 0.000000 6.921447 0.000000 1 / 2018-04-08 13:25:57 [45039.617015] z_wr_int_5 20563 30224.043549 715 100 0.000000 7.144960 0.000000 1 / 2018-04-08 13:25:57 [45039.628493] z_wr_iss 21267 28967.022518 63 101 0.000000 2.774166 0.000000 1 / 2018-04-08 13:25:57 [45039.639972] z_wr_iss 21863 8114286.959664 13818 101 0.000000 614.427172 0.000000 1 / 2018-04-08 13:25:57 [45039.651445] z_wr_iss 21870 8114286.958331 13855 101 0.000000 624.517344 0.000000 1 / 2018-04-08 13:25:57 [45039.662916] z_wr_int_1 21874 8114286.958700 45715 100 0.000000 548.980943 0.000000 1 / 2018-04-08 13:25:57 [45039.674400] txg_quiesce 22014 8268315.470279 17798 120 0.000000 599.323361 0.000000 1 / 2018-04-08 13:25:57 [45039.685890] z_wr_int_6 22457 8069347.548913 3330 100 0.000000 31.835662 0.000000 1 / 2018-04-08 13:25:57 [45039.697376] obd_zombid 23042 18659.117968 2 120 0.000000 0.007382 0.000000 1 / 2018-04-08 13:25:57 [45039.708879] ptlrpcd_01_03 23097 8268315.445626 11553 120 0.000000 181.885847 0.000000 1 / 2018-04-08 13:25:57 [45039.720381] ldlm_cn01_003 23399 8044301.465727 38920 120 0.000000 300.549263 0.000000 1 / 2018-04-08 13:25:57 [45039.731880] ldlm_cn01_005 23517 8044301.465370 797013 120 0.000000 5822.318643 0.000000 1 / 2018-04-08 13:25:57 [45039.743385] osp-pre-0-0 25292 8268315.433529 10106 120 0.000000 216.187929 0.000000 1 / 2018-04-08 13:25:57 [45039.754882] osp-syn-0-0 25301 7345467.750993 15595 120 0.000000 370.252231 0.000000 1 / 2018-04-08 13:25:57 [45039.766388] osp-pre-12-0 26806 8268315.431448 8813 120 0.000000 160.229587 0.000000 1 / 2018-04-08 13:25:57 [45039.777888] mdt_rdpg01_003 27979 8044301.476455 4826 120 0.000000 55.647433 0.000000 1 / 2018-04-08 13:25:57 [45039.789413] osp-syn-15-2 30648 28029.563196 6 120 0.000000 0.402096 0.000000 1 / 2018-04-08 13:25:57 [45039.800941] mdt_rdpg01_007 32914 8044301.465692 11543 120 0.000000 104.525868 0.000000 1 / 2018-04-08 13:25:57 [45039.812472] R mdt_out01_002 35586 8269491.501132 587641836 120 0.000000 12080478.864765 0.000000 1 / 2018-04-08 13:25:57 [45039.824012] z_wr_int_5 282327 8069347.548691 3 100 0.000000 0.016546 0.000000 1 / 2018-04-08 13:25:57 [45039.835650] 2018-04-08 13:25:57 [45039.837556] cpu#12, 3200.000 MHz 2018-04-08 13:25:57 [45039.841200] .nr_running : 0 2018-04-08 13:25:57 [45039.846219] .load : 0 2018-04-08 13:25:57 [45039.851229] .nr_switches : 830647377 2018-04-08 13:25:57 [45039.856916] .nr_load_updates : 19330168 2018-04-08 13:25:57 [45039.862513] .nr_uninterruptible : 26 2018-04-08 13:25:57 [45039.867583] .next_balance : 4339.816291 2018-04-08 13:25:57 [45039.873437] .curr->pid : 0 2018-04-08 13:25:57 [45039.878424] .clock : 45039877.654863 2018-04-08 13:25:57 [45039.884621] .cpu_load[0] : 0 2018-04-08 13:25:57 [45039.889598] .cpu_load[1] : 32 2018-04-08 13:25:57 [45039.894658] .cpu_load[2] : 74 2018-04-08 13:25:57 [45039.899713] .cpu_load[3] : 49 2018-04-08 13:25:57 [45039.904762] .cpu_load[4] : 37 2018-04-08 13:25:57 [45039.909805] .avg_idle : 1000000 2018-04-08 13:25:57 [45039.915278] .max_idle_balance_cost : 500000 2018-04-08 13:25:57 [45039.920662] 2018-04-08 13:25:57 [45039.920662] cfs_rq[12]:/ 2018-04-08 13:25:57 [45039.925320] .exec_clock : 0.000000 2018-04-08 13:25:57 [45039.930857] .MIN_vruntime : 0.000001 2018-04-08 13:25:57 [45039.936388] .min_vruntime : 6982313.821738 2018-04-08 13:25:57 [45039.942440] .max_vruntime : 0.000001 2018-04-08 13:25:57 [45039.947970] .spread : 0.000000 2018-04-08 13:25:57 [45039.953497] .spread0 : -185008.761674 2018-04-08 13:25:57 [45039.959543] .nr_spread_over : 0 2018-04-08 13:25:57 [45039.964461] .nr_running : 0 2018-04-08 13:25:57 [45039.969375] .load : 0 2018-04-08 13:25:57 [45039.974284] .runnable_load_avg : 0 2018-04-08 13:25:57 [45039.979191] .blocked_load_avg : 0 2018-04-08 13:25:57 [45039.984099] .tg_load_avg : 0 2018-04-08 13:25:57 [45039.988998] .tg_load_contrib : 0 2018-04-08 13:25:57 [45039.993898] .tg_runnable_contrib : 0 2018-04-08 13:25:57 [45039.998798] .tg->runnable_avg : 0 2018-04-08 13:25:57 [45040.003694] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:57 [45040.008584] .throttled : 0 2018-04-08 13:25:57 [45040.013476] .throttle_count : 0 2018-04-08 13:25:57 [45040.018353] .avg->runnable_avg_sum : 326 2018-04-08 13:25:57 [45040.023399] .avg->runnable_avg_period : 47755 2018-04-08 13:25:57 [45040.028621] 2018-04-08 13:25:57 [45040.028621] rt_rq[12]:/ 2018-04-08 13:25:57 [45040.033052] .rt_nr_running : 0 2018-04-08 13:25:57 [45040.037918] .rt_throttled : 0 2018-04-08 13:25:57 [45040.042782] .rt_time : 0.000000 2018-04-08 13:25:57 [45040.048241] .rt_runtime : 950.000000 2018-04-08 13:25:57 [45040.053873] 2018-04-08 13:25:57 [45040.053873] runnable tasks: 2018-04-08 13:25:57 [45040.053873] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:57 [45040.053873] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:57 [45040.080427] migration/12 69 0.000000 336 0 0.000000 940.301050 0.000000 0 / 2018-04-08 13:25:57 [45040.091815] ksoftirqd/12 70 6982115.828823 75872 120 0.000000 265.505066 0.000000 0 / 2018-04-08 13:25:57 [45040.103209] kworker/12:0H 72 181.798054 8 100 0.000000 0.023297 0.000000 0 / 2018-04-08 13:25:57 [45040.114602] kworker/12:1H 600 6982115.826187 87697 100 0.000000 124.761421 0.000000 0 / 2018-04-08 13:25:57 [45040.125998] systemd-udevd 931 8665.535760 1361 120 0.000000 918.795428 0.000000 0 / 2018-04-08 13:25:57 [45040.137394] kworker/12:2 2952 6982127.119731 38926 120 0.000000 230.831312 0.000000 0 / 2018-04-08 13:25:57 [45040.148786] multipathd 4269 0.000000 7 0 0.000000 38.026119 0.000000 0 / 2018-04-08 13:25:57 [45040.160191] kdmwork-253:3 4176 6982115.833951 46673 120 0.000000 1080.780314 0.000000 0 / 2018-04-08 13:25:57 [45040.171608] kdmflush 4183 2718.026584 2 100 0.000000 0.005300 0.000000 0 / 2018-04-08 13:25:57 [45040.183018] kdmwork-253:5 4198 6982115.831948 48532 120 0.000000 957.774573 0.000000 0 / 2018-04-08 13:25:57 [45040.194443] kdmflush 4204 2730.030934 2 100 0.000000 0.004796 0.000000 0 / 2018-04-08 13:25:57 [45040.205880] kdmflush 4227 2742.034986 2 100 0.000000 0.004417 0.000000 0 / 2018-04-08 13:25:57 [45040.217313] dbu_evict 8861 6103544.992037 1489 120 0.000000 39.113616 0.000000 0 / 2018-04-08 13:25:57 [45040.228747] rsyslogd 8904 6965306.296851 79 120 0.000000 5.377606 0.000000 0 / 2018-04-08 13:25:57 [45040.240190] in:imjournal 8906 6982303.311870 58110 120 0.000000 1200.927482 0.000000 0 / 2018-04-08 13:25:57 [45040.251631] dbus-daemon 8915 11356.676007 444 120 0.000000 24.662637 0.000000 0 / 2018-04-08 13:25:57 [45040.263084] kworker/12:4 12475 5462.145839 7 120 0.000000 0.020979 0.000000 0 / 2018-04-08 13:25:57 [45040.274545] z_rd_int_0 18789 11220.114340 252 100 0.000000 2.212371 0.000000 0 / 2018-04-08 13:25:57 [45040.286003] z_wr_int_0 18810 11284.299754 721 100 0.000000 6.186578 0.000000 0 / 2018-04-08 13:25:57 [45040.297468] z_rd_iss 19331 17585.688333 34 100 0.000000 0.860936 0.000000 0 / 2018-04-08 13:25:57 [45040.308927] z_wr_iss 19347 190474.108020 196 101 0.000000 8.686688 0.000000 0 / 2018-04-08 13:25:57 [45040.320400] z_wr_int_0 19353 190474.106070 959 100 0.000000 9.570204 0.000000 0 / 2018-04-08 13:25:57 [45040.331882] z_wr_iss 19973 12568.749985 147 101 0.000000 5.577638 0.000000 0 / 2018-04-08 13:25:57 [45040.343355] z_wr_int_7 19984 12604.757921 623 100 0.000000 6.296415 0.000000 0 / 2018-04-08 13:25:57 [45040.354838] dp_sync_taskq 20015 12568.952292 113 139 0.000000 1.162933 0.000000 0 / 2018-04-08 13:25:57 [45040.366325] z_wr_int_4 20562 16472.419787 705 100 0.000000 7.216376 0.000000 0 / 2018-04-08 13:25:57 [45040.377812] z_wr_iss 21257 11753.455022 68 101 0.000000 5.245507 0.000000 0 / 2018-04-08 13:25:57 [45040.389316] txg_sync 21404 6982301.849053 17933 120 0.000000 387.399512 0.000000 0 / 2018-04-08 13:25:57 [45040.400810] z_wr_iss 21866 6865482.427919 13769 101 0.000000 619.797374 0.000000 0 / 2018-04-08 13:25:57 [45040.412322] z_wr_int_4 21877 6865482.426954 44922 100 0.000000 545.020004 0.000000 0 / 2018-04-08 13:25:57 [45040.423825] z_wr_iss 22448 6812272.936078 677 101 0.000000 21.695995 0.000000 0 / 2018-04-08 13:25:57 [45040.435342] z_wr_iss 22449 6812272.936291 667 101 0.000000 22.626556 0.000000 0 / 2018-04-08 13:25:57 [45040.446862] metaslab_group_ 22475 6813286.444463 155 100 0.000000 1.490295 0.000000 0 / 2018-04-08 13:25:57 [45040.458379] dp_sync_taskq 22491 6812273.333751 796 139 0.000000 5.503989 0.000000 0 / 2018-04-08 13:25:57 [45040.469898] kiblnd_sd_00_03 23077 6982301.868538 847850 120 0.000000 9146.715821 0.000000 0 / 2018-04-08 13:25:57 [45040.481433] tx_commit_cb 23398 11284.306300 18 120 0.000000 0.093993 0.000000 0 / 2018-04-08 13:25:57 [45040.492968] mdt_rdpg00_000 24012 6790740.474816 2655 120 0.000000 27.066968 0.000000 0 / 2018-04-08 13:25:57 [45040.504507] mdt_rdpg00_001 24013 6978730.688787 11748 120 0.000000 130.404403 0.000000 0 / 2018-04-08 13:25:57 [45040.516050] mdt00_005 24569 6980847.160883 95845 120 0.000000 2182.746589 0.000000 0 / 2018-04-08 13:25:57 [45040.527598] lquota_wb_apps- 24805 6978409.090565 739 120 0.000000 10.108558 0.000000 0 / 2018-04-08 13:25:57 [45040.539142] tx_commit_cb 25137 6812272.946088 93 120 0.000000 2.054804 0.000000 0 / 2018-04-08 13:25:57 [45040.550693] osp-pre-4-0 26756 6982114.287949 8813 120 0.000000 173.143507 0.000000 0 / 2018-04-08 13:25:57 [45040.562258] ldlm_cn00_007 28412 6810628.880171 26249 120 0.000000 362.635282 0.000000 0 / 2018-04-08 13:25:57 [45040.573810] osp-pre-5-1 28731 11216.578357 4 120 0.000000 0.024473 0.000000 0 / 2018-04-08 13:25:57 [45040.585377] osp-syn-12-1 28777 11212.453748 4 120 0.000000 0.098117 0.000000 0 / 2018-04-08 13:25:58 [45040.596953] osp-syn-15-1 28793 11212.459108 4 120 0.000000 0.102551 0.000000 0 / 2018-04-08 13:25:58 [45040.608515] dist_txn-2 31311 11344.338677 2 120 0.000000 0.030185 0.000000 0 / 2018-04-08 13:25:58 [45040.620070] tgt_recover_2 31538 6979013.158963 863 120 0.000000 117.548916 0.000000 0 / 2018-04-08 13:25:58 [45040.631604] mdt_rdpg00_005 31990 6790740.475415 5957 120 0.000000 85.396744 0.000000 0 / 2018-04-08 13:25:58 [45040.643146] mdt00_012 32615 6981307.766263 103100 120 0.000000 2273.103896 0.000000 0 / 2018-04-08 13:25:58 [45040.654681] mdt_rdpg00_011 34602 6790740.475207 2060 120 0.000000 25.068311 0.000000 0 / 2018-04-08 13:25:58 [45040.666222] z_wr_int_6 35156 12592.751816 2 100 0.000000 0.005398 0.000000 0 / 2018-04-08 13:25:58 [45040.677756] mdt_out00_003 35475 6982315.132391 112740811 120 0.000000 2245845.973903 0.000000 0 / 2018-04-08 13:25:58 [45040.689308] z_rd_int_3 37649 19590.169289 2 100 0.000000 0.007268 0.000000 0 / 2018-04-08 13:25:58 [45040.700852] mdt_rdpg00_017 276875 6790740.615974 40 120 0.000000 1.510185 0.000000 0 / 2018-04-08 13:25:58 [45040.712489] pickup 279397 6978739.294467 55 120 0.000000 9.733107 0.000000 0 / 2018-04-08 13:25:58 [45040.724126] z_wr_int_1 282311 6812272.935772 5 100 0.000000 0.020748 0.000000 0 / 2018-04-08 13:25:58 [45040.735783] 2018-04-08 13:25:58 [45040.737685] cpu#13, 3200.000 MHz 2018-04-08 13:25:58 [45040.741319] .nr_running : 0 2018-04-08 13:25:58 [45040.746344] .load : 0 2018-04-08 13:25:58 [45040.751362] .nr_switches : 995064907 2018-04-08 13:25:58 [45040.757063] .nr_load_updates : 22721196 2018-04-08 13:25:58 [45040.762678] .nr_uninterruptible : -45 2018-04-08 13:25:58 [45040.767855] .next_balance : 4339.817198 2018-04-08 13:25:58 [45040.773724] .curr->pid : 0 2018-04-08 13:25:58 [45040.778728] .clock : 45040778.683374 2018-04-08 13:25:58 [45040.784943] .cpu_load[0] : 0 2018-04-08 13:25:58 [45040.789944] .cpu_load[1] : 0 2018-04-08 13:25:58 [45040.794938] .cpu_load[2] : 0 2018-04-08 13:25:58 [45040.799927] .cpu_load[3] : 0 2018-04-08 13:25:58 [45040.804910] .cpu_load[4] : 52 2018-04-08 13:25:58 [45040.809969] .avg_idle : 77637 2018-04-08 13:25:58 [45040.815284] .max_idle_balance_cost : 500000 2018-04-08 13:25:58 [45040.820684] 2018-04-08 13:25:58 [45040.820684] cfs_rq[13]:/ 2018-04-08 13:25:58 [45040.825384] .exec_clock : 0.000000 2018-04-08 13:25:58 [45040.830941] .MIN_vruntime : 0.000001 2018-04-08 13:25:58 [45040.836495] .min_vruntime : 8889668.293780 2018-04-08 13:25:58 [45040.842566] .max_vruntime : 0.000001 2018-04-08 13:25:58 [45040.848111] .spread : 0.000000 2018-04-08 13:25:58 [45040.853657] .spread0 : 1722345.710368 2018-04-08 13:25:58 [45040.859712] .nr_spread_over : 0 2018-04-08 13:25:58 [45040.864642] .nr_running : 0 2018-04-08 13:25:58 [45040.869564] .load : 0 2018-04-08 13:25:58 [45040.874481] .runnable_load_avg : 0 2018-04-08 13:25:58 [45040.879396] .blocked_load_avg : 13 2018-04-08 13:25:58 [45040.884388] .tg_load_avg : 0 2018-04-08 13:25:58 [45040.889294] .tg_load_contrib : 0 2018-04-08 13:25:58 [45040.894190] .tg_runnable_contrib : 0 2018-04-08 13:25:58 [45040.899088] .tg->runnable_avg : 0 2018-04-08 13:25:58 [45040.903975] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:58 [45040.908860] .throttled : 0 2018-04-08 13:25:58 [45040.913746] .throttle_count : 0 2018-04-08 13:25:58 [45040.918627] .avg->runnable_avg_sum : 5533 2018-04-08 13:25:58 [45040.923767] .avg->runnable_avg_period : 46811 2018-04-08 13:25:58 [45040.928993] 2018-04-08 13:25:58 [45040.928993] rt_rq[13]:/ 2018-04-08 13:25:58 [45040.933425] .rt_nr_running : 0 2018-04-08 13:25:58 [45040.938289] .rt_throttled : 0 2018-04-08 13:25:58 [45040.943141] .rt_time : 0.000000 2018-04-08 13:25:58 [45040.948599] .rt_runtime : 950.000000 2018-04-08 13:25:58 [45040.954220] 2018-04-08 13:25:58 [45040.954220] runnable tasks: 2018-04-08 13:25:58 [45040.954220] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:58 [45040.954220] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:58 [45040.980768] kthreadd 2 8882536.287003 224546 120 0.000000 1924.430133 0.000000 1 / 2018-04-08 13:25:58 [45040.992156] migration/13 74 0.000000 447 0 0.000000 938.043388 0.000000 1 / 2018-04-08 13:25:58 [45041.003545] ksoftirqd/13 75 8889657.675070 13250 120 0.000000 84.527922 0.000000 1 / 2018-04-08 13:25:58 [45041.014936] kworker/13:0 76 8423.471560 24 120 0.000000 0.104458 0.000000 1 / 2018-04-08 13:25:58 [45041.026345] kworker/13:0H 77 5404.198639 8 100 0.000000 0.064481 0.000000 1 / 2018-04-08 13:25:58 [45041.037752] scsi_eh_11 380 131.968313 22 120 0.000000 0.314535 0.000000 1 / 2018-04-08 13:25:58 [45041.049168] kdmwork-253:0 4007 8889571.807316 46705 120 0.000000 1020.546660 0.000000 1 / 2018-04-08 13:25:58 [45041.060580] kdmwork-253:9 4239 8889657.577684 51851 120 0.000000 929.008075 0.000000 1 / 2018-04-08 13:25:58 [45041.071986] kdmwork-253:10 4254 8889657.598058 46049 120 0.000000 1028.535192 0.000000 1 / 2018-04-08 13:25:58 [45041.083391] kworker/13:1H 6111 8889657.673369 13162 100 0.000000 18.523337 0.000000 1 / 2018-04-08 13:25:58 [45041.094819] zvol 8230 8335.309427 2 100 0.000000 0.011671 0.000000 1 / 2018-04-08 13:25:58 [45041.106247] l2arc_feed 9131 8889629.101713 45106 120 0.000000 536.641223 0.000000 1 / 2018-04-08 13:25:58 [45041.117684] kworker/13:2 9145 8889655.282061 31290 120 0.000000 252.082701 0.000000 1 / 2018-04-08 13:25:58 [45041.129118] kdmwork-253:14 9259 8889655.282971 46472 120 0.000000 1018.743182 0.000000 1 / 2018-04-08 13:25:58 [45041.140562] z_null_int 18787 8889657.673400 89473 100 0.000000 602.155605 0.000000 1 / 2018-04-08 13:25:58 [45041.152011] z_wr_iss 18798 19252.950644 122 101 0.000000 4.472954 0.000000 1 / 2018-04-08 13:25:58 [45041.163470] mmp 18939 8889657.598152 89007 120 0.000000 1305.903875 0.000000 1 / 2018-04-08 13:25:58 [45041.174914] z_rd_int_1 19333 219655.508973 623 100 0.000000 7.875875 0.000000 1 / 2018-04-08 13:25:58 [45041.186382] z_rd_int_7 19339 219655.508930 577 100 0.000000 7.428536 0.000000 1 / 2018-04-08 13:25:58 [45041.197838] mmp 19595 8889735.128386 88996 120 0.000000 1518.871123 0.000000 1 / 2018-04-08 13:25:58 [45041.209297] z_wr_iss 19974 20402.264972 162 101 0.000000 5.687715 0.000000 1 / 2018-04-08 13:25:58 [45041.220778] z_wr_iss 20545 20762.342738 163 101 0.000000 7.653908 0.000000 1 / 2018-04-08 13:25:58 [45041.232250] z_wr_int_7 20565 20774.345567 773 100 0.000000 7.776420 0.000000 1 / 2018-04-08 13:25:58 [45041.243716] z_rd_int_1 21249 8743643.884264 898 100 0.000000 10.511912 0.000000 1 / 2018-04-08 13:25:58 [45041.255190] z_wr_iss 21260 20258.149772 58 101 0.000000 2.512108 0.000000 1 / 2018-04-08 13:25:58 [45041.266678] z_wr_int_1 21270 20258.147089 354 100 0.000000 3.272959 0.000000 1 / 2018-04-08 13:25:58 [45041.278161] dp_sync_taskq 21309 20261.251872 52 139 0.000000 0.629631 0.000000 1 / 2018-04-08 13:25:58 [45041.289647] z_wr_iss 21862 8743787.918123 13893 101 0.000000 617.131565 0.000000 1 / 2018-04-08 13:25:58 [45041.301143] z_wr_int_6 21879 8743823.926281 45566 100 0.000000 545.239305 0.000000 1 / 2018-04-08 13:25:58 [45041.312636] dp_sync_taskq 21905 8743790.383607 7015 139 0.000000 131.062884 0.000000 1 / 2018-04-08 13:25:58 [45041.324142] z_null_int 22428 8889657.581752 95448 100 0.000000 594.094090 0.000000 1 / 2018-04-08 13:25:58 [45041.335645] z_rd_int_2 22432 7512060.935601 1940 100 0.000000 21.375771 0.000000 1 / 2018-04-08 13:25:58 [45041.347158] z_rd_int_5 22435 7512060.935601 1805 100 0.000000 19.526267 0.000000 1 / 2018-04-08 13:25:58 [45041.358671] z_rd_int_6 22436 7512060.935591 1856 100 0.000000 21.440699 0.000000 1 / 2018-04-08 13:25:58 [45041.370188] ptlrpcd_01_05 23099 8889177.547391 11633 120 0.000000 182.047722 0.000000 1 / 2018-04-08 13:25:58 [45041.381701] ldlm_cn01_000 23117 8882586.538485 52318 120 0.000000 427.833617 0.000000 1 / 2018-04-08 13:25:58 [45041.393218] ll_mgs_0002 23134 8889656.864313 190037 120 0.000000 4940.322654 0.000000 1 / 2018-04-08 13:25:58 [45041.404748] mdt_out01_001 24023 8888940.725628 89861984 120 0.000000 1874524.367166 0.000000 1 / 2018-04-08 13:25:58 [45041.416276] mdt01_004 24565 8888791.626376 591444 120 0.000000 8288.225109 0.000000 1 / 2018-04-08 13:25:58 [45041.427817] ldlm_cn01_006 24800 8889751.036656 502486 120 0.000000 3671.204034 0.000000 1 / 2018-04-08 13:25:58 [45041.439353] osp-pre-3-0 26750 8889177.536212 8812 120 0.000000 157.487254 0.000000 1 / 2018-04-08 13:25:58 [45041.450898] osp-pre-8-0 26779 8889177.533869 8813 120 0.000000 165.429362 0.000000 1 / 2018-04-08 13:25:58 [45041.462434] osp_up1-0 26833 16384.728506 2 120 0.000000 0.010467 0.000000 1 / 2018-04-08 13:25:58 [45041.473986] mdt01_014 32616 8888791.626702 748891 120 0.000000 10451.503347 0.000000 1 / 2018-04-08 13:25:58 [45041.485544] mdt_rdpg01_005 32912 8643720.015335 1095040 120 0.000000 10570.626994 0.000000 1 / 2018-04-08 13:25:58 [45041.497107] mdt_rdpg01_012 32919 8694463.920491 690218 120 0.000000 6704.719690 0.000000 1 / 2018-04-08 13:25:58 [45041.508665] 2018-04-08 13:25:58 [45041.510570] cpu#14, 3200.000 MHz 2018-04-08 13:25:58 [45041.514192] .nr_running : 0 2018-04-08 13:25:58 [45041.519194] .load : 0 2018-04-08 13:25:58 [45041.524192] .nr_switches : 742488375 2018-04-08 13:25:58 [45041.529879] .nr_load_updates : 17872471 2018-04-08 13:25:58 [45041.535479] .nr_uninterruptible : -103 2018-04-08 13:25:58 [45041.540732] .next_balance : 4339.817973 2018-04-08 13:25:58 [45041.546584] .curr->pid : 29210 2018-04-08 13:25:58 [45041.551917] .clock : 45041551.909595 2018-04-08 13:25:58 [45041.558112] .cpu_load[0] : 1024 2018-04-08 13:25:58 [45041.563347] .cpu_load[1] : 120 2018-04-08 13:25:58 [45041.568494] .cpu_load[2] : 409 2018-04-08 13:25:58 [45041.573632] .cpu_load[3] : 585 2018-04-08 13:25:58 [45041.578771] .cpu_load[4] : 462 2018-04-08 13:25:58 [45041.583901] .avg_idle : 10958 2018-04-08 13:25:58 [45041.589194] .max_idle_balance_cost : 500000 2018-04-08 13:25:59 [45041.594578] 2018-04-08 13:25:59 [45041.594578] cfs_rq[14]:/ 2018-04-08 13:25:59 [45041.599234] .exec_clock : 0.000000 2018-04-08 13:25:59 [45041.604780] .MIN_vruntime : 0.000001 2018-04-08 13:25:59 [45041.610314] .min_vruntime : 6390643.790446 2018-04-08 13:25:59 [45041.616363] .max_vruntime : 0.000001 2018-04-08 13:25:59 [45041.621894] .spread : 0.000000 2018-04-08 13:25:59 [45041.627426] .spread0 : -776742.379010 2018-04-08 13:25:59 [45041.633475] .nr_spread_over : 0 2018-04-08 13:25:59 [45041.638391] .nr_running : 1 2018-04-08 13:25:59 [45041.643305] .load : 0 2018-04-08 13:25:59 [45041.648211] .runnable_load_avg : 519 2018-04-08 13:25:59 [45041.653292] .blocked_load_avg : 519 2018-04-08 13:25:59 [45041.658361] .tg_load_avg : 0 2018-04-08 13:25:59 [45041.663258] .tg_load_contrib : 0 2018-04-08 13:25:59 [45041.668147] .tg_runnable_contrib : 0 2018-04-08 13:25:59 [45041.673035] .tg->runnable_avg : 0 2018-04-08 13:25:59 [45041.677921] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:25:59 [45041.682805] .throttled : 0 2018-04-08 13:25:59 [45041.687687] .throttle_count : 0 2018-04-08 13:25:59 [45041.692565] .avg->runnable_avg_sum : 23090 2018-04-08 13:25:59 [45041.697786] .avg->runnable_avg_period : 46495 2018-04-08 13:25:59 [45041.703004] 2018-04-08 13:25:59 [45041.703004] rt_rq[14]:/ 2018-04-08 13:25:59 [45041.707420] .rt_nr_running : 0 2018-04-08 13:25:59 [45041.712276] .rt_throttled : 0 2018-04-08 13:25:59 [45041.717131] .rt_time : 0.000000 2018-04-08 13:25:59 [45041.722586] .rt_runtime : 950.000000 2018-04-08 13:25:59 [45041.728208] 2018-04-08 13:25:59 [45041.728208] runnable tasks: 2018-04-08 13:25:59 [45041.728208] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:25:59 [45041.728208] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:25:59 [45041.754776] migration/14 79 0.000000 308 0 0.000000 2712.465485 0.000000 0 / 2018-04-08 13:25:59 [45041.766167] ksoftirqd/14 80 6389585.553803 77876 120 0.000000 270.684738 0.000000 0 / 2018-04-08 13:25:59 [45041.777558] kworker/14:0H 82 4433.979137 11 100 0.000000 0.025868 0.000000 0 / 2018-04-08 13:25:59 [45041.788960] scsi_tmf_1 346 110.001237 2 100 0.000000 0.005254 0.000000 0 / 2018-04-08 13:25:59 [45041.800370] fw_event_mpt3sa 347 122.005171 2 100 0.000000 0.004272 0.000000 0 / 2018-04-08 13:25:59 [45041.811777] scsi_eh_15 388 8999.893590 125 120 0.000000 2.772158 0.000000 0 / 2018-04-08 13:25:59 [45041.823183] kmpathd 1449 735.917999 2 100 0.000000 0.003516 0.000000 0 / 2018-04-08 13:25:59 [45041.834599] multipathd 4271 0.000000 9 0 0.000000 2.837495 0.000000 0 / 2018-04-08 13:25:59 [45041.846004] bioset 8850 3606.259141 2 100 0.000000 0.004914 0.000000 0 / 2018-04-08 13:25:59 [45041.857418] xfsalloc 8851 3618.263877 2 100 0.000000 0.005109 0.000000 0 / 2018-04-08 13:25:59 [45041.868842] xfs_mru_cache 8852 3630.267818 2 100 0.000000 0.004281 0.000000 0 / 2018-04-08 13:25:59 [45041.880258] xfs-buf/dm-13 8853 3642.272097 2 100 0.000000 0.004810 0.000000 0 / 2018-04-08 13:25:59 [45041.891680] xfs-data/dm-13 8854 3654.275960 2 100 0.000000 0.004206 0.000000 0 / 2018-04-08 13:25:59 [45041.903097] xfs-conv/dm-13 8855 3666.279856 2 100 0.000000 0.004217 0.000000 0 / 2018-04-08 13:25:59 [45041.914517] xfs-cil/dm-13 8856 3678.283728 2 100 0.000000 0.004212 0.000000 0 / 2018-04-08 13:25:59 [45041.925939] xfs-reclaim/dm- 8857 3690.287900 2 100 0.000000 0.004509 0.000000 0 / 2018-04-08 13:25:59 [45041.937352] xfs-log/dm-13 8858 3702.291694 2 100 0.000000 0.004152 0.000000 0 / 2018-04-08 13:25:59 [45041.948774] xfs-eofblocks/d 8859 3714.295870 2 100 0.000000 0.004539 0.000000 0 / 2018-04-08 13:25:59 [45041.960196] xfsaild/dm-13 8860 3726.300282 2 120 0.000000 0.004418 0.000000 0 / 2018-04-08 13:25:59 [45041.971629] rpciod 8899 3846.822882 2 100 0.000000 0.005140 0.000000 0 / 2018-04-08 13:25:59 [45041.983051] xprtiod 8900 3858.826785 2 100 0.000000 0.004208 0.000000 0 / 2018-04-08 13:25:59 [45041.994482] rdma-ndd 8950 7230.456609 4 120 0.000000 3.213509 0.000000 0 / 2018-04-08 13:25:59 [45042.005923] kworker/14:1H 9659 6390244.500094 95697 100 0.000000 169.077737 0.000000 0 / 2018-04-08 13:25:59 [45042.017368] gdbus 15451 8570.058932 126 120 0.000000 4.339945 0.000000 0 / 2018-04-08 13:25:59 [45042.028819] z_wr_iss 18800 10408.858052 122 101 0.000000 3.552117 0.000000 0 / 2018-04-08 13:25:59 [45042.040270] z_ioctl_int 18831 10420.861959 69 100 0.000000 0.260626 0.000000 0 / 2018-04-08 13:25:59 [45042.051727] metaslab_group_ 18834 10420.861962 57 100 0.000000 0.196461 0.000000 0 / 2018-04-08 13:25:59 [45042.063184] z_wr_iss 19343 178612.108428 193 101 0.000000 8.721872 0.000000 0 / 2018-04-08 13:25:59 [45042.074654] z_wr_int_7 19360 178624.109910 1003 100 0.000000 9.963288 0.000000 0 / 2018-04-08 13:25:59 [45042.086113] dp_sync_taskq 19381 178616.048962 153 139 0.000000 2.460316 0.000000 0 / 2018-04-08 13:25:59 [45042.097591] dp_sync_taskq 19392 178613.908307 150 139 0.000000 2.861832 0.000000 0 / 2018-04-08 13:25:59 [45042.109057] z_rd_int_1 19957 15089.550464 679 100 0.000000 7.610951 0.000000 0 / 2018-04-08 13:25:59 [45042.120532] z_rd_int_6 19962 15089.548871 716 100 0.000000 8.060381 0.000000 0 / 2018-04-08 13:25:59 [45042.132004] z_wr_iss 19971 11671.303007 157 101 0.000000 6.089065 0.000000 0 / 2018-04-08 13:25:59 [45042.143487] z_wr_iss 19972 11671.304627 169 101 0.000000 5.371105 0.000000 0 / 2018-04-08 13:25:59 [45042.154971] z_wr_int_3 19980 11683.307063 628 100 0.000000 6.501511 0.000000 0 / 2018-04-08 13:25:59 [45042.166447] dp_sync_taskq 20013 11671.476323 107 139 0.000000 1.129494 0.000000 0 / 2018-04-08 13:25:59 [45042.177939] txg_quiesce 20186 6389907.622207 17777 120 0.000000 601.580989 0.000000 0 / 2018-04-08 13:25:59 [45042.189434] z_wr_int_6 20564 13380.444464 708 100 0.000000 7.557971 0.000000 0 / 2018-04-08 13:25:59 [45042.200931] z_ioctl_int 20579 13380.444282 49 100 0.000000 0.219434 0.000000 0 / 2018-04-08 13:25:59 [45042.212419] dp_sync_taskq 20591 13389.093607 127 139 0.000000 2.289302 0.000000 0 / 2018-04-08 13:25:59 [45042.223924] txg_sync 20780 6389907.618905 18050 120 0.000000 388.268588 0.000000 0 / 2018-04-08 13:25:59 [45042.235438] dp_sync_taskq 21305 11378.091130 57 139 0.000000 0.635103 0.000000 0 / 2018-04-08 13:25:59 [45042.246951] z_wr_iss 21867 6292221.521047 13753 101 0.000000 621.875226 0.000000 0 / 2018-04-08 13:25:59 [45042.258470] z_wr_int_3 21876 6292221.520427 45909 100 0.000000 551.809412 0.000000 0 / 2018-04-08 13:25:59 [45042.269992] z_wr_int_5 21878 6292221.521944 45763 100 0.000000 546.339236 0.000000 0 / 2018-04-08 13:25:59 [45042.281508] dp_sync_taskq 21902 6292227.652864 6868 139 0.000000 131.951688 0.000000 0 / 2018-04-08 13:25:59 [45042.293015] z_wr_iss 22444 6246755.066885 673 101 0.000000 22.351767 0.000000 0 / 2018-04-08 13:25:59 [45042.304512] z_wr_iss 22446 6246755.065733 676 101 0.000000 22.223180 0.000000 0 / 2018-04-08 13:25:59 [45042.316007] dp_sync_taskq 22487 6246756.495136 769 139 0.000000 5.129068 0.000000 0 / 2018-04-08 13:25:59 [45042.327496] dp_sync_taskq 22489 6246759.087882 786 139 0.000000 5.648887 0.000000 0 / 2018-04-08 13:25:59 [45042.338994] kiblnd_sd_00_03 23077 6390854.584952 847873 120 0.000000 9146.881022 0.000000 0 / 2018-04-08 13:25:59 [45042.350479] ptlrpcd_00_00 23086 6390854.540419 75227 120 0.000000 1473.202249 0.000000 0 / 2018-04-08 13:25:59 [45042.361968] ldlm_cn00_001 23115 6243417.164288 9574 120 0.000000 102.517643 0.000000 0 / 2018-04-08 13:25:59 [45042.373469] osp-pre-0-0 24679 6390854.546574 8823 120 0.000000 160.800555 0.000000 0 / 2018-04-08 13:25:59 [45042.384966] osp-syn-1-0 25318 5632270.202727 15375 120 0.000000 373.314028 0.000000 0 / 2018-04-08 13:25:59 [45042.396465] ldlm_cn00_006 26131 6229667.463218 21107 120 0.000000 371.692074 0.000000 0 / 2018-04-08 13:25:59 [45042.407951] osp-pre-1-0 26744 6390257.228160 8813 120 0.000000 157.729193 0.000000 0 / 2018-04-08 13:25:59 [45042.419448] osp-syn-14-1 28788 10305.750488 4 120 0.000000 0.108986 0.000000 0 / 2018-04-08 13:25:59 [45042.430959] mdt_rdpg00_003 31988 6229667.428875 5072 120 0.000000 64.197691 0.000000 0 / 2018-04-08 13:25:59 [45042.442467] mdt00_010 32613 6390854.553638 92804 120 0.000000 2116.125672 0.000000 0 / 2018-04-08 13:25:59 [45042.453979] kworker/u897:0 32659 6387111.777123 158 120 0.000000 2.412376 0.000000 0 / 2018-04-08 13:25:59 [45042.465491] mdt_rdpg00_013 34722 6229667.428906 8049 120 0.000000 76.919003 0.000000 0 / 2018-04-08 13:25:59 [45042.477008] R mdt_out00_004 37366 6390930.146884 449594384 120 0.000000 10848450.530930 0.000000 0 / 2018-04-08 13:25:59 [45042.488530] kworker/14:1 60930 6390854.548119 47723 120 0.000000 353.293987 0.000000 0 / 2018-04-08 13:25:59 [45042.500057] z_wr_int_5 282325 6246755.065432 4 100 0.000000 0.014996 0.000000 0 / 2018-04-08 13:25:59 [45042.511684] kworker/14:0 282636 6354487.119228 4 120 0.000000 0.053843 0.000000 0 / 2018-04-08 13:25:59 [45042.523306] kworker/14:2 283584 6384342.608416 4 120 0.000000 0.046033 0.000000 0 / 2018-04-08 13:25:59 [45042.534942] 2018-04-08 13:25:59 [45042.536842] cpu#15, 3200.000 MHz 2018-04-08 13:25:59 [45042.540470] .nr_running : 0 2018-04-08 13:25:59 [45042.545475] .load : 0 2018-04-08 13:25:59 [45042.550476] .nr_switches : 1071135314 2018-04-08 13:25:59 [45042.556259] .nr_load_updates : 24006687 2018-04-08 13:25:59 [45042.561868] .nr_uninterruptible : -61 2018-04-08 13:25:59 [45042.567031] .next_balance : 4339.818994 2018-04-08 13:25:59 [45042.572886] .curr->pid : 0 2018-04-08 13:25:59 [45042.577877] .clock : 45042577.081798 2018-04-08 13:25:59 [45042.584077] .cpu_load[0] : 0 2018-04-08 13:25:59 [45042.589064] .cpu_load[1] : 0 2018-04-08 13:26:00 [45042.594049] .cpu_load[2] : 0 2018-04-08 13:26:00 [45042.599033] .cpu_load[3] : 0 2018-04-08 13:26:00 [45042.604007] .cpu_load[4] : 0 2018-04-08 13:26:00 [45042.608972] .avg_idle : 1000000 2018-04-08 13:26:00 [45042.614461] .max_idle_balance_cost : 500000 2018-04-08 13:26:00 [45042.619851] 2018-04-08 13:26:00 [45042.619851] cfs_rq[15]:/ 2018-04-08 13:26:00 [45042.624536] .exec_clock : 0.000000 2018-04-08 13:26:00 [45042.630092] .MIN_vruntime : 0.000001 2018-04-08 13:26:00 [45042.635638] .min_vruntime : 9545938.174643 2018-04-08 13:26:00 [45042.641702] .max_vruntime : 0.000001 2018-04-08 13:26:00 [45042.647238] .spread : 0.000000 2018-04-08 13:26:00 [45042.652776] .spread0 : 2378226.289451 2018-04-08 13:26:00 [45042.658827] .nr_spread_over : 0 2018-04-08 13:26:00 [45042.663750] .nr_running : 0 2018-04-08 13:26:00 [45042.668675] .load : 0 2018-04-08 13:26:00 [45042.673590] .runnable_load_avg : 0 2018-04-08 13:26:00 [45042.678507] .blocked_load_avg : 0 2018-04-08 13:26:00 [45042.683416] .tg_load_avg : 0 2018-04-08 13:26:00 [45042.688323] .tg_load_contrib : 0 2018-04-08 13:26:00 [45042.693226] .tg_runnable_contrib : 0 2018-04-08 13:26:00 [45042.698125] .tg->runnable_avg : 0 2018-04-08 13:26:00 [45042.703020] .tg->cfs_bandwidth.timer_active: 0 2018-04-08 13:26:00 [45042.707913] .throttled : 0 2018-04-08 13:26:00 [45042.712802] .throttle_count : 0 2018-04-08 13:26:00 [45042.717683] .avg->runnable_avg_sum : 32 2018-04-08 13:26:00 [45042.722647] .avg->runnable_avg_period : 47452 2018-04-08 13:26:00 [45042.727867] 2018-04-08 13:26:00 [45042.727867] rt_rq[15]:/ 2018-04-08 13:26:00 [45042.732294] .rt_nr_running : 0 2018-04-08 13:26:00 [45042.737154] .rt_throttled : 0 2018-04-08 13:26:00 [45042.742005] .rt_time : 0.000000 2018-04-08 13:26:00 [45042.747456] .rt_runtime : 950.000000 2018-04-08 13:26:00 [45042.753066] 2018-04-08 13:26:00 [45042.753066] runnable tasks: 2018-04-08 13:26:00 [45042.753066] task PID tree-key switches prio wait-time sum-exec sum-sleep 2018-04-08 13:26:00 [45042.753066] ---------------------------------------------------------------------------------------------------------- 2018-04-08 13:26:00 [45042.779602] rcu_sched 10 9545926.311215 1754329 120 0.000000 13944.773163 0.000000 1 / 2018-04-08 13:26:00 [45042.790989] migration/15 84 0.000000 416 0 0.000000 987.232445 0.000000 1 / 2018-04-08 13:26:00 [45042.802381] ksoftirqd/15 85 9545303.965444 12680 120 0.000000 52.185084 0.000000 1 / 2018-04-08 13:26:00 [45042.813771] kworker/15:0 86 9545926.177528 32172 120 0.000000 262.361657 0.000000 1 / 2018-04-08 13:26:00 [45042.825167] kworker/15:0H 87 5066.141942 8 100 0.000000 0.022942 0.000000 1 / 2018-04-08 13:26:00 [45042.836560] kworker/15:1 124 11517.182274 196 120 0.000000 8.951912 0.000000 1 / 2018-04-08 13:26:00 [45042.847975] scsi_eh_14 386 186.899786 22 120 0.000000 0.220625 0.000000 1 / 2018-04-08 13:26:00 [45042.859379] spl_kmem_cache 3644 9395205.752987 414 100 0.000000 27.521093 0.000000 1 / 2018-04-08 13:26:00 [45042.870798] kworker/15:1H 6112 9545303.963407 12883 100 0.000000 18.914095 0.000000 1 / 2018-04-08 13:26:00 [45042.882213] bioset 7787 7193.827392 2 100 0.000000 0.005684 0.000000 1 / 2018-04-08 13:26:00 [45042.893641] bioset 7799 7238.089781 2 100 0.000000 0.006461 0.000000 1 / 2018-04-08 13:26:00 [45042.905067] z_null_int 18787 9545926.174689 89477 100 0.000000 602.170663 0.000000 1 / 2018-04-08 13:26:00 [45042.916512] mmp 18939 9545926.180945 89011 120 0.000000 1305.926562 0.000000 1 / 2018-04-08 13:26:00 [45042.927955] z_wr_iss 19968 19358.343532 172 101 0.000000 5.809768 0.000000 1 / 2018-04-08 13:26:00 [45042.939396] z_wr_iss 20549 19911.201349 171 101 0.000000 7.608119 0.000000 1 / 2018-04-08 13:26:00 [45042.950832] z_wr_iss 20556 19911.197866 179 101 0.000000 7.000143 0.000000 1 / 2018-04-08 13:26:00 [45042.962280] dp_sync_taskq 20590 19913.103533 134 139 0.000000 1.835620 0.000000 1 / 2018-04-08 13:26:00 [45042.973732] dp_sync_taskq 20592 19912.429198 127 139 0.000000 2.199921 0.000000 1 / 2018-04-08 13:26:00 [45042.985168] z_wr_iss 21262 19166.199622 63 101 0.000000 2.890502 0.000000 1 / 2018-04-08 13:26:00 [45042.996612] z_wr_int_4 21273 19166.197002 327 100 0.000000 2.915991 0.000000 1 / 2018-04-08 13:26:00 [45043.008051] z_wr_int_6 21275 19166.196829 288 100 0.000000 3.092745 0.000000 1 / 2018-04-08 13:26:00 [45043.019509] dp_sync_taskq 21302 19174.003907 56 139 0.000000 0.442737 0.000000 1 / 2018-04-08 13:26:00 [45043.030978] z_wr_iss 21861 9397302.224610 13947 101 0.000000 615.262441 0.000000 1 / 2018-04-08 13:26:00 [45043.042439] z_wr_int_4 22455 9330400.897149 3364 100 0.000000 31.184553 0.000000 1 / 2018-04-08 13:26:00 [45043.053916] kiblnd_sd_01_03 23081 9545926.200593 9000590 120 0.000000 43763.696686 0.000000 1 / 2018-04-08 13:26:00 [45043.065385] ptlrpcd_01_07 23101 9545926.176711 11617 120 0.000000 179.064877 0.000000 1 / 2018-04-08 13:26:00 [45043.076863] ll_mgs_0002 23134 9545926.211739 190046 120 0.000000 4940.359750 0.000000 1 / 2018-04-08 13:26:00 [45043.088348] mdt01_001 24010 9543417.252181 726143 120 0.000000 10173.355136 0.000000 1 / 2018-04-08 13:26:00 [45043.099835] ldlm_cn01_006 24800 9545926.255149 502489 120 0.000000 3671.264040 0.000000 1 / 2018-04-08 13:26:00 [45043.111320] mdt01_007 25153 9543417.251410 715042 120 0.000000 9788.517518 0.000000 1 / 2018-04-08 13:26:00 [45043.122815] osp-pre-0-0 25292 9545926.185439 10107 120 0.000000 216.198725 0.000000 1 / 2018-04-08 13:26:00 [45043.134319] ldlm_cn01_008 26132 9533345.306185 45934 120 0.000000 439.041873 0.000000 1 / 2018-04-08 13:26:00 [45043.145821] osp-syn-2-0 26749 19178.337067 7 120 0.000000 0.244648 0.000000 1 / 2018-04-08 13:26:00 [45043.157314] osp-syn-4-0 26758 15704.144915 4 120 0.000000 0.115481 0.000000 1 / 2018-04-08 13:26:00 [45043.168829] osp-syn-6-0 26768 15704.144085 4 120 0.000000 0.096961 0.000000 1 / 2018-04-08 13:26:00 [45043.180337] osp-syn-7-0 26775 15644.032167 4 120 0.000000 0.098482 0.000000 1 / 2018-04-08 13:26:00 [45043.191854] osp-syn-11-0 26802 15644.035777 4 120 0.000000 0.095228 0.000000 1 / 2018-04-08 13:26:00 [45043.203363] osp-syn-12-0 26807 15704.141339 4 120 0.000000 0.098727 0.000000 1 / 2018-04-08 13:26:00 [45043.214876] osp-syn-13-0 26816 15644.056224 4 120 0.000000 0.124228 0.000000 1 / 2018-04-08 13:26:00 [45043.226386] osp-syn-15-0 26828 15644.031462 4 120 0.000000 0.091112 0.000000 1 / 2018-04-08 13:26:00 [45043.237896] z_wr_int_1 31031 18219.871625 2 100 0.000000 0.005570 0.000000 1 / 2018-04-08 13:26:00 [45043.249407] mdt01_009 32593 9545926.209567 927815 120 0.000000 13073.651420 0.000000 1 / 2018-04-08 13:26:00 [45043.260937] mdt01_011 32597 9545926.179167 779372 120 0.000000 10903.995944 0.000000 1 / 2018-04-08 13:26:00 [45043.272460] mdt_rdpg01_004 32911 9298050.329042 432653 120 0.000000 3981.829195 0.000000 1 / 2018-04-08 13:26:00 [45043.283989] mdt_rdpg01_011 32918 9302006.538061 3769 120 0.000000 36.516141 0.000000 1 / 2018-04-08 13:26:00 [45043.295526] mdt_rdpg01_014 32921 9372935.063702 21866 120 0.000000 213.983064 0.000000 1 / 2018-04-08 13:26:00 [45043.307054] z_wr_int_4 34467 19178.196632 3 100 0.000000 0.009102 0.000000 1 / 2018-04-08 13:26:00 [45043.318565] z_wr_int_7 35159 19370.341156 3 100 0.000000 0.014407 0.000000 1 / 2018-04-08 13:26:00 [45043.330067] z_wr_int_2 35444 19959.203602 2 100 0.000000 0.004912 0.000000 1 / 2018-04-08 13:26:00 [45043.341569] z_wr_int_2 35446 19983.208503 2 100 0.000000 0.005018 0.000000 1 / 2018-04-08 13:26:00 [45043.353063] z_wr_int_2 35449 20019.215611 2 100 0.000000 0.004878 0.000000 1 / 2018-04-08 13:26:00 [45043.364557] z_wr_int_2 35450 20031.218059 2 100 0.000000 0.004712 0.000000 1 / 2018-04-08 13:26:00 [45043.376043] z_wr_int_0 35457 20103.233189 2 100 0.000000 0.008200 0.000000 1 / 2018-04-08 13:26:00 [45043.387520] z_wr_int_0 35459 20115.235699 2 100 0.000000 0.005694 0.000000 1 / 2018-04-08 13:26:00 [45043.398994] z_wr_int_0 35460 20127.238277 2 100 0.000000 0.005130 0.000000 1 / 2018-04-08 13:26:00 [45043.410472] z_wr_int_0 35461 20139.240713 2 100 0.000000 0.004921 0.000000 1 / 2018-04-08 13:26:00 [45043.421942] z_wr_int_0 35463 20151.243359 2 100 0.000000 0.005449 0.000000 1 / 2018-04-08 13:26:00 [45043.433409] z_wr_int_0 35464 20163.245801 2 100 0.000000 0.004763 0.000000 1 / 2018-04-08 13:26:00 [45043.444873] z_wr_int_7 35466 20187.250796 2 100 0.000000 0.005010 0.000000 1 / 2018-04-08 13:26:00 [45043.456333] 2018-04-08 13:27:25 [45128.101834] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 2018-04-08 13:27:25 [45128.115506] Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages